We are looking for a talented Data Engineer with Data Science skills to join our AI Solutions team. The ideal candidate will have a strong foundation in data engineering and AI deployment, with hands-on experience in creating and deploying data pipelines, working with data lakes, and performing ETL processes. You will be responsible for designing, implementing, and maintaining scalable data and AI solutions to support our business needs.
Be part of team that designs and deploys AI Solutions to improve cost, quality and efficiency of manufacturing and development processes.
Key Responsibilities:
- Design, develop, and maintain data pipelines using Python, PySpark and SQL.
- Implement ETL processes to extract, transform, and load data from various sources.
- Develop image-based ML, DL models using pytorch, scikit-learn, etc.
- Deploy and manage containerized applications using Docker.
- Develop and maintain CI/CD pipelines to automate deployment processes.
- Collaborate with cross-functional teams to understand data and AI requirements and deliver solutions.
- Deploy and manage AI/ML models in production environments.
- Create and manage data lakes to store and process large volumes of data.
Required Skills:
- Proficiency in PySpark, Python, RDBMS and SQL.
- Writing optimized PySpark and SQL scripts using best practices.
- Experience in creating and deploying data pipelines.
- Knowledge of data lake architecture and management.
- Strong understanding of ETL processes.
- ML, DL Fundamentals.
- Frameworks like Pytorch, scikit-learn.
- EDA, Feature engineering, hyperparameter tuning, evaluating performance of AI models.
- Hands-on experience with Docker and Git.
- Experience with CI/CD pipeline development and maintenance.
- Follow software development best practices strictly.
- Excellent communication skills in English as well as an independent and team focused style of work.
- Excellent communication skills in English and proactive thinker.
Good to Have:
- Knowledge of Palantir.
- Familiarity with Data streaming services, Apache Kafka, RabbitMQ, etc.
- Experience with Azure DevOps pipelines.
- Experience with Apache AirFlow.
- Experience with AI/ML and MLOps.
YOUR QUALIFICATIONS
Qualification:
- Bachelor’s in computer science / information technology or related field from a reputed institute
- 3 to 5 years of industry experience in software development
- Professional experience in software development, specifically in the field of engineering large, data-driven applications.