Data Engineer
Noida/ Gurgaon – We are on the lookout for a talented Data Engineer to join our team. The perfect candidate will have substantial experience in designing, implementing, and managing large-scale data infrastructure, focusing on data pipelines, ETL processes, and optimizing workflows across cloud platforms.
Proficiency in Python development and experience with SQL queries are essential.
Responsibilities:
• Minimum of 5 years of relevant experience
• Build, monitor, and optimize data pipelines utilizing Redshift, Kinesis Data Streams, Kinesis Firehose, AWS S3, AWS Glue, and Apache Airflow
• Write and enhance complex SQL queries for efficient data extraction and transformation
• Develop Python solutions to support ETL processes and data analysis
• Collaborate with cross-functional teams to maintain data accuracy and integrity
• Demonstrated experience with AWS cloud services, data pipelines, and managing large datasets
• Strong understanding of SQL and data management tools
Preferred:
• Experience with message broker platforms such as Pulsar and Kafka.
• Familiarity with MongoDB for managing NoSQL databases.