Data Engineer - ETL/SQL/Python

Job Title : Data Engineer

Location : Bangalore

Experience : 6+ years

Key Responsibilities :

– Design, build, and optimize robust, scalable, and high-performance data pipelines and ETL processes using Snowflake and AWS tools.

– Collaborate with data scientists, analysts, and other engineers to design and implement data solutions that support analytical needs and business goals.

– Work with large datasets, ensuring data integrity, consistency, and quality.

– Develop and implement data ingestion, transformation, and storage strategies in Snowflake and AWS environments.

– Automate data workflows using Python and AWS services (e.g., Lambda, S3, EC2, Glue).

– Monitor and troubleshoot data pipelines and systems to ensure they run efficiently and effectively.

– Participate in code reviews, design sessions, and brainstorming to improve the overall architecture and data strategy.

– Stay up-to-date with industry best practices, emerging trends, and new technologies in data engineering and cloud computing.

– Maintain proper documentation for data models, pipeline architectures, and other engineering processes.

Required Skills & Qualifications :

– 6+ years of experience as a Data Engineer, working with cloud platforms, particularly AWS.

– Strong experience with Snowflake for data warehousing, data integration, and optimization.

– Proficiency in Python for data engineering tasks such as automation, data transformations, and scripting.

– Hands-on experience with AWS services such as S3, EC2, Lambda, Glue, Redshift, and others.

– Expertise in designing and implementing ETL processes and data pipelines.

– Strong knowledge of SQL and experience working with large datasets and complex queries.

– Familiarity with data modeling and database design best practices.

– Experience with version control systems like Git and collaborative development practices.

– Strong problem-solving skills and the ability to work independently and in a team-oriented environment.

– Excellent communication skills and the ability to collaborate with cross-functional teams.

Preferred Qualifications :

– Experience with containerization tools like Docker and Kubernetes.

– Familiarity with data orchestration tools like Apache Airflow or similar.

– Understanding of data privacy regulations and security best practices.

– Experience in Agile/Scrum development environments.