Cloud Data Engineer

Work setup: Hybrid | Nigh shift

Core Expertise:

●       Experience: At least 3 years in a data engineering role working on data integration, processing and transformation use cases with open-source languages (i.e. Python) and cloud technologies.

●       Strong programming skills in Python specifically for API integration and data libraries, with emphasis on quality and test-driven development

●       Demonstrated proficiency with big data storage formats (Apache Parquet, ORC) and practical knowledge of pitfalls and optimization strategies

●       Demonstrated proficiency with SQL

●       Experience with data modeling:

o   Relational modeling

o   Dimensional modeling

o   NoSQL modeling

●       Working knowledge of IaC on AWS (CloudFormation or CDK)

●       Working knowledge of AWS Services:

o   Required: Glue, IAM, Lambda, DynamoDb, Step Functions, S3, CloudFormation or CDK

o   Nice-to-have: Athena, Kinesis, MSK, MWAA, SQS

●       Experience with orchestration of data flows / pipelines: Apache Airflow or Dagster

●       Nice-to-have: Experience with data streaming (Kinesis, Kafka)

●       Nice-to-have: Experience with Apache Spark

●       Nice-to-have: Client-facing experience, multi-cultural team experience, technical leadership, team leadership

Abilities

●       Ability to work both autonomously and as part of a team

●       Attention to quality and details

●       Good critical and analytical thinking

●       Good time management and organizational skills

●       Customer / end-client orientation

●       Excellent written and spoken communication skills