Python Data Engineer
Project description
In this role, you will be responsible for maintaining, improving and documenting the SLIPDB (SLIP database), an automated data pipeline to report SLIP. You will use Python and Databricks to process a wide range of data, from multiple sources. You will work in a multidisciplinary environment, involving physics, data processing and analysis, and interacting with multiple departments.
Responsibilities
Maintain, improve, test, and deploy the ETL processes for the SLIP database
Perform data analysis to ensure data accuracy, efficiency, and to provide insights
Collaborate with multiple teams to understand data requirements and deliver solutions
Utilize Python and SQL on Databricks for data processing and analysis
Manage version control using git
Troubleshoot and resolve any issues related to data processing
Skills
Must have
Minimum 2-3 years of experience with ETL processes
Proficiency in Python, SQL, Databricks, and git
Experience with the pandas library and the pyspark API
Strong understanding of data processing and analytics
Problem-solving skills and attention to details
Ability to work in a collaborative team environment
University degree on engineering, physics or other related fields
Nice to have
Experience with Agile methodologies
Knowledge of report tools and visualization libraries such as Power BI and matplotlib
Familiarity with cloud platforms such as Azure
Other
Languages
English: C1 Advanced
Seniority
Senior
Eindhoven, Netherlands
Req. VR-113437
Python
Cross Industry Solutions
14/04/2025
Req. VR-113437
