Backend Engineer (Data Platform)
Headquarters: London
URL: https://www.desia.ai/
We are seeking a skilled and motivated Backend Engineer (Data Platform) to join our team and help build a robust data platform. Your responsibilities will include:
Developing and enhancing data pipelines: Create and expand existing data processing pipelines for both structured and unstructured datasets (mainly Python and SQL)
Integrating with third-party systems: Work with external tools and APIs (e.g., Microsoft GraphAPI, financial data providers) to enable seamless data flow between third-party systems and Desia.
Monitoring and optimizing performance: Track the performance of the data platform, analyze logs, and recommend infrastructure improvements using tools like GCP, Sentry, and CloudSQL.
Collaborating on data modeling: Design and implement efficient data structures for relational and non-relational systems to support scalable and reliable data processing.
Ensuring system reliability: Contribute to the stability and scalability of the platform by addressing bottlenecks, optimizing queries, and ensuring smooth operation of containerized environments (e.g., Docker, Kubernetes).
Must-Have Skills:
Strong Python expertise: proven working experience in both scripting and object-oriented programming (OOP).
Solid SQL skills: Experience with writing efficient queries and optimizing database performance.
Data modeling: Hands-on experience designing and organizing data in both relational and non-relational formats.
Communication skills: Excellent verbal and written communication in English.
Adaptability: A quick learner who can bridge knowledge gaps to tackle new challenges effectively.
Collaborative mindset: Open to sharing ideas, providing feedback, and contributing to discussions constructively.
Nice-to-Have Skills:
Cloud experience: Familiarity with Google Cloud Platform (GCP).
Containerization knowledge: Working familiarity with tools like Docker and Kubernetes.
Database expertise: Experience with PostgreSQL.
Scheduling: Working experience with task scheduling (ex. cron, dag’s like Airflow)
Python libraries: Knowledge of libraries such as asyncio, pydantic, fastapi, and psycopg
Search technologies: Familiarity with ElasticSearch or OpenSearch.
System design: Experience with RESTful APIs and queue-based systems.
Qualifications
Holding a Master’s degree in Computer Science or a related field or possessing similar practical experience.
A minimum of 3 years professional experience in Data Platform Engineering or Backend roles
Compensation and benefits
Salary depending on experience and skills (£40000 – £65000)
Performance bonuses
Stock options and retirement plan
To apply: https://weworkremotely.com/remote-jobs/desia-limited-backend-engineer-data-platform
