Quick Overview
Job Description
Data Engineer Python, SQL & Data Pipelines
Role: Senior Data Engineer
Company: Computer Vision Startup
Location: London, Hybrid
Salary: up to 95,000 + Benefits
We're looking for a talented Data Engineer to join a fast-growing, award-winning technology company transforming the an industry through advanced data platforms and digital innovation.
This is an exciting opportunity to work within a multidisciplinary engineering environment spanning cloud platforms, AI & computer vision, embedded systems, data science, and large-scale data processing. You'll play a key role in building scalable data infrastructure and developing robust pipelines that power next-generation products.
What You'll Be Doing
- Design, develop, and maintain scalable data pipelines using Python and orchestration tools such as Dagster.
- Create and optimise efficient data models to support both transactional and analytical workloads.
- Develop high-performance SQL queries, procedures, and integrations for APIs and data services.
- Debug, enhance, and maintain existing systems and codebases.
- Build and execute unit and integration tests to ensure reliability and maintainability.
- Conduct profiling and performance optimisation to improve scalability and responsiveness.
- Produce clear technical documentation for pipelines, databases, and architecture.
- Collaborate with cross-functional engineering teams across backend, cloud, and product development.
- Contribute to architectural decisions and continuously evaluate new technologies and best practices.
Required Skills & Experience
- Degree in Computer Science, Engineering, or equivalent practical experience.
- Strong experience with relational databases and SQL (PostgreSQL preferred).
- Excellent Python programming and object-oriented development skills.
- Experience designing data models for both operational and analytical systems.
- Strong debugging, troubleshooting, and performance tuning capabilities.
- Experience using Git and participating in collaborative code reviews.
- Strong communication and teamwork skills.
- Passion for building scalable in-house technology solutions using both custom and off-the-shelf tools.
Nice to Have
- Experience with Dagster or similar orchestration platforms.
- Familiarity with CI/CD pipelines and tools such as GitHub Actions.
- Knowledge of REST and/or GraphQL APIs.
- Experience working in Linux environments.
- Familiarity with Docker and Kubernetes.
- Understanding of Test-Driven Development (TDD), PyTest, and software design patterns.
Similar jobs
- OC
Talend/Oracle RDS Data Engineer - Telford and remote - 6 months+
NewOctopus Computer Associates
Telford, Shropshire🇬🇧Remote31 minutes agoOracleSQLETL+1Technology - HS
Junior Data Engineer
NewHenderson Scott
Coventry, Warwickshire🇬🇧Hybrid3 hours agoAzureTechnology - HA
Data Engineer (Contract)
NewHackajob Ltd
Leeds, Yorkshire🇬🇧Hybrid3 hours agoTechnology - IN
Senior Data Engineer (Metadata & Lineage Integration)
NewIntellias
london🇬🇧Hybrid4 hours agoMongoDBSQLSQL Server+6Technology - SN
Palantir Data Engineer
NewSearchability NS&D
london🇬🇧On-site4 hours agoExpressETLAgile+3Technology - DA
Lead Data Engineer – London
NewDatatech Analytics
london🇬🇧£85k - £95k/yrOn-site4 hours agoSQLAgilePythonTechnology