Data Engineer - Azure

About Dot Collective

We are a new generation consultancy based across UK and EU and founded on the premises of the engineering excellence and empowering people to make an impact.

We work with all modern tech stacks and typically run agile scrum on all our projects.

About you

Are you passionate about data and its transformational powers? Do you like being able to make a huge difference in a limited period of time? We might be just the right place for you.

Your key skills and capabilities:

Strong SQL and Python skills

Data modelling experience (dimensional, relational, or similar)

Experience building and maintaining backend systems

Familiarity with Microsoft Azure

Understanding of APIs, containers, and backend development best practices

Implementing cloud-native data platforms

Engineering scalable and reliable pipelines

Good knowledge of distributed computing with Spark

Understanding of cloud architecture principles and best practices

Hands-on experience in designing, deploying, and managing cloud resources

Agile ways of working

Experience in cloud automation and orchestration using tools such as CloudFormation or Terraform

Monitoring and performance tuning of cloud-based applications and services

Nice to haves:

Experience with Snowflake, dbt, CubeJS

Experience with Databricks, PySpark, ML workflows

Experience with containerized deployments (Docker, Kubernetes, Azure Container Apps).

Frontend development experience (React, Next.js, TypeScript)

Infrastructure-as-code (Terraform, CloudFormation)

Model Deployment & Serving – Deploy and manage ML models using MLflow, Azure ML, SageMaker, or similar, ensuring scalability and performance

Monitoring & Retraining – Set up model drift detection, performance monitoring, and automated retraining

ML Pipelines & CI/CD – Automate end-to-end ML workflows

Key tasks:

Develop, maintain, and optimise backend services for our SaaS platform

Work with SQL and Python daily to build robust data pipelines and transformations

Model, structure, and query data to support product features and reporting

Integrate and maintain data ingestion flows (e.g., Fivetran, custom connectors)

Implement backend APIs (FastAPI) to power our web application

Work with our cloud environment (Azure - experience with AWS or GCP also valuable)

Collaborate with teammates to plan, build, and deploy features in an Agile way

Contribute to CI/CD workflows, monitoring, and infrastructure-as-code

We expect you to have some knowledge about how to architect, design, develop, deploy, and operate a data platform.

Our promise to you

We will always see you as a human being and will do our very best to support your needs and wellbeing – well-designed co-working and collaboration spaces, remote working patterns that work for you, parenting leave, sabbaticals and ability to work on personal projects.

We believe that a geled team is worth its weight in gold – we will do everything we can to avoid breaking well-performing teams. Whilst continuity across every project is not always possible, we thoughtfully assemble high-performing, blended teams with the appropriate levels of experience and expertise to deliver the best outcomes for our clients — and teams you’ll enjoy working with.

We are committed to prioritising the wellbeing of our employees. To fulfill this promise, we provide a comprehensive employee wellbeing program that includes mental health support, flexible working arrangements, wellness activities, and a positive work culture.

We recognise that the world of tech delivery has moved on significantly in the last 15 years and know a thing or two about how to bring projects over the line without experiencing lots of despair and burn-out. In fact, we like to believe that our projects are the opposite of that – they are run smoothly and most of the time are fun to work on.