Data Engineer

About the Role

At Megapixel, data plays a key role in how we understand our customers, measure performance and make business decisions.

We are looking for a Data Engineer to join our growing Business Intelligence team and help develop, maintain and improve our data platform.

You will work with both batch and real-time data, building reliable pipelines and making sure data is available, accurate and ready for analysis. You will also help improve the performance, reliability and scalability of our existing infrastructure.

This is a hands-on role where you will work with a modern cloud-based data stack and have the opportunity to shape how our data platform evolves.

Our Technology Stack

Data streaming: Apache Kafka

Data processing: Apache Spark on AWS EMR

Cloud storage: Amazon S3

Data warehouse: Snowflake

Data transformation: dbt

Workflow orchestration: Apache Airflow

Key Responsibilities

Design, develop and maintain reliable batch and streaming data pipelines.

Maintain and improve our Spark-based data processing infrastructure.

Build and optimise data transformations and models in Snowflake using dbt.

Manage and improve data pipeline orchestration using Airflow.

Monitor data quality, pipeline reliability and system performance.

Develop and maintain integrations with internal and third-party data sources.

Investigate and resolve data pipeline and infrastructure issues.

Apply good engineering practices, including testing, version control and CI/CD.

Maintain clear technical documentation for data pipelines, systems and operational procedures.

Collaborate with BI, product and engineering teams to understand data needs and deliver scalable solutions.

Identify opportunities to simplify, automate and improve our data platform.

Requirements

At least 3 years of professional experience in data engineering or a similar technical role.

Strong SQL skills and experience working with analytical databases or data warehouses.

Good programming skills in Python , Java or Scala.

Hands-on experience with Apache Spark .

Experience with Apache Airflow or a similar workflow orchestration tool.

Experience developing and maintaining data pipelines in a cloud environment, preferably AWS.

Good understanding of data modelling and data warehouse concepts.

Familiarity with software engineering practices such as Git, testing and CI/CD.

Strong problem-solving skills and the ability to troubleshoot technical issues.

Ability to work independently and collaborate effectively with other teams.

Good written and spoken English.

Nice to Have

Experience with dbt and Snowflake .

Experience with Kafka or other streaming technologies.

Previous experience in the iGaming industry .

What the Company Offers

Competitive salary and benefits package.

Private health insurance.

Fitness and wellness benefits.

Regular wellness initiatives.

Fresh fruit and snacks in the office.

Weekly team lunches and breakfasts.

Company and team events.

Opportunities for continuous learning and professional development.

Hybrid working arrangements: 4 days in the office and 1 day working remotely each week.

This role will be based on-site in our Gzira, Malta offices.