Senior Data Engineer

Job Title: Senior Data Engineer

Key Skills: DBT, Python, SQL, Snowflake, Databricks

Location: Brazil

Mode: Remote

We at Coforge are hiring Senior Data Engineer with the following skill set.

Key Responsibilities

Delivery & Ownership

Own the end-to-end delivery of data pipelines and data products, from design through deployment and production support

Develop, maintain, and optimise scalable data pipelines using Azure Databricks, DBT, and Python

Ensure solutions are production-ready, reliable, and meet defined SLAs

Migration & Platform Engineering

Execute and support migration of data from Snowflake (AWS) to Azure using Databricks, DBT, and Lakebridge

Build and manage infrastructure-as-code using Terraform to enable scalable and repeatable deployments

Ensure seamless integration between legacy systems and the Azure data platform

Data Quality, Observability & Governance

Implement data quality frameworks (e.g., DBT testing, validation rules) to ensure trusted data pipelines

Enable observability through logging, monitoring, and alerting of pipelines and data workflows

Support data governance standards including data lineage, consistency, and compliance requirements

Architecture & Engineering Excellence

Contribute to the design and architecture of scalable data solutions, aligned with lakehouse principles

Apply best practices in data modelling, performance optimisation, and cost efficiency

Follow and promote engineering standards, including modular design and reusable components

Production Support & Reliability

Monitor and maintain data pipelines in production, ensuring high availability and performance

Troubleshoot issues and perform root cause analysis (RCA) for incidents

Continuously improve system stability, resilience, and operational processes

Collaboration & Technical Leadership

Work closely with cross-functional teams (data, product, architecture, business) to translate requirements into scalable technical solutions

Provide guidance and mentorship to junior engineers through code reviews and best practices

Contribute to documentation of architecture, pipelines, and operational processes

Required Skills & Qualifications

Strong hands-on expertise with: Azure Databricks, DBT, Snowflake, Python and SQL

Proven experience building and managing large-scale data pipelines and transformations

Experience working with high-volume datasets (e.g., terabytes, complex data models, multiple pipelines)

Solid understanding of: Data modelling and ETL/ELT frameworks, Distributed data systems and lakehouse architectures, Experience with Terraform and infrastructure-as-code principles

Strong experience with CI/CD pipelines and Git-based version control

Experience supporting production systems, including monitoring, alerting, and incident resolution

Knowledge of data quality, testing, and observability frameworks

Strong problem-solving and analytical skills

Excellent communication skills with the ability to work across technical and non-technical stakeholders

Experience in insurance or financial services domains is highly desirable

Preferred Skills:

Experience with real-time/streaming technologies (Kafka, Event Hubs, Delta Live Tables)

Knowledge of security, compliance, and data protection standards in regulated industries

Experience with cost optimisation and performance tuning in cloud environments

Exposure to multi-cloud or hybrid architectures

Posted On: 14-07-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.