Data Engineer - Contract Position

Description

Job Role

We are seeking a skilled and experienced Database Engineer to join our team for a contract opportunity. The ideal candidate will play a critical role in designing, developing, and maintaining our Enterprise Data Warehouse (EDW). The role requires a deep understanding of Azure, SQL, data modeling, and optimization to ensure the efficiency, scalability, and reliability of our data infrastructure.

Responsibilities Include:

• •Build, schedule, and monitor ETL/ELT pipelines using Azure Data Factory (ADF) and SQL Server Integration Services (SSIS).
• •Implement change data capture (CDC), schema drift handling, and error-recovery patterns to keep pipelines reliable.
• •Ingest, model, and process healthcare claims and cases data to support reporting and analytics.
• •Use AI tools such as GitHub Copilot, Microsoft Copilot in Fabric, Snowflake Cortex, and LLM-based assistants to speed up pipeline development, code generation, documentation, testing, and troubleshooting.
• •Develop and optimize data structures, warehouses, and workloads in Snowflake, including loading, transforming, and sharing data.
• •Write efficient SQL queries and scripts to support data extraction, transformation, and loading (ETL) processes.
• •Optimize database performance by analyzing, monitoring, and fine-tuning SQL queries and database structures.
• •Contribute to CI/CD, version control (Git, Azure DevOps), and infrastructure-as-code practices.
• •Manage database security, backup, and recovery strategies to ensure data integrity and availability.
• •Develop and maintain data pipelines to ensure seamless data flow between various source systems and EDW.
• •Perform regular data quality checks and troubleshooting to ensure the accuracy and consistency of data in the EDW.
• •Monitor and maintain the performance of databases, addressing any issues related to performance, latency, and storage.
• •Work with development teams to integrate databases with applications and ensure seamless interaction between data services and business systems.
• •Keep up to date with emerging trends and best practices in database engineering, data warehousing, and SQL optimization.

Requirements

• •Experience implementing medallion architecture (Bronze, Silver, and Gold layers) in a lakehouse or cloud data warehouse environment.
• •Bachelor’s degree in computer science, Information Technology, or a related field.
• •Proven experience as a Database Engineer with 10 or more years of experience in a healthcare environment, with a focus on SQL and Enterprise Data Warehousing.
• •Hands-on experience working with healthcare claims data.
• •Hands-on experience with Azure Data Factory (ADF).
• •Hands-on experience with Azure DevOps (ADO).
• •Hands-on experience with SQL Server Integration Services (SSIS).
• •Hands-on experience with Snowflake (Preferred).
• •Strong knowledge of data modeling and database design principles.
• •Understanding data security, backup, and recovery procedures (i.e. BCDR).
• •Strong problem-solving skills and attention to detail.
• •Knowledge of Agile methodologies and experience working in Agile environments.
• •Strong communication skills working across business functions
• •Manage multiple projects, issues, and deliverables in a fast-paced environment.
• •Able to multi-task and prioritize work to meet deadlines.
• •Excellent listening, critical thinking, written and verbal skills.
• •Works well within a team environment.
• •Experience working in a professional environment with clinical managed care concepts, practices and procedures preferred.

• ProgenyHealth positively recruits people from diverse backgrounds, including individuals with disabilities - if you need an accommodation to interview, please contact us by email: [email protected]
• Equal Opportunity Employer, including individuals with disabilities and veterans.