Senior Data Engineer

Job Description

WHAT YOU’LL CHAMPION:

As a Senior Data Engineer, your day-to-day duties will encompass the following areas:

Operational Excellence: Provide essential operational support, including system troubleshooting and implementing technical fixes.

Data Quality Assurance: Ensure absolute data integrity and data quality across environments.

Process Optimization: Continuously improve internal processes through automation, pipeline optimization, and infrastructure re-design.

Cross-Functional Collaboration: Support and collaborate closely with cross-functional and multidisciplinary teams in a fast-paced environment.

Data Impact: Leverage data visualization tools and techniques to maximize the business impact and intrinsic value of data.

Internal Stakeholder Management: Manage technical communication, alignment, and relationships with internal business units, product managers, and engineering teams to ensure data deliverables align with organizational goals.

Governance & Compliance: Contribute to improving data governance policies and maintaining data compliance standards.

Continuous Learning: Keep continuously current with the latest technical and industry developments.

WHO YOU ARE:

• •BS/MS/PhD in IT, Mathematics, Science or Engineering discipline Up to 4+ yrs relevant experience beyond first degree
• •Experience with one of the following languages: Python, Spark
• •Experience with DAG, airflow, terraform
• •Familiar with data ETL from a wide variety of data sources.
• •Experience with SQL and NoSQL databases.
• •Experience with pipeline and workflow management tools.
• •Experience with various messaging and stream processing.
• •Experience with object-oriented/object function scripting languages.
• •Familiar with containerisation and orchestration tools.
• •Familiar with one of the following cloud-based services: GCP and its tools and services.
• •Ability to work under pressure and change, and balance among speed, reliability, and interpretability.
• •Good working knowledge of productivity tools such as G Suite, Git, Jira, Confluence.
• •Experience with code versioning, code review and documentation.
• •Proficient understanding of distributed computing principles.
• •Able to select and integrate big data tools and frameworks.
• •Familiar or prone to adopt design thinking methods.
• •Openness to experimenting with new techniques and new ways of working.
• ​

WHAT YOU’LL ENJOY:

• •Physical Wellbeing: Key medical and insurance benefits, maternity expenses, flexible work arrangement, and health and fitness amenities.
• •Emotional Wellbeing: Paid time off, wellness programmes, and childcare amenities.
• •Financial Wellbeing: Resources relating to financial, personal skills and career growth programmes.
• •Allstars Specials: Free flights, unlimited discounted flights, and exclusive discounts with partners.
• •A unique Allstar culture like no other

OUR HIRING PROCESS:

• •Application received
• •Candidate screening
• •Interview(s) and assessment(s)
• •Background check and/or other assessments
• •Offer and negotiation