Senior Data Engineer

Proven Skills with:

• •Writing Complex SQL Queries
• •Unix Shell Scripting
• •Data Warehousing Fundamentals
• •Experience with ETL/ELT pipelines
• •Relational Database
• •SQL, NoSQL
• •Data Mapping, Data Modeling, Data Mining, and Data Warehousing/Mart Relational databases and SQL Query performance tuning
• •Hands-on experience with at least one programming language Python / Java
• •Good understanding of Big Data Fundamentals (Hadoop/Spark) and Data Processing Pipelines
• •Hands-on experience with at least one cloud platform (GCP, AWS, Azure)

Responsibilities

• •Design, Develop and Deploy scalable data pipelines and data services,
• •Design, develop, and test data processes per business requirements, following the development standards and best practices as well as participating in code peer reviews to ensure our applications comply with best practices.
• •Work with business analysts to gather business requirements from end users and translate them into technical specifications.
• •Gather requirements to define data definitions, transformation logic, and data model logical and physical designs, data flow, and process.
• •Provide estimates for development.
• •Perform data analysis and data profiling against source systems and data warehouse.
• •Test solutions to validate whether requirements have been met; develop test plans, test scripts, and test conditions based on the business and system requirements.
• •Provide end-user support in post-deployment phases; assess and evaluate all feedback to ensure that the requirements necessary to correct issues are addressed.
• •Integrate new data management technologies and software engineering tools into existing infrastructure,
• •Research opportunities for data acquisition and new uses for existing data
• •Collaborate with data scientists and researchers to develop algorithms including prototypes, predictive models, and proof of concepts,
• •Work with clients across geographies in an agile team environment,
• •Constantly learn new technologies, frameworks, and tools.
• •Exp. with Agile development.
• •Excellent verbal and written communication skills are a must.