Lead Data Engineer - Scala/Python

Description : We are seeking a Data Engineer with 8 years of experience to join our Data Platform team. This role will report to the Manager of data engineering and be involved in the planning, design, and implementation of our centralized data warehouse solution for ETL, reporting and analytics across all applications within the company. Qualifications : Deep knowledge and experience working with Python/Scala and Spark Experienced in Azure data factory, Azure Data bricks, Azure Data Lake, Blob Storage, Delta Lake, Airflow. Experience working with SQL and NoSQL database systems such as MongoDB, Apache Parquet Experience in distributed system architecture design Experience with AZURE cloud environments Experience with acquiring and preparing data from primary and secondary disparate data sources. Experience working on large scale data product implementation, responsible for technical delivery and mentoring peer engineers. Knowledge of Azure DevOps and version control systems, ideally Git Experience working with agile methodology preferred Excellent understanding of OOPs and design patterns Healthcare industry experience preferred Excellent communication and presentation skills. Responsibilities : Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions Work with other team with deep experience in ETL process, distributed microservices, and data science domains to understand how to centralize their data Share your passion for staying experimenting with and learning new technologies. Perform thorough data analysis, uncover opportunities, and address business problems. (ref:hirist.tech)

Location: Noida, IN

Posted Date: 4/24/2024