Data Engineer - Talend/Matillion

Job Title : Data Engineer. Experience : 3 Years. Budget : Up to 14-15 LPA. Skills Required : - Expertise in at least one of the following: Snowflake, Talend, Databricks, Matillion, DBT. - Proficient in developing ETL processes including ETL control tables, error logging, and auditing. - Strong experience in writing ETL jobs using standard components. - Ability to develop new ETL jobs or modify existing ones based on requirements. - Capable of supporting and troubleshooting existing ETL jobs to prevent failures and suggest fixes. - Building and maintaining complex ETL and data pipelines for data loading and maintenance. Mandatory keywords : Python, PySpark, SQL, Azure, data pipeline, Data warehouse (e.g.Snowflake), ETL control. Responsibilities : - Design, develop, and maintain ETL processes and data pipelines to ensure smooth data flow and transformation. - Collaborate with stakeholders to understand data requirements and translate them into ETL workflows. - Implement best practices for ETL development, including error handling, logging, and performance optimization. - Monitor and troubleshoot ETL jobs for failures, performance issues, and data inconsistencies. - Work closely with the data engineering team to enhance existing ETL processes and implement new features. - Document ETL workflows, processes, and job dependencies for reference and future maintenance. Qualifications : - Bachelor's or Master's degree in Computer Science, Engineering, or related field. - 3 years of experience in data engineering with a focus on ETL development. - Strong proficiency in Python, PySpark, and SQL. - Experience with cloud platforms, especially Azure, and building data pipelines. - Knowledge of data warehouse concepts, preferably Snowflake. - Excellent problem-solving and analytical skills. - Ability to work independently and in a team environment. (ref:hirist.tech)

Location: Chennai, IN

Posted Date: 4/24/2024