IWS - Data Integration Engineer

Job Description : Key Technical Responsibilities : - Design, develop, test, deploy, and maintain ETL/ELT processes using data integration tools and programming languages. - Connect to and extract data from various sources, including relational databases, NoSQL databases, APIs, cloud storage, flat files, and streaming platforms. - Transform data to meet target schema requirements, applying data cleansing, aggregation, normalization, and de-normalization techniques. - Load processed data into target systems such as data warehouses, data lakes, operational databases, or other applications. - Design and implement data models for data warehousing and analytics solutions (e.g., dimensional modeling, 3NF). - Develop and maintain API integrations (REST, SOAP) to facilitate data exchange between systems. - Write and optimize complex SQL queries and stored procedures for data extraction and transformation. - Implement data quality checks and validation rules within integration processes to ensure data accuracy and reliability. - Troubleshoot and resolve technical issues related to data extraction, transformation, loading, and data pipeline performance. - Monitor data integration jobs and pipelines, ensuring timely execution and addressing failures proactively. - Tune and optimize data integration processes for performance, scalability, and cost-efficiency. - Develop and maintain technical documentation for data pipelines, including data mappings, transformation logic, and job schedules. - Collaborate with Data Architects, Data Analysts, Software Engineers, and business stakeholders to understand data requirements and deliver appropriate solutions. - Implement and manage data integration jobs using scheduling tools. - Utilize scripting languages (e.g., Python, Bash) for automation and custom data processing tasks. - Adhere to best practices for data integration development, version control, testing, and deployment. Required Technical Skills : - Proficiency with one or more industry-leading ETL/Data Integration tools (e.g., Informatica PowerCenter/IICS, Talend, DataStage, SSIS, Fivetran, Azure Data Factory, AWS Glue, GCP Dataflow/Dataproc). - Strong expertise in SQL programming and database concepts, including experience with relational databases (e.g., SQL Server, Oracle, PostgreSQL, MySQL). - Experience designing and implementing ETL/ELT processes. - Understanding of data warehousing and data lake concepts and best practices. - Experience with data modelling techniques (e.g., dimensional modeling, 3NF). - Experience integrating data from various sources, including APIs (REST, SOAP). - Proficiency in at least one scripting language (e.g., Python, Bash) for data manipulation and automation. - Familiarity with cloud platforms (Azure, AWS, or GCP) and their relevant data services. - Experience with data quality and data validation techniques. - Experience with performance tuning of data integration jobs and SQL queries. - Knowledge of job scheduling tools. - Experience with version control systems, such as Git. - Ability to troubleshoot complex data issues and integration failures. Required Qualifications : Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical field. (ref:hirist.tech)

Location: in, IN

Posted Date: 6/4/2025