BI Engineer - MySQL/ETL

Skills Required : Hands-on experience in MySQL database Building reports Metric level changes Stakeholder management Data Extraction, Transformation, Loading (ETL) Detailed Job Description for Data Extraction, Transformation, Loading (ETL): Data Extraction : Identify and extract data from various sources such as databases, APIs, flat files, etc. Write SQL queries to extract relevant data from MySQL database efficiently. Utilize ETL tools if applicable for extracting data from multiple sources. Data Transformation : Cleanse, validate, and transform raw data to ensure accuracy and consistency. Perform data manipulation tasks such as filtering, sorting, aggregating, and joining datasets. Implement business logic and transformations as per the requirements. Data Loading : Design and implement data loading processes into the target system, such as a data warehouse or reporting database. Ensure data integrity and optimize loading processes for performance. Schedule and automate data loading tasks to ensure timely updates. ETL Pipeline Development : Develop ETL pipelines to automate the extraction, transformation, and loading of data. Monitor and troubleshoot ETL processes to identify and resolve issues promptly. Optimize ETL workflows for efficiency and scalability. Data Quality Assurance : Conduct data quality checks and validations to ensure accuracy and completeness of the data. Implement data quality rules and validation checks within the ETL process. Collaborate with data stakeholders to address data quality issues and improve processes. Documentation and Reporting : Document ETL processes, data mappings, and transformations for future reference. Generate reports and documentation to communicate ETL workflows, data lineage, and data quality metrics. Provide regular updates and reports to stakeholders on ETL process performance and data quality. Collaboration and Stakeholder Management : Collaborate with cross-functional teams including data analysts, business users, and IT teams. Understand business requirements and translate them into technical ETL solutions. Communicate effectively with stakeholders to gather requirements, provide updates, and address concerns. Continuous Improvement : Stay updated with emerging technologies and best practices in ETL processes and tools. Identify opportunities for process improvement and optimization. Proactively suggest and implement enhancements to ETL pipelines to improve efficiency and reliability. (ref:hirist.tech)

Location: Bangalore, IN

Posted Date: 4/24/2024