Mindcrew Technologies - Data Engineer - Synapse Analytics

Job Description : Location : Mumbai, Maharashtra, India Role Overview : We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data analytics team in Mumbai. You will be a key player in the design, development, and implementation of robust and scalable analytical solutions on the Azure Cloud platform, with a strong focus on Synapse Analytics. Your expertise in data warehousing concepts, ETL/ELT pipelines, and performance optimization will be crucial in delivering high-quality data solutions. Must Have : - More than 5 years of hands-on experience in the design and development of Analytical Solutions utilizing Synapse Analytics and other data services on the Azure Cloud. - Proven ability to implement Dimensional Modeling and Medallion Architecture within Synapse Analytics. - Expertise in defining the overall architecture of analytical solutions using various Synapse components (serverless SQL pool, dedicated SQL pool, Spark pools, etc.). - Extensive experience in the design and implementation of dedicated SQL pool (formerly SQL DW) schemas. - Proven ability to design the ETL pipeline and effectively collaborate with Pyspark developers during the development process. - Strong experience in creating and managing fact and dimension tables for data warehouse models. - Hands-on experience in creating Orchestration pipelines in Azure Data Factory to execute Pyspark notebooks. - Demonstrated ability to ingest data from various Source systems, including SAP ECC, SAP BW, IBM FileNet, SQL, and other diverse data sources. - Excellent skills in writing and optimizing T-SQL queries and stored procedures. - Proven ability to monitor query performance and resource usage within the Azure Synapse environment. Good to Have : - Knowledge of SAP systems (SAP ECC, SAP BW). - Relevant Azure certifications such as AZ-900 (Azure Fundamentals), DP-300 (Administering Microsoft Azure SQL Solutions), or equivalent. Responsibilities : - Design and develop scalable and efficient data warehouse solutions on Azure Synapse Analytics. - Implement Dimensional Modeling and Medallion Architecture principles to build robust data models. - Define the overall architecture of analytical solutions, selecting and configuring appropriate Synapse components. - Design and implement schemas for dedicated SQL pools (formerly SQL DW) to optimize data storage and retrieval. - Design and oversee the development of ETL/ELT pipelines, collaborating closely with Pyspark developers. - Create and manage fact and dimension tables to support business intelligence and reporting needs. - Develop and maintain orchestration pipelines in Azure Data Factory to automate data ingestion and transformation processes. - Ingest and transform data from various source systems, ensuring data quality and integrity. - Write and optimize complex T-SQL queries and stored procedures for data manipulation and analysis. - Monitor the performance of Synapse queries and optimize resource utilization for cost-efficiency. - Collaborate with data analysts, business intelligence developers, and other stakeholders to understand data requirements and deliver effective solutions. - Troubleshoot and resolve data-related issues within the Azure Synapse environment. - Stay up-to-date with the latest Azure data services and best practices. - Document data models, ETL processes, and system : - Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field. - More than 5 years of relevant experience as a Data Engineer, with a strong focus on Azure Synapse Analytics. - Deep understanding of data warehousing concepts, ETL/ELT processes, and database technologies. - Excellent analytical and problem-solving skills. - Strong communication and collaboration abilities. - Ability to work independently and as part of a team (ref:hirist.tech)

Location: mumbai, IN

Posted Date: 6/4/2025