Azure Synapse Architect - Scala/Python

Job Description : We are seeking a highly skilled and experienced Azure Synapse Architect to join our team. The ideal candidate will have 12 to 15 years of experience in data engineering, data architecture, and cloud technologies, with a strong focus on designing and implementing solutions using Azure Synapse Analytics. As an Azure Synapse Architect, you will be responsible for leading the design, architecture, and implementation of scalable, reliable, and high-performance data analytics solutions on the Microsoft Azure platform. Responsibilities : Solution Design and Architecture : - Lead the design and architecture of data analytics solutions using Azure Synapse Analytics. - Define the overall solution architecture, including data ingestion, data storage, data processing, and data visualization components. Data Modeling and Integration : - Design data models, schemas, and data integration pipelines to support analytical workloads. - Implement data ingestion pipelines to extract, transform, and load (ETL) data from various source systems into Azure Synapse. Data Lake and Data Warehouse Management : - Architect and manage data lakes and data warehouses using Azure Synapse Analytics. - Define data storage structures, partitioning strategies, and indexing techniques to optimize query performance and data retrieval. Big Data Processing : - Implement big data processing workflows using Azure Synapse Analytics. - Utilize Apache Spark for distributed data processing and Apache Hadoop for batch processing of large datasets. - Advanced Analytics and Machine Learning : - Integrate advanced analytics and machine learning capabilities into Azure Synapse Analytics solutions. - Design and implement predictive analytics models, recommendation engines, and anomaly detection algorithms. Data Visualization and Reporting : - Develop data visualization dashboards and reports using tools such as Power BI and Azure Synapse Studio. - Create interactive dashboards to enable business users to explore and analyze data insights. Security and Compliance : - Ensure data security and compliance requirements are met within Azure Synapse Analytics solutions. Implement security controls, data encryption, and access policies to protect sensitive data assets. Performance Optimization : - Optimize query performance and resource utilization within Azure Synapse Analytics environments. - Tune SQL queries, optimize data partitioning, and leverage caching mechanisms to improve overall system performance. Automation and Orchestration : - Implement automation and orchestration workflows using Azure Data Factory, Azure DevOps, and other cloud-native tools. - Streamline deployment processes, manage infrastructure as code, and automate routine tasks. Capacity Planning and Scalability : - Perform capacity planning and scalability assessments for Azure Synapse Analytics solutions. - Monitor resource utilization, identify bottlenecks, and scale resources as needed to accommodate growing data volumes and user demands. Documentation and Best Practices : - Create technical documentation, architecture diagrams, and best practice guidelines for Azure Synapse Analytics solutions. - Establish coding standards, design patterns, and development methodologies for data engineering teams. Collaboration and Knowledge Sharing : - Collaborate with cross-functional teams, including data engineers, data scientists, and business analysts, to align on solution requirements and priorities. - Share expertise and best practices through knowledge sharing sessions and mentorship programs. Requirements : - Bachelor's degree in Computer Science or a related field. - Master's degree or equivalent experience is preferred. - 12 to 15 years of experience in data engineering, data architecture, and cloud technologies, with a focus on Microsoft Azure. - Proven experience designing and implementing data analytics solutions using Azure Synapse Analytics. - Strong understanding of data modeling concepts, ETL processes, and data integration techniques. - Expertise in SQL, T-SQL, and programming languages such as Python or Scala for data manipulation and analysis. - Hands-on experience with big data technologies such as Apache Spark, Apache Hadoop, and Apache Kafka. - Proficiency in data visualization tools such as Power BI, Tableau, or Azure Synapse Studio. - Familiarity with cloud-native services and platforms, including Azure Data Lake Storage, Azure SQL Database, and Azure Machine Learning. - Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders. - Strong problem-solving skills and the ability to troubleshoot complex technical issues in distributed data environments. - Certifications in Microsoft Azure, Azure Synapse Analytics, or related technologies are a plus. Educational Qualifications : Bachelor's/Master's (ref:hirist.tech)

Location: Bangalore, IN

Posted Date: 4/24/2024