Azure Data Engineer

About Avensys : Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success we have evolved to become one of the top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail and supply chain. We are currently looking to hire a Azure Data Engineer. Location : INDIA (Remote). Experience : 8 years. Type : Contract (12 months, extendable). Shift : India ( 9 am to 6 pm : - 8 years of experience in data engineering or a related role. - Experience in cloud data engineering, preferably in Microsoft Azure environments. - Strong experience with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks, and Azure Functions. - Proficient in SQL, Python, or Scala for data processing and transformation. - Experience with ETL/ELT design and development, including real-time data streaming (e.g., using Azure Stream Analytics). - Good understanding of data warehousing and data lake architectures. - Familiarity with DevOps practices, including CI/CD pipelines and Infrastructure-as-Code (IaC) using ARM templates, Terraform, or Bicep. - Knowledge of Power BI or other visualization tools is a plus. Key Responsibilities : - Design, develop, and maintain end-to-end data pipelines using Azure Databricks, Azure Data Factory, and Azure Synapse. - Implement big data processing frameworks using PySpark for scalable data transformation. - Manage and optimize Azure Data Lake storage, ensuring efficient data ingestion, retrieval, and governance. - Develop ETL/ELT solutions to process structured and unstructured data from multiple sources. - Work with Delta Tables & Unity Catalog to ensure data integrity, consistency, and security. - Automate data workflows, API integrations, and analytics services for real-time insights. - Collaborate with data architects, data scientists, and business stakeholders to deliver scalable data solutions. - Ensure data quality, governance, and compliance with enterprise standards and best practices. - Optimize data performance, including partitioning, indexing, caching, and cost-effective data storage strategies. - Stay up to date with Azure and big data technologies to drive innovation and efficiency in data engineering On Offer : You will be remunerated with an excellent base salary and entitled to attractive company benefits. Additionally, you will get the opportunity to enjoy a fun and collaborative work environment, alongside a strong career progression. (ref:hirist.tech)

Location: in, IN

Posted Date: 5/1/2025