Data Engineer

Come to one of the largest IT Services companies in the world! Here you can transform your career! Why join TCS? Here at TCS we believe that people make the difference, which is why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment. We are looking for Data Engineer focused on Databricks and Azure. Required skills are even more specific, combining in-depth knowledge of the Databricks platform, Azure services, modern data architecture, and data engineering best practices. Hard Skills (Technical Skills) – Programming Languages: Python (main language for data manipulation and creation of pipelines in Databricks), SQL (for modeling, queries, and data optimization), Scala (desirable for high performance in Spark), Bash (for automation and administration scripts in Azure). Data Processing and ETL/ELT: Apache Spark (PySpark, Spark SQL, Delta Engine). Distributed processing optimized for Databricks, Databricks Workflows and Jobs. Automation of ETL pipelines and scheduled tasks, Delta Lake (transactional data architecture for reliable pipelines - ACID, data versioning). Azure Services for Data Engineering: Azure Data Lake Storage (ADLS Gen2). Scalable storage for raw and transformed data, Azure Data Factory (ADF) for orchestration of integrated ETL pipelines with Databricks, Azure Synapse Analytics for integration between Databricks and enterprise data warehouses, Azure Event Hubs / Azure Kafka for real-time data ingestion for streaming, Azure Functions & Logic Apps for automation of data-related tasks. Data Modeling and Architecture: Data Lakehouse Architecture (hybrid between Data Lake and Data Warehouse), SQL query optimization (indexing, caching, partitioning, Ordering). DevOps & Automation: CI/CD for Databricks (GitHub Actions, Azure DevOps, Terraform), Monitoring and Logging (Azure Monitor, Databricks Logging, MLflow for pipeline tracking). Security, Governance and Compliance: Azure Purview (Data Catalog and Lineage), RBAC (Role-Based Access Control) in Azure, Encryption and Masking of Sensitive Data, Implementation of Compliance Rules (GDPR, LGPD, HIPAA). What do we offer? Health Insurance Dental Plan Life Insurance Gym Workout TCS Cares – a free 0800 number that provides psychological (24 hours/day), legal, social and financial assistance to members. Partnership with SESCC Certification Refund TCS Free Learning Portal – Online Courses and Live Training Opportunity for international experience Discount Partnership with Universities and Language Schools Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire TCS Gems – Performance Recognition Accelerate – Career platform with free mentoring At Tata Consultancy Services, we promote an inclusive culture and always work towards equity. This applies to gender, people with disabilities, LGBTQIA, religion, race, ethnicity, that is, all our opportunities are developed with these principles in mind. We think about various actions for inclusion and social responsibility, in order to build a TCS that respects individuality. Be a TCSer! Seniority level Mid-Senior level Employment type Full-time Job function Information Technology Industries IT Services and IT Consulting J-18808-Ljbffr

Location: Brasil, BR

Posted Date: 5/1/2025