Data Engineer Cloud Datastack

About the job HCLTech is a global technology company, home to more than 218,000 people across 59 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending September 2024 totaled $13.7 billion. AWS Senior Data Lead with Glue, SQL, Python Role and Responsibilities: An AWS-Data Engineer with strong experience across the entire Cloud Datastack. The ideal candidate should have extensive experience in data pipelines (ELT/ETL), data warehousing and dimensional modeling, and curation of data sets for Data Scientists and Business Intelligence users. Experience in building Data Lake. This candidate should also have excellent problem-solving ability dealing with large volumes of data and various data sources. It will report to the Sr Manager of Application Development. Key Responsibilities: • Design, Build and Operate the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, cloud migration tools, and ‘big data’ technologies. • Optimize various RDBMS engines in the cloud and solve customers' security, performance, and operation problems. • Design, Build, and Operate large, complex data lakes that meet functional / non-functional business requirements. • Optimize various data types of ingestion, storage, processing, and retrieval from near real-time events, and IoT, to unstructured data as images, audio, video, and documents, and in between. • Work with customers' and internal stakeholders including the Executive, Product, Data, Software Development, and Design teams to assist with data-related technical issues and support their data infrastructure and business needs. • Understand and Develop AI/ML models using AWS AI/ML services (e.g., Sage Maker, Rekognition, Comprehend) and collaborate with data scientists and engineers to implement machine learning solutions Qualifications: • Bachelor (Graduate preferred) degree in Computer Science, Mathematics, Informatics, Information Systems, or another quantitative field • 3 years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools. • 3 years working experience in AWS Glue ETL, Redshift, Step Function, Athena • Experience in implementing data pipelines for both streaming and batch integrations using tools/frameworks like Glue ETL, Lambda, Spark, Spark Experience in Lake Formation Orchestration, Maintain and enhance models for SDLC using CI/CD pipelines in AWS. • Experience in Relational and NoSQL databases, such as MySQL or Postgres and DynamoDB. • Functional and scripting languages: Python, Advanced SQL. • 3 years of experience in SQL optimization and performance tuning, and development experience in programming languages like Python, PySpark, Scala etc.). • 2 years in cloud data engineering experience in AWS • Experience with integration of multi cloud services with on-premises technologies. • Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines. • Experience with data profiling and data quality tools like Apache Griffin, Deequ, and Great Expectations. • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets. • Experience with at least one MPP database technology such as Redshift, Synapse or SnowFlake. • Experience with running and scaling applications on the cloud infrastructure and containerized services like Kubernetes. • Experience with version control systems like Github and deployment & CI tools. • Experience with Statistical/ML techniques is a plus. • Understanding of metadata management, data lineage, and data glossaries is a plus. • Working knowledge of agile development, including DevOps and DataOps concepts. • Experience building and optimizing ‘big data’ pipelines, architectures, and data sets. • Familiarity with business intelligence tools (such as PowerBI) Additional Skills, Abilities, Knowledge • Excellent communication skills, both verbal and written, along with the ability to influence and demonstrate confidence in communications with senior level management. • Proven track record of leading, mentoring data teams. • Strong change manager. Comfortable with change, especially that which arises through company growth. Able to lead a team effectively through times of change. • Ability to understand and translate business requirements into data and technical requirements. • High degree of organization and ability to manage multiple, competing projects and priorities simultaneously. • Positive and flexible attitude to enable adjusting to different needs in an ever-changing environment. • Strong leadership, organizational and interpersonal skills; comfortable managing trade-offs. • Foster a team culture of accountability, communication, and self-management. • Proactively drives impact and engagement while bringing others along. • Consistently attain/exceed individual and team goals • Ability to lead others without direct authority in a matrixed environment. • Competencies • Highly influential and having the ability to educate challenging stakeholders on the role of data and its purpose in the business. • Understands both the engineering and business side of the Data Products released. • Places the user in the center of decision making. • Teams up and collaborates for speed, agility, and innovation. • Experience with and embraces agile methodologies. • Strong negotiation and decision-making skill. • Experience managing and working with globally distributed teams. Education: • BA/BS in Computer Science, Math, Physics, or other technical fields. We offer a competitive package that includes Life insurance Major Medical Expenses Insurance Minor Medical Expense Insurance Savings Fund Food vouchers 10% 30 days as Christmas Bonus 12 days of vacation in the first year, increasing 2 days as dictated by law. Additionally, we provide continuous training and development opportunities to help our employees achieve their professional goals.

Location: Ciudad de México, MX

Posted Date: 5/11/2025