AWS Data Engineer - Python/SQL

AWS Data Engineer DBT (3-5 Years Experience) Job Title : AWS Data Engineer DBT Experience : 3-5 Years About the Job : We are seeking a highly motivated and skilled AWS Data Engineer with 3-5 years of experience to join our growing data team. In this role, you will be instrumental in building, maintaining, and optimizing our data pipelines and project infrastructure within the AWS ecosystem. You will work closely with cross-functional teams to ensure the seamless flow of data, enabling critical business insights and supporting our Customer Data Platform (CDP) initiatives. This is an excellent opportunity to contribute significantly to our data-driven culture and expand your expertise in modern data engineering practices. Key Responsibilities : - Collaborate with product managers, data scientists, analysts, and other stakeholders to understand data requirements and deliver robust data solutions. - Design, develop, and maintain scalable and efficient data pipelines using AWS services such as S3, Glue, Lambda, and Redshift. - Manage end-to-end data engineering tasks, including data ingestion from various sources, data cleaning, transformation, and loading into our data lake and data warehouse. - Utilize DBT (Data Build Tool) to implement and manage data transformations, ensuring data quality and accessibility for analytical purposes. - Write and optimize complex SQL queries for data extraction, manipulation, and analysis within the AWS environment. - Develop and maintain Python scripts for data processing, automation of repetitive tasks, and integration with various systems. - Contribute to the development and maintenance of our project infrastructure on AWS. - Implement and enforce data quality checks and monitoring to ensure the accuracy and reliability of our data assets. - Support CDP-related initiatives by building and maintaining data pipelines that integrate data from various marketing and analytics platforms into our AWS environment. - Participate in code reviews and contribute to the establishment of data engineering best practices. - Work with version control systems like Git (via Jenkins and Bitbucket) for continuous integration and continuous delivery (CI/CD) of data pipelines. - Troubleshoot and resolve data-related issues in a timely and efficient manner. Required Skills and Experience : - AWS Data Engineering : Proven hands-on experience (3-5 years) with core AWS data services, including S3, Glue (including Glue DataBrew and Glue Catalog), Lambda, and Redshift. - DBT (Data Build Tool) : Solid experience in using DBT for data transformation, version control of data models, and promoting a data analytics-friendly environment. - SQL : Strong ability to write, optimize, and debug complex SQL queries across different database systems. - Python : Practical experience (3-5 years) in Python programming for data manipulation, ETL processes, and automation. - Version Control : Familiarity with Git and experience using tools like Jenkins and Bitbucket for CI/CD pipelines. Additional Skills (Good to Have) : - Data Modeling : Understanding of data modeling concepts (e.g., dimensional modeling, star schema, snowflake schema) and experience in designing and maintaining data models. - Big Data Technologies : Exposure to big data processing frameworks like Databricks (Spark) and their integration with AWS. - Workflow Orchestration : Familiarity with workflow orchestration tools such as Apache Airflow or AWS Step Functions. - Experience with data visualization tools (e.g., Tableau, Power BI). - Understanding of data governance principles and practices. Qualifications : - Proven track record of successfully delivering data engineering projects. - Ability to work independently, take ownership of assigned tasks, and manage priorities effectively. - Strong problem-solving and analytical skills with a keen attention to detail. - Excellent communication and collaboration skills to work effectively with cross-functional teams. While a formal degree in Computer Science, Engineering, or a related field is a plus, demonstrable hands-on experience and a strong portfolio of delivered projects are highly valued (ref:hirist.tech)

Location: pune, IN

Posted Date: 5/17/2025