AWS Data Engineer/Analyst - Cloud Services

Position : AWS Data Engineer - Analyst Location : Bangalore, Coimbatore, Delhi NCR, Mumbai (India) Experience : 1 - 3 Years Company : Talent Worx (Recruiting for a Leading Big 4 Firm) Job Summary : We are seeking a highly motivated and skilled AWS Data Engineer - Analyst to join our client, a leading Big 4 firm. In this role, you will be responsible for designing, implementing, and maintaining robust data pipelines and analytics solutions using AWS services. The ideal candidate will possess a strong foundation in AWS data services, big data technologies, and programming languages, with a focus on delivering scalable and efficient data solutions. Key Responsibilities : - Design and implement scalable, high-performance data pipelines using AWS services (Glue, EMR, Lambda). - Develop and optimize ETL/ELT processes to ingest, transform, and load data from various sources into data lakes and data warehouses. - Automate data pipeline processes for efficiency and reliability. - Build and maintain data lakes using Amazon S3 and Delta Lake, ensuring data integrity and accessibility. - Create and manage analytics solutions using Amazon Athena and Redshift for efficient data querying and analysis. - Optimize data storage and retrieval for performance and cost-effectiveness. - Design and implement database solutions using Amazon Aurora, RDS, and DynamoDB to support various application needs. - Develop and maintain database schemas and optimize database performance. - Ensure data integrity and security within database systems. - Develop serverless workflows using AWS Step Functions to orchestrate complex data processing tasks. - Implement event-driven architectures using AWS Lambda and other serverless services. - Write efficient and maintainable code using Python/PySpark for data processing and analysis. - Develop and execute SQL/PostgreSQL queries for data extraction and manipulation. - Create automation scripts. - Ensure data quality, security, and compliance with industry standards and regulations. - Implement data validation and quality checks to maintain data accuracy. - Implement security best practices for data storage and access. - Collaborate with data scientists and analysts to understand their data needs and provide effective solutions. - Troubleshoot and resolve data pipeline and infrastructure issues in a timely manner. - Optimize data architecture for performance and cost-efficiency. - Create and maintain clear and thorough documentation for data pipelines, data models, and processes. Technical Skills : - AWS Glue, EMR, Lambda, Athena, Redshift, S3, Aurora, RDS, DynamoDB, Step Functions. - Hadoop, Spark, Delta Lake. - Python, PySpark. - SQL, PostgreSQL, NoSQL databases. - Experience with data warehousing concepts and analytics tools. - Strong understanding of ETL/ELT processes and best practices. - Experience with designing and implementing data lake architectures. - Proficiency in Git for version control. - Familiarity with Agile development methodologies. Required Qualifications : Educational Background : - Master's degree in Computer Science, Information Technology, or a related field. Experience : - 1-3 years of experience as a Data Engineer, with a significant focus on AWS services. - At least 60% of experience focusing on AWS. - Strong proficiency in AWS data services, including Glue, EMR, Lambda, Athena, Redshift, and S3. - Experience with data lake technologies, particularly Delta Lake. - Expertise in database systems, including Aurora, RDS, DynamoDB, and PostgreSQL. - Proficiency in Python and PySpark programming. - Strong SQL skills and experience with PostgreSQL. Benefits : - Opportunity to work with a leading Big 4 firm in India. - Exposure to cutting-edge AWS technologies and big data solutions. - Competitive compensation and benefits package. - Opportunities for professional growth and development. (ref:hirist.tech)

Location: in, IN

Posted Date: 5/1/2025