Data Engineer - Python/Scala

Responsibilities : - Design, construct, install, test, and maintain highly scalable data management systems. - Develop and implement ETL processes to collect, store, and process data from various sources. - Build and optimize data pipelines for efficient data ingestion and transformation. - Collaborate with data analysts and data scientists to understand data requirements and implement solutions. - Ensure data quality, integrity, and security throughout the data lifecycle. - Perform data modeling and schema design to support business needs. - Implement and maintain data warehouse solutions for analytics and reporting purposes. - Stay updated with emerging technologies and best practices in data engineering. Requirements : - Bachelor's degree in Computer Science, Engineering, or related field. - 5 years of experience in data engineering or related roles. - Proficiency in programming languages such as Python, Java, or Scala. - Strong experience with big data technologies such as Hadoop, Spark, or Kafka. - Hands-on experience with SQL and NoSQL databases. - Familiarity with cloud platforms such as AWS, Azure, or GCP. - Experience with data pipeline orchestration tools like Apache Airflow or Luigi. - Solid understanding of data modeling and schema design principles. - Excellent problem-solving and analytical skills. - Strong communication and collaboration abilities. - Ability to work effectively in a fast-paced and dynamic environment. - Certifications in relevant technologies (optional but preferred). (ref:hirist.tech)

Location: India, IN

Posted Date: 4/24/2024