Data Engineer - AWS/Azure Databricks

Job Description : Responsibilities : - Minimum three years of experience in data analytics field - Experience with Azure/AWS Databricks - Experience in building and optimizing data pipelines, architectures and data sets - Excellent experience in Scala or Python, PySpark and SQL - Ability to troubleshoot and optimize complex queries on the Spark platform - Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques - Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS - Hands on experience in performance tuning and optimizing code running in Databricks environment - Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment - Data Engineering expertise in Big Data Management using Cloudera, Python, Hive, Scala, Data Warehouse, Data Lake, AWS, / Professional Skills : - Azure/AWS Databricks - Python / Scala / Spark / PySpark - HIVE / HBase / Impala / Parquet - Sqoop, Kafka, Flume - SQL and RDBMS - Airflow - Jenkins / Bamboo - Github / Bitbucket - Nexus (ref:hirist.tech)

Location: pune, IN

Posted Date: 5/1/2025