Data Engineer - ETL/Python/Tableau

Job Title : Data : - Design, develop, and maintain scalable and efficient data pipelines using Snowflake, DBT, and Python. - Build and optimize data models within Snowflake using DBT for efficient data transformation and analysis. - Develop and implement ETL/ELT processes to ingest data from various sources into our data warehouse. - Write complex SQL queries for data extraction, manipulation, and analysis within Snowflake. - Utilize Python to automate data-related tasks, build custom data processing logic, and integrate with various systems. - Collaborate with data scientists, analysts, and other stakeholders to understand their data requirements and provide appropriate solutions. - Monitor and troubleshoot data pipelines, ensuring data quality, reliability, and performance. - Implement data governance and data quality best practices. - Contribute to the development and maintenance of our data warehouse architecture. - Stay up-to-date with the latest advancements in data engineering technologies and best practices, particularly within the Snowflake and DBT ecosystems. - Document data pipelines, data models, and other technical specifications. - Participate in code reviews to ensure code quality and adherence to standards. - Work in an agile environment, contributing to sprint planning, daily stand-ups, and Bachelor's degree in Computer Science, Engineering, or a related field. Equivalent practical experience will also be considered. - Proven experience (4 years) working as a Data Engineer or Data Developer. - Strong understanding of data warehousing concepts, principles, and best practices (e.g., dimensional modeling, star schema, snowflake schema). - Experience working with cloud-based data platforms, preferably Snowflake. - Solid understanding of data governance, data quality, and data security principles. - Experience with version control systems (e.g., Git). - Excellent problem-solving and analytical skills. - Strong communication and collaboration skills. - Ability to work independently and as part of a team. - Experience working in an agile development environment. Minimum 3 years of practical experience with DBT, including : - Designing and implementing data models and transformations using DBT. - Proficiency in writing Jinja code for dynamic SQL generation. - Experience with DBT testing and documentation. - Understanding of DBT project structure and best practices. Python : Minimum 3 years of advanced proficiency in Python, including : - Experience with data manipulation libraries (e.g., Pandas, NumPy). - Knowledge of ETL/ELT frameworks and libraries in Python. - Ability to write clean, efficient, and well-documented Python code. - Experience with connecting to and interacting with databases using Python. Preferred Skills : - Experience with other cloud platforms (AWS, Azure, GCP). - Familiarity with data visualization tools (Tableau, Power BI). - Experience with data streaming technologies (Kafka, Kinesis). - Knowledge of orchestration tools (Airflow, Prefect). - Experience with NoSQL databases. - Understanding of DevOps principles and CI/CD pipelines. - Experience with data catalog and data lineage tools. (ref:hirist.tech)

Location: hyderabad, IN

Posted Date: 5/1/2025