Techstar Software Development India Pvt. Ltd.
Data Engineer - ETL Tools
Job Location
hyderabad, India
Job Description
Primarily looking for a candidate with strong expertise in data-related skills, including : - SQL & Database Management : Deep knowledge of relational databases (PostgreSQL), cloud-hosted data platforms (AWS, Azure, GCP), and data warehouses like Snowflake. - ETL/ELT Tools : Experience with SnapLogic, StreamSets, or DBT for building and maintaining data pipelines. / ETL Tools Extensive Experience on data Pipelines - Data Modeling & Optimization : Strong understanding of data modeling, OLAP systems, query optimization, and performance tuning. - Cloud & Security : Familiarity with cloud platforms and SQL security techniques (e.g., data encryption, TDE). - Data Warehousing : Experience managing large datasets, data marts, and optimizing databases for performance. - Agile & CI/CD : Knowledge of Agile methodologies and CI/CD automation tools. Imp : The candidate should have a strong data engineering background with hands-on experience in handling large volumes of data, data pipelines, and cloud-based data systems Responsibilities : - Build the data pipeline for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and cloud database technologies. - Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data needs. - Work with data and analytics experts to strive for greater functionality in our data systems. - Assemble large, complex data sets that meet functional / non-functional business requirements. - Ability to quickly analyze existing SQL code and make improvements to enhance performance, take advantage of new SQL features, close security gaps, and increase robustness and maintainability of the code. - Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery for greater scalability, etc. - Unit Test databases and perform bug fixes. - Develop best practices for database design and development activities. - Take on technical leadership responsibilities of database projects across various scrum teams. - Manage exploratory data analysis to support dashboard development (desirable) Required Skills : - Strong experience in SQL with expertise in relational database(PostgreSQL preferrable cloud hosted in AWS/Azure/GCP) or any cloud-based Data Warehouse (like Snowflake, Azure Synapse). - Competence in data preparation and/or ETL/ELT tools like SnapLogic, StreamSets, DBT, etc. (preferably strong working experience in one or more) to build and maintain complex data pipelines and flows to handle large volume of data. - Understanding of data modelling techniques and working knowledge with OLAP systems - Deep knowledge of databases, data marts, data warehouse enterprise systems and handling of large datasets. - In-depth knowledge of ingestion techniques, data cleaning, de-dupe, etc. - Ability to fine tune report generating queries. - Solid understanding of normalization and denormalization of data, database exception handling, profiling queries, performance counters, debugging, database & query optimization techniques. - Understanding of index design and performance-tuning techniques - Familiarity with SQL security techniques such as data encryption at the column level, Transparent Data Encryption(TDE), signed stored procedures, and assignment of user permissions - Experience in understanding the source data from various platforms and mapping them into Entity Relationship Models (ER) for data integration and reporting(desirable). - Adhere to standards for all database e.g., Data Models, Data Architecture and Naming Conventions - Exposure to Source control like GIT, Azure DevOps - Understanding of Agile methodologies (Scrum, Itanban) (ref:hirist.tech)
Location: hyderabad, IN
Posted Date: 5/10/2025
Location: hyderabad, IN
Posted Date: 5/10/2025
Contact Information
Contact | Human Resources Techstar Software Development India Pvt. Ltd. |
---|