Quarks - Data Engineer - On Premises

Job Title : Data Engineer Experience Level : 4 years and atleast 1 in on premises Location : Noida ( WFO) Job Overview : We are seeking a skilled and experienced On-Premises Data Engineer to join our team. The ideal candidate will have a strong background in designing, implementing, and maintaining data infrastructure solutions within on-premises environments. This role will involve working closely with cross-functional teams to ensure the availability, integrity, and security of our on-premises data systems. Responsibilities : - Data Infrastructure Design: - Design, architect, and implement data infrastructure solutions within on-premises environments to support business needs. - Evaluate existing systems and propose enhancements or upgrades as necessary. Data Pipeline Development : - Develop, optimize, and maintain data pipelines to ingest, process, and transform data from various sources. - Ensure scalability, reliability, and performance of data pipelines. Database Management : - Manage on-premises database systems, including installation, configuration, tuning, and troubleshooting. - Ensure data integrity, security, and compliance with regulatory requirements. Data Modeling and Warehousing : - Design and implement data models and data warehouses to support reporting and analytics requirements. - Optimize data storage and retrieval for performance and efficiency. Monitoring and Optimization : - Monitor system performance and identify opportunities for optimization and improvement. - Implement automation and scripting for routine tasks and processes. Collaboration and Support : - Collaborate with cross-functional teams, including developers, data scientists, and business analysts, to support data-related initiatives. - Provide technical support and troubleshooting for data-related issues. Documentation and Compliance : - Document system configurations, processes, and procedures. - Ensure compliance with data governance policies, security standards, and regulatory requirements. Requirements : Education : - Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Experience : - Minimum 4 years of experience in data engineering roles, with a focus on on-premises environments. - Hands-on experience with on-premises data infrastructure solutions, such as Hadoop, Apache Spark, or similar technologies. Technical Skills : - Proficiency in SQL and one or more programming languages (e.g., Python, Java). - Experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra). - Knowledge of data warehousing concepts and technologies (e.g., Snowflake, Redshift). - Familiarity with data integration tools and ETL processes. (ref:hirist.tech)

Location: Noida, IN

Posted Date: 4/24/2024