Lead Data Engineer - Python/PySpark

Job Role : Lead Data Engineer Location : Bengaluru, Karnataka, Notice Period : 15 to 20 days. Job Description : The incumbent will be part of the Predictive Analytics, Digital Analytics, Data Sciences, Advanced Visualization, Insights & Experimentation team and will report to the Manager/Senior Manager. He/she will be an individual contributor working on multiple data sciences, advanced visualization and data management initiatives across multiple companies and industries leveraging traditional and big data. The incumbent will have the unique opportunity to witness the application of analytics across multiple industry verticals. Close partnership with business and the senior leadership of multiple Tata Companies will enable a clear understanding of the business perspectives and the application of analytics for solving real business problems. Job Responsibilities : - Experience in Python - Experience in Spark ,pyspark, Hadoop, Hive, Map-R, MS SQL/PostgreSQL, ETL and Reporting Tools. - Experience in Technical & Functional roles in DWBI/Analytics, R&D & Management as Techno Functional expert in large and startup enterprises. - Driving innovation on development of DWBI/Analytics products and applications Automation. - Experience in Using Shell script ,cron jobs for process automation - Creating new insightful stories from complex unstructured data in ways that assist in translating problem statements into actionable decisions. - Expertise in building & Architecting Big Data Warehouse solutions which includes Enterprise Data Modelling, Requirements/Skill sets : - Must-have technical skills - Advanced proficiency with MS Office (Excel, Word, PPT etc.) - Experience in BI, Big Data and Data Visualisation - Basic understanding of advanced analytics and managing Unstructured data Must-have soft skills : - Problem Solving and lateral thinking - Excellent written and oral communication skills - Good interpersonal, problem solving, reasoning and analytical skills - People Management Experience, managing performance of team. - Ability of depicting the results of a statistical analysis in an easy-to-understand manner - Detailed oriented, organized, demonstrated ability to manage multiple projects simultaneously Good to have soft skills : - Candidates from Consulting background preferred - Excellent analytical, problem-solving and storytelling skills; effectively uses numbers to gain understanding and/ or illustrate a point - Strong number crunching and quantitative skills - Intellectual and analytical curiosity - initiative to dig into the why, what & how Strong aptitude on working with unstructured problems - Start-up environment and product development experience Experience and Skills : - 8 years of professional working experience in Analytics Domain - Experience in Leading Project End to End Delivery. - Experience in Retail, Financial Services and Manufacturing will be preffered - Experience using statistical packages of R, Python and Spark ML to work with data and draw insights from large data sets - Experience with distributed data/ computing tools: Hadoop, Hive, Spark, Python - Experience with SQL - Experience visualizing/ presenting data for stakeholders using matplot, ggplot or Excel or Tableau - Excellent written and verbal communication skills for coordinating across teams Education qualification : - Bachelors/ Masters in a quantitative discipline (Statistics, Econometrics, Mathematics, Engineering and Science) (ref:hirist.tech)

Location: karnataka, IN

Posted Date: 5/1/2025