Lead Software Engineer (Data Engineer)

Lead Software Engineer (Data Engineer)

Innovation / Project / Organization Permanent contract Bangalore, India Hybrid Reference Start date Immediately Publication date 2025/07/25

Responsibilities

Lead - Data Engineer

Responsibilities

Analyze, organize and process raw data using Bigdata technologies and Scala

Perform data validation, cleaning and transformation using Big data technologies, Spark and Scala

Ingest and manage data in HDFS/Hive and analyze data using Spark and produce meaningful insights for the business team

Combine raw information from different sources, Explore ways to enhance data quality and reliability

Develop code using Software Craftmanship best practices such as Continuous delivery and Clean coding principles

Help business operations team with data samples to create proof of concepts

Ensure the new data sets are feedin...