Job Description
Job Role: Senior Data Engineer
Experience: 6+ Years
Location: South Bangalore, KA
Key Responsibilities:
• Design, develop, and optimize ETL/ELT pipelines using Azure Databricks and Azure Data Factory.
• Build scalable batch and streaming data processing solutions using Python and PySpark.
• Implement and maintain Delta Lake and Lakehouse architectures .
• Design and manage data models, including Dimensional Modeling and SCD Type 1 & Type 2 implementations.
• Develop data storage solutions using Azure Data Lake Storage (Gen2, Delta Tables, and Parquet formats).
• Integrate external systems through REST APIs and secure authentication mechanisms.
• Build and maintain CI/CD pipelines using Azure DevOps and Git.
• Implement data governance, security, and acces...