Job Description
Details:
We are looking for an experienced Senior Databricks Engineer to design, build, and optimize scalable data solutions on the Databricks platform. The ideal candidate will have strong expertise in data engineering, Spark, SQL, Python/Scala, and cloud-based data platforms. This role involves working closely with data architects, analysts, and business teams to deliver reliable, high-performance data pipelines and analytics solutions.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark
Build batch and streaming data processing solutions for large-scale datasets
Optimize ETL/ELT workflows for performance, reliability, and cost efficiency
Work with data from multiple sources and integrate it into curated data models
Implement data quality checks, monitoring, and troubleshooting for production pipelines
Collaborate with stakeholders to understand data requ...