Job Description
Exp: 5+yrs
Location: India
Key Responsibilities
Design and implement data pipelines using S3 Medallion Architecture (Bronze, Silver, Gold layers)
Build and maintain scalable ETL/ELT workflows using AWS Lambda and Step Functions
Develop data ingestion frameworks to pull data from external APIs
Transform and load data into Amazon Redshift for analytics and reporting
Write efficient, reusable, and scalable code in Python
Ensure data quality, validation, and monitoring across pipelines
Optimize data storage and query performance in S3 and Redshift
Collaborate with data analysts, data scientists, and business stakeholders
Implement logging, alerting, and error-handling mechanisms
Maintain documentation for pipelines, data models, and workflows
Required Skills & Qualifications
Strong hands-on experience with AWS services:
S3 (data lake design)
Redshift
...