Job Description
In-person Interview for Irving, TX
8+ year min
Job Description
Roles & Responsibilities
Job Title: Senior PySpark Data Engineer
Job Description:
As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing in Big Data environment using predominantly PySpark/Python. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems using PySpark.
Roles & Responsibilities:
• Design, develop, and maintain robust, scalable high-performance Data Pipelines using PySpark.
• Create data pipelines, ensuring data quality, and implement ETL processes to migrate and deploy data across systems.
• Migrate Ab Initio ETL Applications into Pyspark based data pipelines
• Migrate On Prem workloads into Cloud(AWS, Databricks, Snowflake...