Job Description
SUMMARY:
We are sourcing for a Data Engineer role.
POSITION INFO:
Duties and Responsibilities: Contribute to the establishment and operation of the AI Centre of Excellence (AI CoE) Collaborate with executives to develop strategies that align with organisational imperatives. Partner with AI Champions, ICT, Data Scientists and AI/ML Engineers to integrate AI into operational workflows smoothly. Data Ingestion & Integration Build scalable batch and streaming pipelines from internal and external sources (APIs, CDC, files, events). Implement schema evolution, late-arriving data handling, and idempotent ingestion. Set up connectors and jobs across cloud services, message queues (Kafka/Kinesis/Event Hubs), and integration tools. Data Transformation & Modeling Design and maintain curated datasets (bronze/silver/gold) using ELT/ETL. Implement dimensional models, data vault, and/or lakehouse patterns as appropriate. Use transformation frameworks (e.g., dbt...