Senior AI Test Automation Engineer (Vitoria-Gasteiz)

Senior AI Test Automation Engineer – Hybrid Madrid

We are seeking a Senior AI Test Automation Engineer to lead and evolve the test automation strategy for an advanced AI & MLOps platform. The role involves designing scalable frameworks, automating test cases in Python, and ensuring quality across complex systems including APIs, UIs, data pipelines, and AI/ML components such as LLMs and RAG systems.

Responsibilities

• Own the design, architecture, and evolution of the test automation framework for the AI & MLOps platform.
• Define and implement scalable, reusable automation patterns (UI, API, data, BDD).
• Automate test cases using Python stack (Playwright, pytest, requests, pytest‑bdd/Behave) applying clean code practices.
• Design and execute AI/ML‑specific tests (LLM evaluation, RAG validation, non‑deterministic outputs).
• Integrate and orchestrate automated tests within CI/CD pipelines (GitLab), ensuring reliable executi...