Location
winnipeg
Job Type
Full-time
Posted
June 08, 2026
Job Description
Shape the future of AI with Outlier as an Evaluation Engineer. Collaborate closely with leading organizations to enhance AI agents through human feedback and innovative design.
Outlier is seeking an AI Evaluation Engineer with over two years of experience in backend engineering and AI automation. The ideal candidate should have a robust understanding of software development, including modular services and complex system integration. Engage directly in crafting proactive and multi-step AI agents while ensuring high-quality performance through rigorous testing and feedback.
Key Responsibilities:
• Build and maintain production-grade software for AI systems
• Provide technical feedback on agent behaviors and workflows
• Coordinate multi-turn system interactions effectively
• Implement integrations with live tools and APIs
• Ensure system optimization and data management
Requirements:
• 2+ years in backend engineering or AI automation
• Proficiency in Python, ...
Outlier is seeking an AI Evaluation Engineer with over two years of experience in backend engineering and AI automation. The ideal candidate should have a robust understanding of software development, including modular services and complex system integration. Engage directly in crafting proactive and multi-step AI agents while ensuring high-quality performance through rigorous testing and feedback.
Key Responsibilities:
• Build and maintain production-grade software for AI systems
• Provide technical feedback on agent behaviors and workflows
• Coordinate multi-turn system interactions effectively
• Implement integrations with live tools and APIs
• Ensure system optimization and data management
Requirements:
• 2+ years in backend engineering or AI automation
• Proficiency in Python, ...
Ready to Apply?
Submit your application for AI Evaluation Engineer for Outlier at Outlier AI
Apply Now