Senior QA Tester - AI Solutions

MCS Group is delighted to be supporting an innovative Belfast-based technology company as they look to hire a Senior QA Engineer to join their growing AI Solutions team.

This is an opportunity to work on cutting-edge AI and LLM-powered applications used within highly regulated environments. You'll play a key role in ensuring quality across intelligent workflows, agent-based systems, integrations, and AI-driven solutions where reliability and robustness are critical.

The Role

• Design testing strategies for AI and LLM-powered applications
• Build automated evaluation frameworks and test suites
• Validate complex integrations, APIs and data pipelines
• Work closely with AI Solutions Engineers throughout the delivery lifecycle
• Integrate testing into CI/CD pipelines and development workflows
• Define QA standards and best practices for AI applications
• Help shape the future QA function within a rapidly growing organisation

What We're Looking For

• 5+ years' experience in QA Engineering
• Strong automation testing experience
• Experience testing complex software platforms and APIs
• Python or other scripting/programming experience
• Understanding of CI/CD pipelines and modern engineering practices
• Experience with AI, LLMs, prompt testing, evaluation frameworks, or a strong interest in this area
• Excellent communication skills and the ability to work closely with technical teams
• LangSmith, DeepEval, Ragas, Promptfoo or similar tools
• Agentic workflows, RAG applications or AI evaluation pipelines
• Performance testing
• Cloud platforms such as AWS, Azure or GCP
• Docker and containerised environments
• Experience within regulated industries

What's On Offer

• Competitive salary and benefits package
• Private healthcare
• Share options
• Flexible hybrid working
• Exposure to cutting-edge AI technologies
• Significant influence over QA strategy and standards
• A genuinely unique working pattern with additional company days off throughout the year

Unfortunately, sponsorship cannot be provided for this position.

To find out more, apply now or contact Djay Erskine at MCS Group for a confidential discussion.

#J-18808-Ljbffr