W
Software quality engineer (UK)
Writer
Contract type
Ongoing
Work mode
On-site · On-site (see listing for address)
Experience
Senior · 5+ years
Job description
Key details
- Define and implement comprehensive quality assurance strategies and test plans for AI agents and LLM-powered applications
- Design and develop robust, scalable, and maintainable automated test frameworks from scratch or enhance existing ones
- Collaborate closely with product managers, machine learning engineers, and data scientists to translate complex AI features and model behaviors into effective test cases and validation criteria
- Drive continuous improvement of testing processes and infrastructure, integrating automated checks within CI/CD pipelines
- Identify, document, and track software defects and inconsistencies, performing root cause analysis and providing actionable feedback
- Monitor production systems and AI model performance, proactively identifying potential issues and contributing to post-release quality validation
- Champion quality best practices across engineering teams and foster a culture of ownership and continuous improvement
- Design, manage, and maintain test data strategies and mock services for stable, isolated, and repeatable test execution
- Design, develop, or integrate agentic AI systems, AI skills, and the Model Context Protocol (MCP)
- Manage the full defect lifecycle by analyzing customer feedback and debugging logs to identify, prioritize, and track software bugs
- Company mission
- Information not specified
Primary stack
Core technologies
Python (Programming Language)TypeScriptAWSAzureGoogle Cloud Platform (GCP)DockerKubernetes
Benefits
- Generous PTO, plus company holidays
- Comprehensive medical and dental insurance
- Paid parental leave for all parents (16 weeks)
- Fertility and family planning support
- Early-detection cancer testing through Galleri
- Competitive pension scheme and company contribution
- Annual wellness stipend for gym, massage/chiropractor, personal training, etc
- Learning and development stipend
- Company-wide off-sites and team off-sites
- Competitive compensation and company stock options
Requirements & details
- 5+ years of hands-on experience in software quality assurance or engineering, with a strong focus on testing complex distributed systems or AI/ML applications
- 5+ years of experience working with GitHub Actions
- Proficiency in programming languages like Python or TypeScript for test automation
- Experience with modern testing frameworks such as Playwright
- Solid understanding of AI/ML concepts, including model evaluation metrics, data pipelines, and challenges of testing generative AI outputs
- Experience with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) in a CI/CD environment is a big plus
- Exceptional analytical skills and keen eye for detail
- Collaborative spirit to connect cross-functional teams, challenge assumptions, and own end-to-end quality
- Demonstrated ability to drive initiatives independently and thrive in a fast-paced, evolving startup environment
- Python, TypeScript, Playwright, GitHub Actions, AWS, Azure, GCP, Docker, Kubernetes, LLMs, AI Agents, MCP
- Python (Programming Language)
- TypeScript
- AWS
- Azure
- Google Cloud Platform (GCP)
- Docker
- Kubernetes
