All jobs
Save

Software quality engineer (UK)

Writer
Contract type
Ongoing
Work mode
On-site · On-site (see listing for address)
Experience
Senior · 5+ years

Job description

Key details

  • Define and implement comprehensive quality assurance strategies and test plans for AI agents and LLM-powered applications
  • Design and develop robust, scalable, and maintainable automated test frameworks from scratch or enhance existing ones
  • Collaborate closely with product managers, machine learning engineers, and data scientists to translate complex AI features and model behaviors into effective test cases and validation criteria
  • Drive continuous improvement of testing processes and infrastructure, integrating automated checks within CI/CD pipelines
  • Identify, document, and track software defects and inconsistencies, performing root cause analysis and providing actionable feedback
  • Monitor production systems and AI model performance, proactively identifying potential issues and contributing to post-release quality validation
  • Champion quality best practices across engineering teams and foster a culture of ownership and continuous improvement
  • Design, manage, and maintain test data strategies and mock services for stable, isolated, and repeatable test execution
  • Design, develop, or integrate agentic AI systems, AI skills, and the Model Context Protocol (MCP)
  • Manage the full defect lifecycle by analyzing customer feedback and debugging logs to identify, prioritize, and track software bugs
  • Company mission
  • Information not specified

Primary stack

Core technologies

Python (Programming Language)TypeScriptAWSAzureGoogle Cloud Platform (GCP)DockerKubernetes

Benefits

  • Generous PTO, plus company holidays
  • Comprehensive medical and dental insurance
  • Paid parental leave for all parents (16 weeks)
  • Fertility and family planning support
  • Early-detection cancer testing through Galleri
  • Competitive pension scheme and company contribution
  • Annual wellness stipend for gym, massage/chiropractor, personal training, etc
  • Learning and development stipend
  • Company-wide off-sites and team off-sites
  • Competitive compensation and company stock options

Requirements & details

  • 5+ years of hands-on experience in software quality assurance or engineering, with a strong focus on testing complex distributed systems or AI/ML applications
  • 5+ years of experience working with GitHub Actions
  • Proficiency in programming languages like Python or TypeScript for test automation
  • Experience with modern testing frameworks such as Playwright
  • Solid understanding of AI/ML concepts, including model evaluation metrics, data pipelines, and challenges of testing generative AI outputs
  • Experience with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) in a CI/CD environment is a big plus
  • Exceptional analytical skills and keen eye for detail
  • Collaborative spirit to connect cross-functional teams, challenge assumptions, and own end-to-end quality
  • Demonstrated ability to drive initiatives independently and thrive in a fast-paced, evolving startup environment
  • Python, TypeScript, Playwright, GitHub Actions, AWS, Azure, GCP, Docker, Kubernetes, LLMs, AI Agents, MCP
  • Python (Programming Language)
  • TypeScript
  • AWS
  • Azure
  • Google Cloud Platform (GCP)
  • Docker
  • Kubernetes

Apply