D
LLM Deployment Engineer
Destinusgroup
Contract type
Ongoing
Work mode
Remote · Zürich, Switzerland
Experience
Mid-level · 3+ years
Job description
An LLM Deployment Engineer role focused on deploying and scaling open-weights LLMs on cloud and local clusters and connecting them to automation use cases across the organization. The position sits at the intersection of ML, software infrastructure engineering, and enterprise systems.
At a glance
- Work mode
- Remote · Zürich, Switzerland
- Languages
- English
What you'll do
- Deploy and maintain open-weights LLMs on cloud and local cluster
- Scale deployments to serve a large number of users within the organization
- Be up-to-date with new model releases, to keep our deployment state of the art
- Connect LLMs to specific use cases, helping users across the organization to automate their work routine
- Analyze the effectiveness of models on automation tasks
- Embed security and privacy in the automation pipeline, to safeguard sensitive content
What we're looking for
- 3+ years of professional experience in software engineering
- Experience working with LLM APIs, both open-weight and proprietary
- Familiarity with LLM applications, including tools, retrieval-augmented generation (RAG) and routing
- Experience with CI/CD pipelines, infrastructure as code, and modern software delivery practices
- Understanding of security and privacy considerations in enterprise environments
- Strong problem-solving skills and the ability to collaborate effectively across technical and non-technical teams
Nice to have
- Knowledge of Model Context Protocol (MCP) or similar interoperability standards
- Experience with AI governance, observability, or operational monitoring
- Proficiency with cloud platforms (AWS, GCP, or Azure), and high-performance computing environments (Kubernetes, SLURM)
- Experience in evaluating ML models