V
AI Research
Contract type
Ongoing
Work mode
Remote · Worldwide
Experience
3 years
Job description
AI Researcher at Vetto who designs datasets, benchmarks, and evaluations to teach models new capabilities and measure whether training interventions worked. The role is evaluation-driven with some fine-tuning and post-training to validate research hypotheses, working directly with top AI labs.
At a glance
- Work mode
- Remote · Worldwide
What you'll do
- Design and run experiments to understand model behavior, test new ideas, and determine whether a dataset or training intervention actually works.
- Use fine-tuning and post-training experiments when useful to validate research hypotheses and measure improvements in the capabilities we care about.
- Create datasets, benchmarks, agent environments, rubrics, and evaluation methods for problems that are not well measured today.
- Work directly with AI labs and enterprise partners to turn open-ended model-development goals into concrete research and data projects.
- Dig into model outputs and trajectories to understand systematic failure modes and separate model limitations from problems in the data, grader, or evaluation setup.
- Write analysis code and build lightweight tools or prototypes for your own work, with support from engineers when a workflow needs to become reliable infrastructure.
- Share what you learn through clear technical reports, internal discussions, benchmarks, and research papers.
What we're looking for
- Experience doing empirical research or similarly open-ended technical work with machine learning systems.
- Hands-on experience designing and running agentic systems for complex work, such as coding agents and automated research pipelines.
- Good experimental judgment: you can form a hypothesis, choose useful baselines and metrics, run a careful experiment, and make sense of noisy results.
- Strong Python and data analysis skills, plus enough software engineering ability to prototype your own research workflows.
- The independence to take an ambiguous question about a model and turn it into a dataset, benchmark, experiment, or other concrete contribution.
- Rigorous analytical thinking — you look at the underlying evidence, notice subtle failure modes, and question results that seem too simple or too good to be true.
- Excellent written and verbal communication with researchers, engineers, customers, and non-specialists.
- Comfort with ambiguity, fast iteration, changing priorities, and occasional forward-deployed work with partner teams.
Nice to have
- Research or industry experience in LLM evaluation, post-training, agents, human or synthetic data, alignment, or AI safety.
- Experience designing datasets or benchmarks, validating annotation quality, or working with large collections of model outputs and trajectories.
- Published research, technical writing, open-source contributions, or strong independent projects.
- Experience building or managing human feedback pipelines.
- A background in cognitive science, linguistics, philosophy, statistics, or another field that helps you think clearly about evaluation.
- Experience at an AI lab, AI data company, or in a partner-facing research role.
Benefits
- Competitive compensation and a stock option plan.
- Global, remote-first work with flexibility and periodic in-person on-sites every few months.
- Direct collaboration with cutting-edge AI labs on evaluation, data, and post-training challenges.
- High ownership and fast career growth in a founding-era team.
Apply
About Vetto
Builds the infrastructure for next-generation AI training data
Vetto builds the infrastructure for next-generation AI training data. We partner with the world's top AI labs to push the frontier of what models can do — by designing, collecting, and delivering the highest-quality training data for the hardest problems in AI.
Key facts
- Partners with the world's top AI labs
- Global, remote-first work with periodic in-person on-sites every few months
- Founding-era team
What they value
- End-to-end ownership
- Work that gets used
- Fast, flat team
