Senior Software Engineer (YDB Team)
Job description
Mid- and senior-level software developer role in the YDB Development Team at Nebius, working on the open-source YDB platform used for object storage and as a distributed relational database and message broker. The role focuses on evolving YDB's architecture for new hardware and large-scale production clusters.
At a glance
- Employment
- Full-time
- Work mode
- Remote · EU
What you'll do
- Evolve YDB's architecture for new hardware, redesigning core components when incremental optimization is insufficient
- Increase storage density on QLC NVMe drives while controlling RAM/CPU consumption and write amplification
- Reduce CPU overhead and memory bandwidth consumption to utilize dual 800 Gb/s network adapters
- Ensure efficient operation on NVIDIA GB300-based Arm hosts and offload storage and networking processing to BlueField DPUs
- Support high-capacity SMR HDDs by designing data placement, sequential writes, garbage collection and recovery around zoned-write constraints
- Develop wide erasure-coding schemes to reduce space amplification while maintaining durability and availability
- Reduce recovery and rebalancing times after device outages while limiting the impact on foreground workloads
- Prevent, detect and recover from silent data corruption across memory, networking and storage
- Provide the system capabilities and interfaces required by fleet-wide automation so that hundreds of production clusters can be deployed, configured, upgraded, diagnosed and operated consistently
What we're looking for
- 5+ years of professional experience developing high-load systems in C or C++ (3+ years considered with relevant distributed storage systems experience)
- Experience developing high-performance, low-latency software components
- Understanding of core dumps, flame graphs and sanitizer-enabled builds
- Understanding of CPU caches, atomic operations and NUMA architectures
Nice to have
- Experience designing and developing production-grade distributed storage systems and/or databases
- Experience with on-disk data structures such as LSM trees and B+ trees, and storage algorithms such as erasure coding and checksumming
- Understanding of NVMe, conventional HDD and SMR HDD internals
- Experience with debugging and profiling tools such as perf, VTune, bpftrace and gdb
- Familiarity with the Linux kernel, SPDK/DPDK, libaio and io_uring
- Knowledge of IP, TCP, UDP and DNS, and ideally InfiniBand or RoCE/RDMA
- Experience with Kubernetes and Grafana
- Experience responding to production incidents
- Knowledge of availability and durability calculations
Your team
YDB Development Team
Team building the open-source YDB platform, which provides the binary object storage foundation for S3 Object Storage, Shared Filesystems and Network Block Storage, and serves as a distributed relational database and message broker for services such as IAM, billing, audit trails and logging.
Benefits
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Apply
About Nebius
Leading a new era in cloud infrastructure for the global AI economy
Nebius is building a full-stack AI cloud platform. From large-scale GPU orchestration to inference optimization, the company owns the hard problems across compute, storage, networking and applied AI. Listed on Nasdaq (NBIS) and headquartered in Amsterdam, with a global footprint and R&D hubs across Europe, the UK, North America and Israel.
Mission
Building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
Key facts
- 1,500+
- Amsterdam
- AI cloud infrastructure
- Listed on Nasdaq (NBIS)
- Global footprint with R&D hubs across Europe, the UK, North America and Israel
- Team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D
- Operates YDB clusters in more than 10 regions using HDD and NVMe storage
- Individual clusters span tens of thousands of nodes, manage hundreds of petabytes of data and deliver terabytes per second of throughput
- Infrastructure includes x86 and Arm-based systems, including NVIDIA GB300 nodes
What they value
- Fast moving
- Bold thinking
- Constant growth
- Meaningful impact
- Trust and real ownership
- Opportunity to shape the future of AI