scout22 › Jobs › baseten › Software Engineer — GPU Networking & Distributed Systems

Software Engineer — GPU Networking & Distributed Systems

baseten

Mid levelOn-siteSan Francisco

Shape the future of AI at Baseten!

Apply in one tap on the scout22 app — your details fill themselves in on every application Apply on baseten's website fill out every field yourself, every time

Already have scout22? Open this job in the app

About baseten

Baseten powers mission-critical inference for leading AI companies.

What you'd do

Integrate RDMA/RoCE/InfiniBand into our stack
Optimize networking for Disaggregated KV Cache Offload
Enable sub-10-second startups for LLMs
Characterize networking performance on advanced clusters, writing test

What they're looking for

Experience with high-performance networking protocols
Fluency in C++ or Python
Deep understanding of NVIDIA memory hierarchy

Perks

Competitive compensation with equity
100% medical, dental, and vision insurance
Flexible PTO policy