Scout22 › Jobs › baseten › Software Engineer — GPU Networking & Distributed Systems

Software Engineer — GPU Networking & Distributed Systems

baseten

Mid levelOn-siteSan Francisco

Imagine building the future of AI networking.

Apply in one tap on the scout22 app — your details fill themselves in on every application Apply on baseten's website fill out every field yourself, every time

Already have scout22? Open this job in the app

About baseten

Baseten powers inference for top AI companies.

What you'd do

Optimize distributed inference layers
Implement RDMA/RoCE capabilities
Enable fast startup for LLMs
Design tools to visualize packet flow

What they're looking for

Experience with InfiniBand and RoCE
Proficient in C++ or Python
Deep understanding of NVIDIA architecture
Knowledge of NCCL and NVSHMEM