Senior Backend Engineer, Inference Platform

About Together AI

Together AI is a research-driven artificial intelligence company.

What you'd do

• Build and optimize global and local request routing
• Develop auto-scaling systems for resource allocation
• Design systems for multi-tenant traffic shaping
• Engineer trade-offs between latency and throughput used across diverse

What they're looking for

• 5+ years of experience building distributed systems
• Strong background in improving scalability and stability
• Expert-level programming in Rust, Go, Python, or TypeScript
• Knowledge of LLMs and generative models is a plus.

Perks

• Competitive compensation
• Equity and benefits
• Health insurance