scout22 › Jobs › Together AI › Junior/Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering

Junior/Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering

Together AI

Entry levelRemoteIndia

Want to build the backbone of AI infrastructure?

Apply in one tap on the scout22 app — your details fill themselves in on every application Apply on Together AI's website fill out every field yourself, every time

Already have scout22? Open this job in the app

About Together AI

Together AI is purpose-built for AI engineers delivering high-performance inference and custom models.

What you'd do

Build the provisioning state machine for GPU lifecycle management
Design declarative APIs for self-service inference requests
Automate self-healing and node management
Ensure reliability of the provisioning pipeline with robust monitoring

What they're looking for

Strong software engineering background in Go, Python, orRust
Experience with workflow orchestration tools like Temporal
Experience building software control planes or orchestration
Familiarity with event-driven systems and message queues