scout22 › Jobs › Neon › Staff Software Engineer- Foundation Model Inference

Staff Software Engineer- Foundation Model Inference

Neon

$190k–$265kStaff+San Francisco, CA, USA

Level up AI infrastructure at a leading data company.

Apply in one tap on the scout22 app — your details fill themselves in on every application Apply on Neon's website fill out every field yourself, every time

Already have scout22? Open this job in the app

About Neon

Databricks is the data and AI company.

What you'd do

Build LLM infrastructure for large-scale inference
Improve reliability, latency, and efficiency
Collaborate with platform and ML teams
Shape AI interaction for developers and data scientists

What they're looking for

8+ years in backend or infrastructure engineering
Experience with distributed systems and scalable APIs
Familiarity with service-oriented architecture