Scout22 › Jobs › AnyScale › Distributed LLM Inference Engineer

Distributed LLM Inference Engineer

AnyScale

Mid levelSan Francisco

Scale machine learning with your skills!

Apply in one tap on the scout22 app — your details fill themselves in on every application Apply on AnyScale's website fill out every field yourself, every time

Already have scout22? Open this job in the app

About AnyScale

Anyscale makes distributed computing accessible for developers.

What you'd do

Optimize large-scale ML inference
Integrate Ray Data and LLM engine
Contribute to open source software
Implement best practices from research

What they're looking for

Familiarity with ML inference at scale
Knowledge of deep learning frameworks
Understanding of distributed systems