Staff Software Engineer (Inference)

Join our Inference team as a Staff Software Engineer, where you will be responsible for building and maintaining critical systems that serve our AI model, Claude, to millions of users worldwide. You will work on complex distributed systems challenges, optimize compute efficiency, and enable breakthrough AI research. The role offers comprehensive benefits, a competitive salary, and opportunities for professional growth.

- Strong candidates should have familiarity with performance optimization, distributed systems, large-scale service orchestration, and intelligent request routing
- Familiarity with LLM inference optimization, batching strategies, and multi-accelerator deployments is highly encouraged but not strictly necessary
- Implementing and deploying machine learning systems at scale
- LLM inference optimization, batching, and caching strategies
- Kubernetes and cloud infrastructure (AWS, GCP)
- Load balancing, request routing, or traffic management systems
- High-performance, large-scale distributed systems
- Python or Rust
- Care about the societal impacts of your work
- Have significant software engineering experience, particularly with distributed systems
- Are results-oriented, with a bias towards flexibility and impact
- Want to learn more about machine learning systems and infrastructure
- Thrive in environments where technical excellence directly drives both business results and research breakthroughs
- Pick up slack, even if it goes outside your job description
- Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience
- We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed