Senior Software Engineer (Inference)

Join our Inference team as a Senior Software Engineer, where you'll be responsible for building and maintaining critical systems that serve our AI model, Claude, to millions of users worldwide. You'll tackle complex distributed systems challenges, design intelligent routing algorithms, and contribute to new inference features. Enjoy comprehensive benefits, a competitive salary, and the opportunity to make a significant impact in the field of AI.

- Kubernetes and cloud infrastructure (AWS, GCP)
- Load balancing, request routing, or traffic management systems
- Implementing and deploying machine learning systems at scale
- LLM inference optimization, batching, and caching strategies
- Python or Rust
- High-performance, large-scale distributed systems
- Are results-oriented, with a bias towards flexibility and impact
- Have significant software engineering experience, particularly with distributed systems
- Pick up slack, even if it goes outside your job description
- Want to learn more about machine learning systems and infrastructure
- Thrive in environments where technical excellence directly drives both business results and research breakthroughs
- Care about the societal impacts of your work
- Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience