Software Engineer, Inference

June 3

Apply Now

Receive Emails with Similar Jobs

Anthropic

WebsiteLinkedInAll Job Openings

Anthropic is an AI safety and research company working to build reliable, interpretable, and steerable AI systems.

51 - 200

Description

• The expected salary range for this position is: • Improving how inference requests are routed to model servers to maximize compute efficiency. • Building a performance model to predict the impact of future architecture and hardware improvements. • Implementing inference for a new model architecture. • Analyzing observability data to tune performance based on production workloads. • Implementing inference on a new hardware platform. • Building instrumentation to detect and eliminate Python GIL contention. • Optimizing the efficiency of our accelerator kernels. • Ensuring smooth and regular deployment of inference services.

Requirements

• Have significant software engineering experience. • Are results-oriented, with a bias towards flexibility and impact. • Pick up slack, even if it goes outside your job description. • Enjoy pair programming (we love to pair!). • Want to learn more about machine learning research. • Care about the societal impacts of your work. • High performance, large-scale distributed systems experience. • Knowledge of Kubernetes. • Familiarity with Python. • Experience in machine learning.

Benefits

• Optional equity donation matching. • Comprehensive health, dental, and vision insurance for you and all your dependents. • 401(k) plan with 4% matching. • 22 weeks of paid parental leave. • Unlimited PTO – most staff take between 4-6 weeks each year, sometimes more! • Stipends for education, home office improvements, commuting, and wellness. • Fertility benefits via Carrot. • Daily lunches and snacks in our office. • Relocation support for those moving to the Bay Area. • Private health, dental, and vision insurance for UK employees. • Pension contribution (matching 4% of your salary). • 21 weeks of paid parental leave for UK employees. • Health cash plan. • Life insurance and income protection.