Scale AI
The Data Platform for AI: High quality training and validation data for AI applications.
Computer Vision • Data Annotation • Sensor Fusion • Machine Learning • Autonomous Driving
201 - 500
Software Engineer, ML Infrastructure - Evaluation Platform
September 12
🏢 In-office - Manhattan
Scale AI
The Data Platform for AI: High quality training and validation data for AI applications.
Computer Vision • Data Annotation • Sensor Fusion • Machine Learning • Autonomous Driving
201 - 500
Description
• Develop re-usable platforms for running in-house and open-source LLM-benchmarks • Ensure correctness and performance of post-training and eval jobs on the platform • Improve APIs for managing ML workflows • Contribute to foundational infrastructure for model inference and training • Participate in team’s on call process for service availability • Own projects end-to-end in cross-functional environment
Requirements
• 4+ years of experience developing ML platforms • Passion for working closely with researchers to drive business impact • Experience training and/or benchmarking LLMs • Experience with Python, Docker, Kubernetes, and Infrastructure as code (e.g. terraform)
Benefits
• Comprehensive health, dental and vision coverage • Retirement benefits • Learning and development stipend • Generous PTO • Commuter stipend
Apply Now
