Senior Software Engineer - Compiler

January 10

Apply Now

Receive Emails with Similar Jobs

CentML

WebsiteLinkedInAll Job Openings

We Make ML Training Affordable. Our platform offers significant savings on your training costs for ML models.

Machine Learning • NLP • Computer Vision • Deep Learning • Optimizations

11 - 50

Description

• Do you want to help drive the development of high-performance, power-efficient datacenter solutions for Deep Learning? Do you have an interest in how system architecture across GPU, networking, CPU and IO relate to brand new generative AI capabilities? Come join our team, and bring your experience and interests to help us optimize our next generation of inference and training frameworks/frameworks and to redefine the deep learning industry once again. • Responsibilities: - Communicate with our product teams and profile ML/DL workloads to acquire an in-depth understanding of the problems (e.g., slow kernels). - Figure out where the bottleneck of the slow GPU kernels with profilers - Optimize the GPU kernels. - Write tests and benchmarks to validate and evaluate our solutions.

Requirements

• Bachelors or higher degree in Computer Science or Engineering. • Excellent communication skills and the ability to work in a team. • Strong coding skills (in at least one of Python and C++). • Solid fundamentals in other computer science and computer engineering topics: algorithms and data structures, operating systems, computer architecture, etc. • Strong academic records for candidates with bachelor’s degrees. You will stand out from the crowd if you have: • 5+ years of experience in researching or contributing to HPC/ML/DL systems, frameworks or libraries (including the time of being a graduate student). • Experience with GPU architecture and GPGPU programming: NVIDIA GPUs: CUDA programming and libraries and toolkits (e.g., cuDNN, cuBLAS, CUTLASS, nvprof, Nsight Compute, Nsight Systems, etc.); AMD GPUs: ROCm and its related libraries and toolkits. • OpenCL • Experience with developing high-performance kernels for CPUs. • Experience in developing ML or traditional compilers. • Experience with TPU. • Strong publication records in top HPC/ML/DL or computer system and architecture venues.

Benefits

• An open and inclusive culture and work environment • Fully stocked kitchen at the office • Full health and dental benefits • Parental Leave top-up for 6 months • Continuous education budget • Generous vacation - we're not saying unlimited, but if you need extra time to recharge, just ask