Note: The job is a remote job and is open to candidates in USA. Modular is a company focused on creating advanced machine learning technologies, and they are seeking a Senior AI Graph Compiler Engineer. This role involves extending and developing the graph compiler to enhance performance and usability across various hardware platforms, ensuring a seamless developer experience.
Responsibilities
- Design and develop compiler optimizations to improve inference efficiency across CPUs, GPUs, and ML accelerators, including kernel fusion, memory planning, and shape optimization
- Compile large-scale application workloads onto heterogeneous hardware: map hardware-agnostic graphs of computational operators onto hardware-specific graphs of devices and nodes
- Collaborate with the kernels, serving, and Mojo compiler teams to implement core technologies that deliver end-to-end performance across a variety of heterogeneous hardware platforms
- Write design documents for new features and drive for alignment on designs with cross-functional teams
- Collaborate with the customer success team and engage with customers to understand their performance requirements and use cases
Skills
- 5+ years of software engineering experience
- Proficiency in C++
- Experience working with compilers for machine learning frameworks
- Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others
- Knowledge of and experience working with MLIR and LLVM
- Experience with ML parallel / distributed programming, heterogeneous ML computation, and/or code generation
- Knowledge of basic ML implementation and modeling techniques and familiarity with ML frameworks like PyTorch, JAX, or TensorFlow
Benefits
- Premier insurance plans
- Up to 5% 401k matching
- Flexible paid time off
- Stock options
- Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA as well as different cities. Traveling 2-4 times a year is expected for all roles.
Company Overview
Modular provides AI infrastructure for deployment, serving, and programming GPUs. It was founded in 2022, and is headquartered in Palo Alto, California, USA, with a workforce of 51-200 employees. Its website is https://www.modular.com.Company H1B Sponsorship
Modular has a track record of offering H1B sponsorships, with 3 in 2026, 10 in 2025, 6 in 2024, 8 in 2023, 4 in 2022. Please note that this does not guarantee sponsorship for this specific role.