Note: The job is a remote job and is open to candidates in USA. Dice is seeking a Principal Machine Learning Engineer who will be a deep technical authority responsible for designing and evolving critical ML systems. The role focuses on architecting large-scale ML systems and collaborating with application engineering to integrate these systems into various products.
Responsibilities
- Architect and build large-scale ML systems spanning data, training, evaluation, inference, and deployment
- Design reproducible, high-performance training pipelines across GPU infrastructure
- Architect inference systems that balance latency, throughput, cost, and reliability at scale
- Design and maintain data systems for high-quality synthetic and real-world training data
- Implement evaluation pipelines covering performance, robustness, safety, and bias, in partnership with research leadership
- Own production deployment, including GPU optimization, memory efficiency, latency reduction, and scaling policies
- Collaborate closely with application engineering to integrate ML systems cleanly into backend, mobile, and desktop products
- Make pragmatic trade-offs and ship improvements quickly, learning from real usage
- Work under real production constraints: latency, cost, reliability, and safety
Skills
- Strong background in deep learning and transformer-based architectures
- Hands-on experience training, fine-tuning, or deploying large-scale ML models in production
- Proficiency with at least one modern ML framework (e.g. PyTorch, JAX), and ability to learn others quickly
- Experience with distributed training and inference frameworks (e.g. DeepSpeed, FSDP, Megatron, ZeRO, Ray)
- Strong software engineering fundamentals; you write robust, maintainable, production-grade systems
- Experience with GPU optimization, including memory efficiency, quantization, and mixed precision
- Comfort owning ambiguous, zero-to-one ML systems end-to-end
- A bias toward shipping, learning fast, and improving systems through iteration
- Experience with LLM inference frameworks such as vLLM, TensorRT-LLM, or FasterTransformer
- Contributions to open-source ML or systems libraries
- Background in scientific computing, compilers, or GPU kernels
- Experience with RLHF pipelines (PPO, DPO, ORPO)
- Experience training or deploying multimodal or diffusion models
- Experience with large-scale data processing (Apache Arrow, Spark, Ray)
Benefits
- Medical insurance
- Dental
- Vision
- Savings Plan Options
- PTO
Company Overview
Company H1B Sponsorship