ML Model Serving Engineer job opportunity at Sesame.

Home Jobs In United States Of America Tag: Software ML Model Serving Engineer position at Sesame


bot
Sesame ML Model Serving Engineer
Experience: General
Pattern: full-time
Country:
apply Apply Now
Salary:
Status:

Software

Copy Link Report
degreeBachelor's (B.Sc.)
loacation San Francisco, United States Of America
loacation San Francisco....United States Of America

About Sesame Sesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel natural and human. With this vision, we're designing a new kind of computer, focused on making voice agents part of our daily lives. Our team brings together founders from Oculus and Ubiquity6, alongside proven leaders from Meta, Google, and Apple, with deep expertise spanning hardware and software. Join us in shaping a future where computers truly come alive. Responsibilities: Turbocharge our serving layer, consisting of a variety of LLM, speech, and vision models. Partner with ML infrastructure and training engineers to build a fast, cost-effective, accurate, and reliable serving layer to power a new consumer product category. Modify and extend LLM serving frameworks like VLLM and SGLang to take advantage of the latest techniques in high-performance model serving. Work with the training team to identify opportunities to produce faster models without sacrificing quality. Use techniques like in-flight batching, caching, and custom kernels to speed up inference. Find ways to reduce model initialization times without sacrificing quality. Required Qualifications: Expert in some differentiable array computing framework, preferably PyTorch. Expert in optimizing machine learning models for serving reliably at high throughput, with low latency. Significant systems programming experience; ex. Experience working on high-performance server systems—you’d be just as comfortable with the internals of VLLM as you would with a complex PyTorch codebase. Significant performance engineering experience; ex. Bottleneck analysis in high-scale server systems or profiling low-level systems code. Always up to date on the latest techniques for model serving optimization. Preferred Qualifications: Familiarity with high-performance LLM serving; ex. experience with VLLM, SGlang deployment, and internals. Experience with a public cloud platform such as GCP, AWS, or Azure. Experience deploying and scaling inference workloads in the cloud using Kubernetes, Ray, etc. You like to ship and have a track record of leading complex multi-month projects without assistance. You’re excited to learn new things and work in a multitude of roles. Sesame is committed to a workplace where everyone feels valued, respected, and empowered. We welcome all qualified applicants, embracing diversity in race, gender, identity, orientation, ability, and more. We provide reasonable accommodations for applicants with disabilities—contact careers@sesame.com for assistance. Full-time Employee Benefits: 401k matching 100% employer-paid health, vision, and dental benefits Unlimited PTO and sick time Flexible spending account matching (medical FSA) Benefits do not apply to contingent/contract workers.

Other Ai Matches

Mechanical Engineer, Product Design Applicants are expected to have a solid experience in handling Hardware related tasks
ML Model Serving Engineer Applicants are expected to have a solid experience in handling Software related tasks
Office Manager & Executive Assistant (Bellevue, WA) Applicants are expected to have a solid experience in handling Operations related tasks
iOS Engineer Applicants are expected to have a solid experience in handling Software related tasks
Sensing Systems Engineer Applicants are expected to have a solid experience in handling Hardware related tasks
iOS Engineer, Device Integration Applicants are expected to have a solid experience in handling Hardware related tasks
Embedded ML Engineer – Gesture Recognition Applicants are expected to have a solid experience in handling Hardware related tasks
Audio Systems Engineer Applicants are expected to have a solid experience in handling Hardware related tasks
Senior Product Marketing Manager Applicants are expected to have a solid experience in handling Product related tasks
Research Engineer – Synthetic Data for Vision Applicants are expected to have a solid experience in handling Vision related tasks
Android Engineer Applicants are expected to have a solid experience in handling Software related tasks
Embedded OS Architect Applicants are expected to have a solid experience in handling Hardware related tasks
Electrical Engineer Applicants are expected to have a solid experience in handling Hardware related tasks
Audio System TPM Applicants are expected to have a solid experience in handling Hardware related tasks
Research Engineer - Computer Vision ML Applicants are expected to have a solid experience in handling Vision related tasks
Software Engineer, Internal Tools Applicants are expected to have a solid experience in handling Machine Learning related tasks
Backend Infrastructure Engineer Applicants are expected to have a solid experience in handling Software related tasks
Embedded Engineer Applicants are expected to have a solid experience in handling Hardware related tasks
ML Engineer Applicants are expected to have a solid experience in handling Machine Learning related tasks
Social Media Lead Applicants are expected to have a solid experience in handling Product related tasks
Head of Advanced Manufacturing Applicants are expected to have a solid experience in handling Hardware Operations related tasks
Office Manager (NYC) Applicants are expected to have a solid experience in handling Operations related tasks
Audio System TPM Applicants are expected to have a solid experience in handling Hardware related tasks