LLM Training Frameworks and Optimization Engineer job opportunity at Together AI.

Home Jobs In United States Of America Tag: Engineering LLM Training Frameworks and Optimization Engineer position at Together AI


bot
Together AI LLM Training Frameworks and Optimization Engineer
Experience: 5-years
Pattern: full-time
Country:
apply Apply Now
Salary:
Status:

Engineering

Copy Link Report
degreeVocational
loacation San Francisco, United States Of America
loacation San Francisco....United States Of America

Optimize communication patterns (e.g., gradient synchronization, all-reduce) in distributed training. Implement techniques like mixed precision, tensor parallelism, pipeline parallelism, and sharded training. __ Conduct in-depth profiling and debugging of training jobs to identify and resolve bottlenecks. Collaborate with #hardware teams to optimize performance for #GPUs, TPUs, and other accelerators. __ Ensure training #systems scale efficiently to thousands of nodes and petabytes of #data. #Develop resilience mechanisms for fault-tolerant and checkpointed training pipelines. __ Work closely with researchers, data #engineers, and platform teams to ensure training frameworks meet model and workload requirements. Provide guidance and tools to improve the overall efficiency of the LLM development lifecycle.

Other Ai Matches

Senior Systems Administrator Applicants are expected to have a solid experience in handling System Administrator related tasks
Senior Network Operations Engineer Applicants are expected to have a solid experience in handling Engineering related tasks
LLM Training Dataset and Checkpoint Optimization Engineer Applicants are expected to have a solid experience in handling Engineering related tasks
Research Scientist, Post-Training Applicants are expected to have a solid experience in handling Research related tasks
Product Marketing Director Applicants are expected to have a solid experience in handling Marketing Director related tasks
AI Researcher, Core ML Applicants are expected to have a solid experience in handling AI Researcher related tasks
Machine Learning Operations Lead Applicants are expected to have a solid experience in handling Machine Learning related tasks
Solutions Architec Applicants are expected to have a solid experience in handling Solutions Architect related tasks
GPU Cluster Resource Scheduling and Optimization Engineer Applicants are expected to have a solid experience in handling Engineering related tasks
Lead DX Engineer - Documentation (SF / NYC) Applicants are expected to have a solid experience in handling Production related tasks
Staff Brand Marketing Manager Applicants are expected to have a solid experience in handling Brand Manager related tasks
Senior Developer Productivity Engineer Applicants are expected to have a solid experience in handling Productivity Engineer related tasks
Senior Software Engineer, Observability Applicants are expected to have a solid experience in handling Software Engineer related tasks
Revenue Accounting Manager Applicants are expected to have a solid experience in handling Finance related tasks
LLM Training Resilience Engineer Applicants are expected to have a solid experience in handling Engineering related tasks
Senior Data Engineer Applicants are expected to have a solid experience in handling Data Engineering related tasks
Research Scientist, Large-Scale Learning Applicants are expected to have a solid experience in handling Research Scientist related tasks
Account Executive Europe (Net New Logo) Applicants are expected to have a solid experience in handling Sales related tasks
Customer Support Engineer, India Applicants are expected to have a solid experience in handling Support Engineer related tasks
Staff Brand and Content Marketing Manager Applicants are expected to have a solid experience in handling Content marketing related tasks
Customer Support Engineer, India Applicants are expected to have a solid experience in handling Customer service related tasks
Staff Partner Marketing Manager Applicants are expected to have a solid experience in handling Marketing Manager related tasks
Staff Product Manager, Infrastructure as a Service Applicants are expected to have a solid experience in handling Product Manager related tasks