UX Engineer, LLM Experimentation Platform job opportunity at Arize AI.



bot
Arize AI UX Engineer, LLM Experimentation Platform
Experience: General
Pattern: Remote
apply Apply Now
Salary:
Status:

Engineering

Copy Link Report
degreeGeneral
loacation Remote (), United States Of America
loacation Remote ()....United States Of America

About Arize AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence. We’re a Series C company backed by top-tier investors, with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.The Opportunity Most engineering teams treat UX refinement as an afterthought squeezed between feature work. We're carving out a dedicated role for it because we believe the difference between "works" and "delightful" is what separates good products from great ones. You'll have the space to really care about craft. We're a technical team building for technical users (ML engineers, researchers) who are drowning in complexity. Your job is to make that complexity manageable and maybe even enjoyable. We're looking for an engineer who obsesses over the details that make complex tools feel effortless. You'll work on our LLM evaluation and prompt experimentation platform, taking functional features and refining them into intuitive, polished experiences. What You’ll Do Refine and iterate on UX for existing features - you won't build from scratch, but you'll make things significantly better Watch real users struggle in Fullstory, identify friction points, and fix them Prototype interaction alternatives rapidly (in Figma or code) to test different approaches Work closely with our Senior engineers who own feature architecture - they build the foundation, you perfect the interface Own the "feel" of the product: transitions, feedback, error handling, progressive disclosure Build reusable interaction patterns that the team can leverage Run lightweight usability tests to validate improvements A typical week might include: Watching 10 user sessions, identifying 3 common friction points Prototyping 2 different flows for evaluator configuration in Figma Implementing the winner with smooth transitions and helpful inline guidance Pairing with Staff engineers to refactor a complex form into a multi-step wizard Running a quick usability test with 5 users on the new onboarding flow You're a great fit if: You've made products noticeably better through interaction refinement (show us!) You're comfortable with modern frontend frameworks and animation libraries You've used session replay tools and incorporated user feedback into designs You can work in Figma to prototype before committing to code You think about edge cases, loading states, and empty states automatically You've worked on complex tools (dev tools, data tools, B2B SaaS) where UX really matters Bonus: You've built or contributed to design systems What you DON'T need: Formal design training (though it's welcome) Full-stack experience (we have engineers for that) Experience with our specific tech stack (we care more about your UX sensibility) The estimated annual salary for this role is between $175,000 - $200,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness. While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.More About Arize Arize’s mission is to make the world’s AI work—and work for people.Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale. Learn more about what we're doing here: https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/ https://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/ Diversity & Inclusion @ Arize Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI Culturally conscious events such as LGBTQ trivia during pride month We have an active Lady Arizers subgroup

Other Ai Matches

remote-jobserver Remote
AI Product Engineer, New Grad Applicants are expected to have a solid experience in handling Engineering related tasks
remote-jobserver Remote
Open Source Design Engineer Applicants are expected to have a solid experience in handling Engineering related tasks
remote-jobserver Remote
DevOps Support Engineer Applicants are expected to have a solid experience in handling Engineering related tasks
remote-jobserver Remote
Developer Relations Engineer Applicants are expected to have a solid experience in handling Developer Relations related tasks
remote-jobserver Remote
AI Engineer - Instrumentation Applicants are expected to have a solid experience in handling Engineering related tasks
AI Solutions Engineer (Raleigh) Applicants are expected to have a solid experience in handling Solutions Engineering related tasks
remote-jobserver Remote
Field Events Marketing Manager Applicants are expected to have a solid experience in handling Marketing related tasks
remote-jobserver Remote
Developer Relations Engineer Applicants are expected to have a solid experience in handling Developer Relations related tasks
remote-jobserver Remote
Senior AI Product Engineer, Fullstack Applicants are expected to have a solid experience in handling Engineering related tasks
AI Solutions Manager (San Francisco) Applicants are expected to have a solid experience in handling Solutions Engineering related tasks
remote-jobserver Remote
Engineering Manager - Product & Platform Applicants are expected to have a solid experience in handling Engineering related tasks
remote-jobserver Remote
Senior AI Product Engineer, Backend Applicants are expected to have a solid experience in handling Engineering related tasks
remote-jobserver Remote
Developer Relations Engineer (EU) Applicants are expected to have a solid experience in handling Developer Relations related tasks
AI Sales Engineer Applicants are expected to have a solid experience in handling Sales Engineering related tasks
remote-jobserver Remote
Think of me later - Join our Talent Pool! Applicants are expected to have a solid experience in handling Talent Pool related tasks
remote-jobserver Remote
Developer Relations Engineer (EU) Applicants are expected to have a solid experience in handling Developer Relations related tasks
remote-jobserver Remote
Enterprise Account Executive (West) Applicants are expected to have a solid experience in handling Sales related tasks
remote-jobserver Remote
Developer Relations Engineer (EU) Applicants are expected to have a solid experience in handling Developer Relations related tasks
Executive Assistant-Office Manager Applicants are expected to have a solid experience in handling General & Administrative related tasks
remote-jobserver Remote
Senior Frontend Engineer Applicants are expected to have a solid experience in handling Engineering related tasks
remote-jobserver Remote
Enterprise Account Executive (East) Applicants are expected to have a solid experience in handling Sales related tasks
remote-jobserver Remote
UX Engineer, LLM Experimentation Platform Applicants are expected to have a solid experience in handling Engineering related tasks
Compliance Operations Analyst Applicants are expected to have a solid experience in handling Security & IT related tasks