Senior Product Manager – DPAI Arena job opportunity at JetBrains.

Home Jobs In Netherlands Tag: IDE Senior Product Manager – DPAI Arena position at JetBrains


bot
JetBrains Senior Product Manager – DPAI Arena
Experience: General
Pattern: full-time
Country:
apply Apply Now
Salary:
Status:

IDE

Copy Link Report
degreeGeneral
loacation Amsterdam, ; Belgrade, Serbia; Berlin, Germany; Limassol, Cyprus; Madrid, Spain; Munich, Germany; Paphos, Cyprus; Prague, Czech Republic; Tel Aviv, Israel; Warsaw, Poland; Yerevan, Armenia, Netherlands
loacation Amsterdam, ; B..........Netherlands

About usAt JetBrains, code is our passion. Ever since we started, we have strived to make the strongest, most effective developer tools on earth. By automating routine checks and corrections, our tools speed up production, freeing developers to grow, discover, and create. We believe in building tools developers love – and we see the next frontier in AI-powered developer tools. The DPAI Arena project aims to define and maintain an open, community-driven benchmark for evaluating AI agents and IDE-embedded AI features at scale. We believe that the benchmark industry is only in its early stages, and we’re planning to take part in the evolution of the field.  We’re looking for a Senior Product Manager to own the direction of DPAI Arena and help define what “good evaluation” looks like and how we measure it.  What you’ll do Refine our answer to the question of what makes an evaluation task a representative data point for software engineers and IDE AI features, using usage data, feedback loops, and community input. Define and iterate the evaluation methodology, designing tasks, specifying metrics and success criteria, and covering real developer workflows from both product and UX perspectives. Build and maintain relationships with external vendors, platform partners, outsourcing providers, and internal stakeholders to expand participation in DPAI Arena and drive both business and ecosystem development. Curate and manage datasets, coordinating contributions from JetBrains teams, external partners, and outsourcing vendors (including crowdsourced workers when needed) to keep evaluation tasks high-quality, representative, and diverse. Own the evaluation standard and roadmap, representing DPAI Arena internally and externally while aligning plans with the broader JetBrains AI and IDE strategy. What we expect from you Proven experience in product management (developer tools or data-driven products is a plus). Experience working on GenAI features for developer tooling. Strong analytical skills, with the ability to define meaningful metrics, interpret results, and turn them into product design. Experience working with multiple stakeholders: internal teams, external partners, and vendors (including outsourcing providers). Understanding of developer workflows, IDEs, and AI-assisted development, and the ability to translate real-world coding tasks into evaluation workloads. Strong communication skills, both written and spoken. Ownership mindset and proactive approach. Engineering background (particularly SWE or QA for tech products). Bonus points Experience maintaining or curating open-source products. ML experience.  Familiarity with outsourcing or crowdsourcing platforms, data collection pipelines, or community-driven ecosystems. #LI-HYBRID  #LI-AA1We process the data provided in your job application in accordance with the Recruitment Privacy Policy.

Other Ai Matches

remote-jobserver Remote
FullStack ML Developer Applicants are expected to have a solid experience in handling Junie related tasks
Head of Corporate Security Applicants are expected to have a solid experience in handling Security related tasks
Entrepreneur in Residence / Product Lead (Project Ignite) Applicants are expected to have a solid experience in handling Ignite related tasks
remote-jobserver Remote
ML Solutions Architect (Data Agents) Applicants are expected to have a solid experience in handling Data Context Engine related tasks
remote-jobserver Remote
Senior Technical Product Manager (Kotlin Ecosystem - AI Value Stream) Applicants are expected to have a solid experience in handling Kotlin Ecosystem related tasks
Staff Product Manager (High Performance Data Infrastructure) Applicants are expected to have a solid experience in handling JetBrains Cloud Platform related tasks
Enterprise Customer Success Engineer (Post-Sales) - US Applicants are expected to have a solid experience in handling Customer Solutions & Engineering related tasks
remote-jobserver Remote
YouTrack Internal Automation Engineer Applicants are expected to have a solid experience in handling YouTrack - Internal Development related tasks
remote-jobserver Remote
Research Engineer - JetBrains AI Applicants are expected to have a solid experience in handling JCP Core Machine Learning related tasks
Finance Systems Analyst and Support Applicants are expected to have a solid experience in handling Financial Support and Analysis related tasks
Head of Crisis Communications Applicants are expected to have a solid experience in handling Public Relations (PR) and Communications related tasks
Senior Software Developer (IntelliJ AI) Applicants are expected to have a solid experience in handling IntelliJ AI related tasks
remote-jobserver Remote
Senior Product Designer (TeamCity) Applicants are expected to have a solid experience in handling TeamCity Discovery related tasks
HR Manager Applicants are expected to have a solid experience in handling Human Resources Armenia related tasks
remote-jobserver Remote
Senior Backend Engineer (Matter) Applicants are expected to have a solid experience in handling DarkMatter related tasks
remote-jobserver Remote
Research Engineer (Agentic Models) Applicants are expected to have a solid experience in handling JCP Core Machine Learning related tasks
Machine Learning Evaluation Engineer (Agentic Mobile App Generator) Applicants are expected to have a solid experience in handling Ignite related tasks
remote-jobserver Remote
Senior Software Developer - Kotlin Native Applicants are expected to have a solid experience in handling Kotlin Native related tasks
Construction Procurement Specialist Applicants are expected to have a solid experience in handling Global Workplace Department related tasks
remote-jobserver Remote
Head of Marketing (Kotlin Ecosystem) Applicants are expected to have a solid experience in handling Kotlin Ecosystem related tasks
remote-jobserver Remote
JetBrains Go Developer Advocate (Developer Advocacy) Applicants are expected to have a solid experience in handling Web and Data Advocacy related tasks
remote-jobserver Remote
Senior Creator (Creative Lab) Applicants are expected to have a solid experience in handling Creative Lab related tasks
HR Specialist Applicants are expected to have a solid experience in handling Human Resources Netherlands related tasks