Machine Learning Evaluation Engineer (Agentic Mobile App Generator) job opportunity at JetBrains.

Home Jobs In Netherlands Tag: Ignite Machine Learning Evaluation Engineer (Agentic Mobile App Generator) position at JetBrains


bot
JetBrains Machine Learning Evaluation Engineer (Agentic Mobile App Generator)
Experience: General
Pattern: full-time
Country:
apply Apply Now
Salary:
Status:

Ignite

Copy Link Report
degreeGeneral
loacation Amsterdam, ; Belgrade, Serbia; Berlin, Germany; Limassol, Cyprus; Munich, Germany; Paphos, Cyprus; Prague, Czech Republic; Warsaw, Poland; Yerevan, Armenia, Netherlands
loacation Amsterdam, ; B..........Netherlands

Are you passionate about high-quality AI developer tools? We’re looking for a Machine Learning (ML) Evaluation Engineer to join our agentic mobile app generator project. This role focuses on building evaluation pipelines for AI code generation within the Compose Multiplatform ecosystem. About the team and role  Our internal accelerator team is developing AI agents to generate Kotlin Multiplatform apps with fully working navigation, data persistence, and access to remote data sources. As an ML Evaluation Engineer, you will ensure our AI features work correctly and facilitate continuous improvement of the generated apps. If you’re excited about improving the quality of AI-generated code, skilled in building evaluation systems, and interested in new projects, this role is for you. In this role, you will:  Design, build, and maintain evaluation pipelines. Work with AI engineers, mobile experts, and product designers to establish quality standards and test plans. Develop ways to assess the completeness, security, and performance of generated apps. Analyze evaluation results, identify areas to improve code generation, and give feedback to the development team. Develop and run test plans, test cases, and automated tests. Improve our testing methods and QA processes in an agile environment. Join discussions, design reviews, and brainstorming sessions around AI tools. We'd like you to join the team if you:  Have at least three years of QA or evaluation engineering experience in commercial software, with a strong background in testing complex systems. Have experience or interest in building and maintaining evaluation pipelines for AI-assisted development, prompt engineering, or ML-based code generation. Have experience with data analysis tools or ML experiment tracking platforms. Understand software testing methods, including functional, performance, and integration testing. Are proficient in Python, Kotlin, Java, Swift, or similar languages. Work well in distributed, cross-functional teams. Have strong English communication skills and can explain complex ideas clearly. We’ll be especially thrilled if you:  Are always looking for ways to improve developer workflows and productivity. Have experience with low-code and/or no-code platforms or tools. Are familiar with Compose Multiplatform, building KMP libraries or frameworks, or IDE and plugin development. Why work at JetBrains?  Impactful work: Directly influence how future mobile applications are built and tested globally by millions of developers. Innovative culture: Work in an environment that values innovation, creativity, open communication, and respect. Cutting-edge tech: Use new technology stacks with minimal bureaucracy, and focus on developing ideas. Professional growth: Grow as an evaluation engineer through mentorship, teamwork, and learning about AI research and trends. Work-life balance: Enjoy flexible work and a good work-life balance in a developer-focused culture. Want to help shape AI-driven development?  Apply now for JetBrains' new agentic mobile app generator project. Tell us about yourself and why you want to build the next generation of agentic AI. We look forward to hearing from you! #LI-DNIWe process the data provided in your job application in accordance with the Recruitment Privacy Policy.

Other Ai Matches

Team Leader - TeamCity, Build Tools Integration Applicants are expected to have a solid experience in handling TeamCity Build Tools Integrations related tasks
remote-jobserver Remote
Head of Marketing (Kotlin Ecosystem) Applicants are expected to have a solid experience in handling Kotlin Ecosystem related tasks
remote-jobserver Remote
Senior Software Developer (Qodana Core) Applicants are expected to have a solid experience in handling Qodana Core related tasks
remote-jobserver Remote
JetBrains Go Developer Advocate (Developer Advocacy) Applicants are expected to have a solid experience in handling Web and Data Advocacy related tasks
Senior Software Engineer – IntelliJ Ultimate Team Applicants are expected to have a solid experience in handling Ultimate related tasks
remote-jobserver Remote
CRM Architect Salesforce Applicants are expected to have a solid experience in handling Sales & Marketing Automations related tasks
Data Partner (Data Office) Applicants are expected to have a solid experience in handling Data Partners related tasks
remote-jobserver Remote
Senior Creator (Creative Lab) Applicants are expected to have a solid experience in handling Creative Lab related tasks
remote-jobserver Remote
Software Developer (IntelliJ Platform) Applicants are expected to have a solid experience in handling IntelliJ Platform related tasks
Country HR Lead Applicants are expected to have a solid experience in handling Human Resources Munich related tasks
Head of Product, Partner, and Customer PR and Communications Applicants are expected to have a solid experience in handling Public Relations (PR) and Communications related tasks
ML Researcher (JetBrains Research) Applicants are expected to have a solid experience in handling AI Agents & Planning related tasks
remote-jobserver Remote
Data Analyst (JetBrains AI) Applicants are expected to have a solid experience in handling JCP Core Analytics related tasks
Compliance Program Manager Applicants are expected to have a solid experience in handling Compliance related tasks
Enterprise Customer Success Engineer (Post-Sales) - US Applicants are expected to have a solid experience in handling Customer Solutions & Engineering related tasks
Senior Product Manager – DPAI Arena Applicants are expected to have a solid experience in handling IDE related tasks
Software Developer (Station/Toolbox App) Applicants are expected to have a solid experience in handling Toolbox App Infrastructure related tasks
Machine Learning Evaluation Engineer (Agentic Mobile App Generator) Applicants are expected to have a solid experience in handling Ignite related tasks
remote-jobserver Remote
Research Engineer (Agentic Models) Applicants are expected to have a solid experience in handling JCP Core Machine Learning related tasks
Technical Lead (IntelliJ Platform) Applicants are expected to have a solid experience in handling IntelliJ Platform related tasks
Project Manager (Software Engineering Research) Applicants are expected to have a solid experience in handling Software Engineering Research related tasks
remote-jobserver Remote
Senior Backend Engineer (Matter) Applicants are expected to have a solid experience in handling DarkMatter related tasks
SDET Engineer in KED QA Automation team Applicants are expected to have a solid experience in handling Kotlin Automation QA related tasks