Confident AI is the leading LLM evaluation platform that helps teams evaluate, test, benchmark, optimize, monitor, and red-team LLM applications. Powered by DeepEval, the go-to LLM evaluation framework with over 600k monthly downloads, 5.3k GitHub stars, and over 40 million evaluations conducted, Confident AI is trusted by hundreds of companies from leading startups to international corporations.

What you’ll be doing:

• Drive the development of Confident AI's user-facing features, working across the full stack with an emphasis on the frontend.
• Design, build, and maintain both frontend and backend services to deliver a seamless user experience.
• Collaborate closely with the founders to design and implement new features from concept to production.
• Work on reliability and scalability of the platform.

You should be able to:

• Strong proficiency in frontend development using React, TypeScript, and modern JavaScript.
• Experience building and maintaining backend services using Node.js and Python.
• Solid understanding of PostgreSQL and database design for scalable applications.
• Experience with WebSockets for real-time applications.
• Ability to write clearly and an avid reader, able to write documentation and blog articles for the open-source community.
• Willingness to work 6 days a week in a high-impact startup environment.

Your work will:

• Work closely with the founders to translate product vision into technical reality.
• Ensure the reliability and scalability of our platform through robust engineering practices.
• Write clean, well-tested code and conduct thorough testing to maintain high-quality standards.
• Actively listen to customer and community feedback to guide product development and improvements.

By joining us, you will:

• Be shaping the future of LLM testing and evaluation.
• Learn how to run and do startups, in a relatively safe environment.
• Be compensated highly, with generous founding equity. This also means that we expect a lot from you.
• Compensation will increase with the growth of the company.

Confident AI is building an open-source LLM evaluation framework called DeepEval to help companies evaluate their LLM applications. While we provide the algorithms, companies are free to use their own LLMs for evaluation and our job is to make sure they get accurate evaluation results and a good user experience while using our framework.

Confident AI's commercial product brings DeepEval to the cloud. While DeepEval is great, it can only do so much as a testing framework that runs locally in notebooks or CI/CD pipelines. With Confident AI, companies can get instant access to benchmark and LLM testing reports, catch regressions at scale, and monitor LLM applications in production.