Confident AI is the leading LLM evaluation platform that helps teams evaluate, test, benchmark, optimize, monitor, and red-team LLM applications. Powered by DeepEval, the go-to LLM evaluation framework with over 600k monthly downloads, 5.3k GitHub stars, and over 40 million evaluations conducted, Confident AI is trusted by hundreds of companies from leading startups to international corporations.

What you’ll be doing:

• Lead the design and development of Confident AI's core backend infrastructure, ensuring scalability and reliability.
• Architect and implement robust, scalable systems for our cloud platform and manage on-premise deployments for enterprise clients.
• Own critical backend services from development through to deployment and maintenance.
• Collaborate with the frontend team to build and deliver new features.

You should be able to:

• Expertise in designing, building, and scaling backend systems using Python and Node.js/TypeScript.
• Deep knowledge of relational databases, particularly PostgreSQL, including performance tuning and scaling.
• Experience building reliable, low-latency distributed systems.
• Extensive experience with containerization (Docker) and orchestration (Kubernetes, AWS EKS).
• Proven experience with major cloud providers (AWS, GCP, Azure) and deploying applications on-premise.
• Experience with multi-tenant architecture and authentication systems.
• Strong understanding of data security best practices (e.g., for SOC 2, HIPAA compliance).
• Willingness to work 6 days a week in a high-impact startup environment.

Your work will:

• Collaborate closely with the founders to define and execute the infrastructure roadmap.
• Take ownership of the platform's reliability, scalability, and performance, implementing robust monitoring and alerting.
• Write high-quality, thoroughly tested code to ensure the stability of our core systems.
• Engage with enterprise customers to understand their infrastructure needs and support on-premise deployments.

By joining us, you will:

• Bring LLM testing and evaluation to the largest companies available.
• Learn how to serve enterprise customers as a startup, in a relatively safe environment.
• Be compensated highly, with generous founding equity. This also means that we expect a lot from you.
• Compensation will increase with the growth of the company.

Confident AI is building an open-source LLM evaluation framework called DeepEval to help companies evaluate their LLM applications. While we provide the algorithms, companies are free to use their own LLMs for evaluation and our job is to make sure they get accurate evaluation results and a good user experience while using our framework.

Confident AI's commercial product brings DeepEval to the cloud. While DeepEval is great, it can only do so much as a testing framework that runs locally in notebooks or CI/CD pipelines. With Confident AI, companies can get instant access to benchmark and LLM testing reports, catch regressions at scale, and monitor LLM applications in production.