Helicone is the open-source observability platform for LLM applications. We provide developers with the monitoring, optimization, and reliability tools they need to build production-ready AI systems. From real-time insights and intelligent routing to comprehensive analytics, Helicone gives engineering teams complete visibility into their LLM stack.

We're deeply committed to open source and transparency. With 4k stars and a thriving community, we believe the best developer tools are built in the open. Our platform includes both our core observability suite and our lightweight Rust-based AI Gateway, providing everything teams need to scale their LLM applications reliably.

This is the right time to join us. The LLM ecosystem is rapidly evolving, and in 5 years, there will be unicorns and giants in this space. We're on track to becoming one of them, growing ~20% MoM over the past year. Joining us now means you'll play a pivotal role in shaping the future of AI infrastructure.

Culture at Helicone

Ship mentality: We build efficient, maintainable systems and take ownership from end to end, while prioritizing shipping and speed to get products out to market.

Growth Mindset: We solve complex challenges, learn from peers, and continuously improve.

Adaptability: As a fast-growing startup, we pivot and iterate quickly in dynamic environments.

Perks & Benefits

• Competitive compensation with meaningful equity
• Comprehensive health benefits
• Career development opportunities in the rapidly growing AI infrastructure space
• Team building through hackathons and collaborative environment.

We're looking for someone who's as excited about this space as we are and wants to build something transformative together.

Are you a skilled engineer looking to level up and make a substantial impact in AI observability? Helicone.ai is seeking a technically proficient, highly driven software engineer to join our team. We’re an agile startup developing a platform for LLM observability, helping developers gain insights, optimize performance, and streamline workflows in AI applications.

What We’re Looking For:

This role requires a mid-level software engineer who’s a problem-solver at heart and passionate about building scalable, resilient systems. You'll be working closely with our engineering team to shape the future of LLM observability.

Key Responsibilities:

• Design, build, and optimize microservices, ensuring they’re maintainable, scalable, and aligned with our architectural standards.
• Collaborate on developing new features in TypeScript, Node.js, and Python, optimizing for both performance and readability.
• Build and maintain integrations with LLM providers like OpenAI, Anthropic, and LangChain, enabling seamless data tracking and analytics.
• Work with Next.js to develop our frontend components, enhancing usability and performance for complex observability metrics.
• Contribute to data processing workflows using tools like Clickhouse, Kafka, or similar distributed data systems.

Ideal Candidate Profile:

• 3-5 years of experience in software engineering, with a deep understanding of backend services and a solid grasp of frontend fundamentals.
• Proficiency in TypeScript and Node.js, with experience building RESTful APIs.
• Strong foundation in distributed system design, with knowledge of data processing at scale.
• Familiarity with Next.js or similar React frameworks.
• Experience with observability tools and methodologies, such as monitoring, tracing, and logging.
• Working knowledge of Docker, Helm, or other container orchestration tools.
• You prioritize code quality and performance optimization in everything you build.

Why Helicone?

• Impact: Join a small, focused team where your contributions directly influence the product’s direction and success.
• Growth: You’ll work with and learn from highly skilled engineers and have opportunities for mentorship and technical ownership.
• Technology Stack: Our stack includes TypeScript, Node.js, Next.js, Clickhouse, Supabase, and Kubernetes, with integrations across leading LLM SDKs and frameworks.
• Competitive Benefits: We offer a compelling package, flexible work hours, and remote work options.

Helicone Tech Stack and Challenges

At Helicone.ai, we combine a cutting-edge tech stack with a focus on solving complex problems in AI observability. Our platform is designed to give developers unparalleled insights into their applications' performance, costs, and behavior, all while being scalable, developer-friendly, and secure.

Tech Stack

Frontend: TypeScript, Next.js, React, Tailwind, ShadCN Backend: Python, Express, Postgres, Clickhouse, Redis Infrastructure: Kubernetes, AWS, GCP, Vercel, Supabase, Cloudflare Workers LLM Support: OpenAI, Anthropic, Gemini, TogetherAI, and more

Challenges We’re Tackling

1. Real-Time Observability at Scale: Processing and querying millions of events through Clickhouse and Redis pipelines.

2. Unified LLM Integrations: Abstractions across OpenAI, Anthropic, and Gemini for easy provider switching.

3. Prompt Management and Experimentation: Version control and experimentation tools to track costs, latency, and accuracy.

4. Data Privacy and Security: With enterprise customers relying on our platform, we maintain SOC 2 and GDPR compliance with rate limiting, access control, and caching.

By joining Helicone, you’ll dive into some of the most exciting challenges in AI observability, from real-time analytics to developer-centric tooling. Our dynamic team is shaping the future of AI performance monitoring, and we’d love for you to be part of it!