Helicone is the open-source observability platform for LLM applications. We provide developers with the monitoring, optimization, and reliability tools they need to build production-ready AI systems. From real-time insights and intelligent routing to comprehensive analytics, Helicone gives engineering teams complete visibility into their LLM stack.

We're deeply committed to open source and transparency. With 4k stars and a thriving community, we believe the best developer tools are built in the open. Our platform includes both our core observability suite and our lightweight Rust-based AI Gateway, providing everything teams need to scale their LLM applications reliably.

This is the right time to join us. The LLM ecosystem is rapidly evolving, and in 5 years, there will be unicorns and giants in this space. We're on track to becoming one of them, growing ~20% MoM over the past year. Joining us now means you'll play a pivotal role in shaping the future of AI infrastructure.

Culture at Helicone

Ship mentality: We build efficient, maintainable systems and take ownership from end to end, while prioritizing shipping and speed to get products out to market.

Growth Mindset: We solve complex challenges, learn from peers, and continuously improve.

Adaptability: As a fast-growing startup, we pivot and iterate quickly in dynamic environments.

Perks & Benefits

• Competitive compensation with meaningful equity
• Comprehensive health benefits
• Career development opportunities in the rapidly growing AI infrastructure space
• Team building through hackathons and collaborative environment.

We're looking for someone who's as excited about this space as we are and wants to build something transformative together.

As a Senior Engineer at Helicone.ai, you will take on a leadership role within the engineering team, driving technical excellence and delivering impactful solutions that enhance the LLM developer experience. This role offers the opportunity to shape the future of AI observability while mentoring others and solving complex technical challenges in a fast-paced, collaborative environment.

Key Responsibilities

• Architect and Develop Solutions: Design and implement scalable systems that enhance the performance, reliability, and usability of Helicone’s platform.
• Lead Backend Development:
  • Oversee core services, including:
  • Frontend services (**Node.js**)
  • Proxy worker (**Wrangler/Cloudflare**)
  • Application database (**Supabase**)
  • Analytics database (**ClickHouse**)
• Optimize data pipelines to handle large-scale, real-time observability workloads.
• Mentor and Guide the Team: Provide technical mentorship to junior engineers, fostering a culture of learning and growth.
• Drive Technical Excellence: Advocate for best practices in code quality, testing, and architecture to ensure maintainable and efficient systems.
• Collaborate Across Teams: Work with product managers, designers, and community contributors to develop features, integrations, and documentation.
• Contribute to the Community: Engage with Helicone’s open-source community to gather feedback, improve the platform, and foster innovation.

Required Skills

• Strong TypeScript Expertise: Deep experience working with TypeScript, which constitutes the majority of Helicone's codebase.
• Database Proficiency: Experience with SQL databases and tools like ClickHouse, Supabase, and Postgres.
• Cloud and Deployment: Familiarity with Kubernetes, Cloudflare Workers, Docker, and cloud platforms like AWS or GCP.
• Leadership and Mentorship: Proven ability to guide and mentor engineers, fostering growth and collaboration.
• Problem Solving at Scale: Experience designing systems to handle high-throughput, real-time data processing.
• AI and LLM Knowledge: Familiarity with LLMs, their APIs, and the current AI landscape.
• Adaptability and Ownership: A proactive mindset with the ability to own and deliver on complex projects end-to-end.

Helicone Tech Stack

• Languages: TypeScript, Python
• Frameworks: Next.js, Tailwind CSS, Express, ShadCN
• Hosting: Kubernetes, AWS, GCP, Vercel, Supabase
• Services: Docker, Postgres, ClickHouse, Cloudflare Workers, Redis
• Developer Tools: Unix, CLI, git
• LLMs: OpenAI, Anthropic, Gemini, TogetherAI, and more

Why Join Helicone?

As a Senior Engineer, you’ll play a pivotal role in shaping Helicone’s technical vision and scaling its impact. You’ll be part of a tight-knit, ambitious team in San Francisco, working on cutting-edge technology at the forefront of AI observability.

• Technical Leadership: Your expertise will guide the team, influence architecture decisions, and ensure the platform's success.
• Collaboration and Impact: Work closely with founders, engineers, and the community to drive meaningful improvements.
• Dynamic Culture: Weekly team lunches, monthly hackathons, and an environment where innovation thrives.
• Career Growth: Opportunities to lead, mentor, and work on groundbreaking AI challenges in a high-growth startup.

If you’re excited about solving complex technical problems, mentoring others, and driving the future of AI observability, we’d love to hear from you. Join Helicone and make a lasting impact!

Helicone Tech Stack and Challenges

At Helicone.ai, we combine a cutting-edge tech stack with a focus on solving complex problems in AI observability. Our platform is designed to give developers unparalleled insights into their applications' performance, costs, and behavior, all while being scalable, developer-friendly, and secure.

Tech Stack

Frontend: TypeScript, Next.js, React, Tailwind, ShadCN Backend: Python, Express, Postgres, Clickhouse, Redis Infrastructure: Kubernetes, AWS, GCP, Vercel, Supabase, Cloudflare Workers LLM Support: OpenAI, Anthropic, Gemini, TogetherAI, and more

Challenges We’re Tackling

1. Real-Time Observability at Scale: Processing and querying millions of events through Clickhouse and Redis pipelines.

2. Unified LLM Integrations: Abstractions across OpenAI, Anthropic, and Gemini for easy provider switching.

3. Prompt Management and Experimentation: Version control and experimentation tools to track costs, latency, and accuracy.

4. Data Privacy and Security: With enterprise customers relying on our platform, we maintain SOC 2 and GDPR compliance with rate limiting, access control, and caching.

By joining Helicone, you’ll dive into some of the most exciting challenges in AI observability, from real-time analytics to developer-centric tooling. Our dynamic team is shaping the future of AI performance monitoring, and we’d love for you to be part of it!