Automated QA Engineer at Phonely (S24)
$130K - $190K  •  0.20% - 0.45%
AI call centers
San Francisco, CA, US
Full-time
US citizen/visa only
Any (new grads ok)
About Phonely

About Phonely

There are billions of calls made every day which will soon be handled by AI. Today 70% of business customer support calls are outsourced to call centers and contact centers. These call centers are looking for a solution that they can build simulate, and deploy voice agents all in one platform. We are building this.

Through YC we grew at 22% week over week and went through demo day with the some of the top revenue in the batch. We already work with the largest contact centers in the world and are looking for people that want to build the future of AI phone support together.

About the role

Automated QA Engineer

About this role

At some point in the future, every business will answer their phone with voice AI. We are making sure that when they build that AI agent, the experience of doing so doesn’t suck.

We’re growing incredibly fast and need someone who thrives in a dynamic, high-pressure environment to work side-by-side with the our engineering and leadership team. To win in the AI space, we need to ship incredibly fast. When you’re dealing with LLM systems, realtime voice infrastructure pipelines and telephonly there are sooo many things that can go wrong.

Your job is to write tests, monitoring, and evaluating the health of our platform. You’ll be tasked on everything from figuring out how to set up monitoring telephony infrastructure, to LLM’s to building analytics on latency and other core systems.

This may be one of the most important roles in the company and is critical in helping us move faster, stay organized, and execute at the highest level.

We’re looking for someone who is highly organized, driven, and fun to work with. You’ll be working directly with our engineers, customers, and product team.

NOTE: You will be thinking of problems for the first time, writing a lot of code, and you’ll be directly responsible for keeping our platform online. If you’re looking for a cushy corporate job where nothing get done, I recommend checking out some of our competitors. If you’re looking to be a part of a winning team and to make a real difference read on.

What you will do

  • Design, write, and maintain automated tests across APIs, services, and telephony infrastructure
  • Build and manage monitoring, alerting, and health checks for production systems
  • Manage incidents, uptime metrics and reliability dashboards
  • Investigate failures, and production incidents
  • Work with engineers to reproduce issues and prevent regressions
  • Work through our QA processes for releases, rollouts, and hotfixes
  • Continuously improve test coverage and signal quality

What we are looking for

  • 2-3 years of experience experience in backend SWE, QA engineer or SDET with a strong testing focus
  • 1+ year experience using Datadog
  • Strong experience writing automated tests (API, integration, end to end)
  • Familiarity with monitoring and observability tools (logs, metrics, alerts)
  • Comfort working with CI/CD pipelines
  • Ability to think in terms of failure modes and edge cases, and prioritize accordingly
  • Clear communicator who can work cross functionally

Nice to have

  • Experience with high availability or real time systems
  • Experience testing distributed systems or production APIs
  • Experience with LLM and eval platforms
  • Background in uptime, reliability, or site reliability engineering
  • Experience in fast moving startup environments/ former founders
  • Former athlete/ competitor in some fashion

Why Join Phonely?

We’re super cool. Our team is a group of ex-athletes, founders, and builders with low egos, and a high belief that life not about taking the easy road, but challenging ourselves to find the most we can be. Working at Phoenly feels like family, we eat most meals together as a team (the company pays for food) we go on runs, hikes and surf together when we’re not working. Also we rent out Airbnb’s in cool places (Rocky mountains, Costa Rica, Indonesia) four times a year so you can still see the world while on the grind.

From a product and direction standpoint, we are customer obsessed and focused on building a product that we ourselves would love to use. We are solving voice AI problems, that have never been solved before with a mission to build something that 1M+ businesses love. If you made it to this part of the JD, please message me (Will) with an item from your bucket list and something impressive you’ve done.

Working at Phonely, you’ll have the flexibility to contribute to all aspects of the business. It will be hard, but it will be rewarding. We are extremely picky with who we bring on as full time employees. While resume’s and experience are important, the MOST important thing is that we believe in you, like you and are inspired to work around you. If we do, we will bend over backwards to make sure that the hard work you put in here will return dividends later.

We look forward to you applying!

About the interview

  1. a 10 minute chat with me the CEO!
  2. a more in depth interview
  3. (if possible) a working trial of 2-7 days

Please reach out if this seems interesting to you!

Technology

To achieve human-level performance with voice AI agents, we need 99.9% reliability across all verticals. Building a high-performing Voice AI solution requires a combination of key elements:

  1. Voice AI Infrastructure: Develop robust systems that can handle real-time conversations seamlessly.
  2. API Integrations: Connect with relevant software to ensure smooth interactions.
  3. LLM Testing, Simulation, and Evaluation: Validate models under various conditions to ensure accuracy.
  4. Performance Monitoring: Continuously track metrics to optimize system performance.
  5. Countless Other Tasks: From scaling infrastructure to managing edge cases, achieving this level of reliability is no small feat.

We’ve brought all of these elements together in one place so enterprises can integrate reliable and accurate voice AI into their offerings in minutes, not months.

Other jobs at Phonely

fulltimeSan Francisco, CA, USFull stack$130K - $190K0.20% - 0.45%Any (new grads ok)

fulltimeSan Francisco, CA, USFull stack$130K - $190K0.20% - 0.45%Any (new grads ok)

Hundreds of YC startups are hiring on Work at a Startup.

Sign up to see more ›