Staff Engineer - Apache Flink Expert at Promoted.ai (W21)
$200K - $240K  •  0.30%
Marketplace Optimization
San Francisco, CA, US / Remote
Full-time
6+ years
About Promoted.ai

Promoted dramatically improves search and discovery relevance and ads quality at scale, like at our customers Upwork, Eventbrite, and Outschool. We combine the best of traditional ML and streaming data infra with the latest in LLM AI to optimize the balance between relevance, revenue, and profitability. We're ex-Google, Meta, and Pinterest ads engineers, and we've built this before together.

When you join Promoted, you’ll get the benefits of:

  • San Francisco Office - Our office space is open and available
  • Healthcare Plans - We have options for you and your family
  • FSA/HSA - You can opt into these savings plans
  • Dependant Care Account - For eligible care savings
  • 401k - We offer it and match your first 6%
  • PerkSpot Account - Trusted employee discounts
  • Competitive and transparent compensation

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, mental or physical disability, gender identity or Veteran status.

About the role

Data Stream Processing Software Engineer

Ship innovations in streaming data processing at publicly traded company data scales but at startup scale shipping velocities! If you love Flink, then this role is the perfect fit for you.

Responsibilities

  • Leverage Apache Flink to develop robust and efficient stream processing jobs and tackle challenges related to data skew, out-of-order events, and other intricacies of streaming data. Must be an expert with Apache Flink.
  • Architect and implement near real-time ingestion pipelines for data lakes.
  • Maintain and optimize the data infrastructure for streaming systems.
  • Collaborate closely with cross-functional team members to ensure seamless data processing.

Requirements

  • Enthusiasm for working in a startup environment with a small, dedicated team.
  • Proficiency in at least one programming language, such as Java, Scala, Kotlin, or Python.
  • Hands-on experience with big data systems such as Apache Spark, Apache Flink, and Apache Kafka.
  • Knowledge of common data storage formats such as Avro, Proto, and Parquet.
  • Experience with at least one cloud platform, such as AWS or GCP.
  • Familiarity with Kubernetes and experience with tools such as Helm, Prometheus, and Grafana.

Preferred Qualifications

  • Familiarity with data analytics tools such as Apache Hive, ClickHouse, Presto, Trino, or AWS Redshift.
  • Experience data lake formats such as Apache Iceberg, Hudi, and Paimon.
  • Experience with DevOps practices, IoC, and Terraform.
  • Background in Machine Learning or Recommendation Systems.

Other jobs at Promoted.ai

fulltimeSan Francisco, CA, US / RemoteBackend$200K - $240K0.30%6+ years

Hundreds of YC startups are hiring on Work at a Startup.

Sign up to see more ›