Secoda makes the experience of exploring and using data as intuitive, fast, and useful as using Google Search. Secoda stands for searchable company data and our vision is to continue to work towards a tool that makes browsing for data knowledge as easy as finding a website on Google.

We are hiring a Senior Software Engineer to join our Engineering team. In this role, you will take the lead on building and maintaining the metadata ingestion and lineage systems for integrations. You'll collaborate closely with design, product management, and engineering to shape our core platform, improving performance, and influencing our product roadmap. We value your problem-solving skills, technical acumen, and ability to communicate complex ideas. We prioritize your potential, passion for learning, and commitment to best practices that will bring meaningful impact and help shape our platform's future.

Roles and responsibilities

• Build and maintain the services related to data lineage and integrations for our product
• Optimize and troubleshoot existing data infrastructure to ensure reliability and performance
• Work cross functionally with engineers, design, and product
• Design and maintain scalable and efficient data pipelines for processing and analyzing large datasets
• Implement data models and structures to support the organization's data needs.
• Stay up-to-date with industry trends, advancements in data quality tools, and emerging technologies related to data engineering

The ideal candidate should have:

• At least 5 years of industry experience working as a data engineer
• A fundamental understanding of some of the core technologies in our stack
• Experience with big data technologies (e.g., Apache Spark, Hadoop) and data processing frameworks
• Familiarity with database systems, both SQL and NoSQL, and experience with data modeling and database design
• Proficiency in communicating complex technical issues to both technical and non-technical audiences
• Passion for delivering scalable, reliable software

Nice to have

• Building integrations for Modern Data Stack tools, i.e, Snowflake, Looker, dbt
• Building a SQL parser
• Building complex data pipelines

Secoda provides a competitive salary, excellent benefits, and an opportunity to be a part of a growing, dynamic, and innovative environment, employee discounts, wellness programs, and other perks.

At Secoda there are many interesting technical challenges that come when building a collaborative data knowledge base. To give an idea of some of the projects you could be working on, here's an overview of some of the pieces of technology we've built so far.

Secoda's platform is built on top of a PostgresSQL database that makes organizing data resources and finding the between them simple and flexible. We have designed our own SQL parser to automatically find the lineage of data resources in a company's data ecosystem. We have created a SQL editor to run queries against popular data warehouses and built charting capabilities to showcase query results. We've implemented a task engine to schedule and run concurrent extractions from data sources. All of the components in Secoda are organized into a micro-service architecture leveraging Docker containers in AWS.

We've just scratched the tip of the iceberg when it comes to problems that we're solving, so if the idea of working to make data be more accessible and and easy to use excites you, come work at Secoda!