Staff Data Engineer - Special Projects
April 10
🏡 Remote – New York
Description
• As a Staff Data Engineer at Northbeam, you will work with a cross functional team of engineers, product managers, and business leaders to build, maintain, and scale the data pipelines which power our product offering. • Marketing attribution for the direct-to-consumer (DTC) space involves creating, maintaining and improving a labyrinth of transformations in a complex network of touchpoints to keep everything running smoothly. The system is powered by data that spans various ad platforms, a variety of order management systems (such as Shopify and Amazon), as well as our own real-time events that we collect as our customer’s customers navigate their online stores. • Curiosity, experience, and a desire to solve customer problems will be the key to success in this role. • A Staff Data Engineer at Northbeam has the opportunity both to provide direction for, and to execute on, a large product surface area. Some of your potential responsibilities: • Partner with product managers, engineers, leadership to build products to solve high-value customer problems. • Expand the functionality of the large-scale number crunching systems which power the core of our marketing attribution algorithms by integrating with various data sources. • Build creative solutions to handle data coming from many sources (S3, SFTP, email, and more) of many different types (Parquet, JSON, CSV, Thrift) in an extensible and sustainable manner. • Design, implement, document, and scale customer-facing APIs, enabling customers to connect their data to Northbeam faster, decreasing the time to onboard. • Design, develop and maintain the data models and transformations that will enable us to accelerate product development on our core ecommerce analytics product. • Establish best practices, frameworks, and repeatable processes that enable us to measure the impact of changes to our complex systems. • Mentor younger members of the engineering team, promoting organizational growth while maintaining a high bar for excellence and technical curiosity.
Requirements
• Expert in Python, SQL, and Linux / UNIX terminals • Six to eight years of experience, thrives in a startup stage • Solid understanding of the applications for: • Database engines – both traditional OLTP and distributed OLAP systems • Cloud infrastructure primitives – object stores, message queues, compute • Observability tools – logging, metric stores, application performance and error monitoring • Experience with building orchestrated batch data processing pipelines, in particular for large-scale (> 1TB) analytics • Enthusiasm for collaborating with both technical and non-technical stakeholders • Good to have: • Prior experience in marketing, ecommerce, ad-tech, or enterprise SaaS. • Experience with real-time data processing pipelines. • Experience working with external APIs – in particular, building resiliency and observability in the face of API outages, rate limits, and customer faults. • Experience with parts of our tech stack – BigQuery (and open source alternatives), Airflow, dbt, Apache Beam.
Benefits
• Equity package • Generous base salary • Healthcare Benefits (medical, dental, vision) • Travel to meet with the team • Flexible PTO Policy • 12 Company Paid Holidays
Apply Now