Senior Staff Software Engineer, Streaming
April 12
🏡 Remote – New York
Description
• We are looking for a highly motivated Senior Staff Software Engineer to play a pivotal role in realizing Voltron Data’s streaming data vision within the composable data ecosystem. As a key member of the team, you will be entrusted with making strategic architecture decisions, evaluating technical feasibility for proof of concepts, crafting meticulous component designs, and driving executions to completion. You will collaborate alongside highly competent product engineering experts. You will also have the opportunity to work across open-source stacks (e.g., Ibis, Arrow, Substrait). • Your contributions will directly impact the advancement of our unified data processing capabilities, driving innovation and setting new benchmarks within the industry. Join us in shaping the future of data analytics. • Below is a rough timeline of where you can expect to be at different points during your career path starting in this position. • Upon joining: - Spending time learning about the Ibis and Apache Arrow, the open-source software we support as critical building blocks in the composable data ecosystem. - Getting exposed to accelerated computing concepts such as GPUs and DPUs. - Learning and embracing the software development culture at Voltron Data. • Within a month: - Engage actively in building a proof of concept, collaborating with peers to assess its engineering feasibility against our business objectives. - Work closely with open-source tools such as Ibis, Arrow, Kafka, DuckDb, Flink, and RAPIDS/cuDF in a GPU-accelerated environment. - Analyze and interpret results meticulously to inform various distributed system design tradeoffs. - Contribute to bug fixing efforts and propose areas for improvement in conjunction with the team. • Within 6 months: - Iterate and evolve the proof of concept into a more crafted offering, leveraging feedback and insights gained along the way. - Foster cross-organizational and cross-functional collaboration with co-design partners to turn the PoC into an offering deployable at an internet scale. - Demonstrate unwavering commitment to engineering excellence, setting high standards for execution quality and velocity. - Ship an MVP use case. • Within 12 months: - Mature the technology to be ready for broader adoption. - Establish an efficient engineering process for fast iteration with high engineering qualities. - Become one of the company's streaming go-to experts and strategic technical advisors. • Previous experience that could be helpful (not all required): - You have built large-scale distributed systems that can handle throughput greater than 10-100GB/s. - You have worked with batch processing and stream processing systems. You are opinionated about data platform evolution and a strong thought leader. - You have good intuitions about distributed system challenges and failure characteristics. - You have experience running capacity planning and estimations in cloud-native or on-premise data centers. - You love building at a scale that most companies don’t even imagine. - You have experience with hardware like GPUs, DPUs, FPGAs, and associated software.
Requirements
• You have built large-scale distributed systems that can handle throughput greater than 10-100GB/s. • You have worked with batch processing and stream processing systems. You are opinionated about data platform evolution and a strong thought leader. • You have good intuitions about distributed system challenges and failure characteristics. • You have experience running capacity planning and estimations in cloud-native or on-premise data centers. • You love building at a scale that most companies don’t even imagine. • You have experience with hardware like GPUs, DPUs, FPGAs, and associated software.
Benefits
• Work from Anywhere - Payroll and Benefits in 150+ Countries • Unlimited PTO • Medical, Dental, and Vision • Retirement [USA Only] • Home Office Budget • Continuing Education Budget
Apply Now
