Staff Data Engineer

2 days ago

🏡 Remote – New York

Apply Now
Logo of BeyondTrust

BeyondTrust

Protect identities, stop threats, and deliver dynamic access to empower and secure a work-from-anywhere world.

Privileged Access Management • Vulnerability Management • Privileged Account Management • Session Monitoring • Privileged Password Mgt

1001 - 5000

💰 Private Equity Round on 2021-05

Description

• Optimize data workloads at a software level by improving processing efficiency. • Independently tackle problem statements and bring solutions to life. • Develop new data processing routes to remove redundancy or reduce transformation overhead. • Monitor and maintain existing data workflows. • Use monitoring and observability best practices to ensure pipeline performance remains high. • Perform complex transformations on both real time and batch data assets. • Create new ML/Engineering solutions to tackle existing issues in the cybersecurity space. • Leverage CI/CD best practices to effectively develop and release source code.

Requirements

• Strong programming and technology knowledge in cloud data processing. • Spark experience is needed, existing Databricks knowledge is a plus. • Interest and aptitude for cybersecurity; interest in identity security is highly preferred. • Technical understanding of underlying systems and computation minutiae. • Experience working with distributed systems and data processing on object stores. • Ability to work autonomously • Required: Data warehousing and Data Lakes for analytics use cases • Required: Highly proficient in Python (or another object orientated language) • Required: Distributed processing framework experience • Highly Preferred: Spark • Highly Preferred: Realtime processing experience. • Ideal: Some experience with graph data stores

Apply Now
Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or lior@techjobsnewyorkcity.com