Staff Data Engineer

May 20

🏡 Remote – New York

Apply Now
Logo of Oportun

Oportun

Oportun is an A.I.-powered digital banking platform that seeks to make financial health effortless for anyone.

Financial Services • Responsible Lending • Pre-Paid Debit Cards • Serving the Underbanked • Data Analytics

1001 - 5000

Description

• Lead the design and implementation of scalable, efficient, and robust data architectures to meet business needs and analytical requirements • Collaborate with stakeholders to understand data requirements, build subject matter expertise, and define optimal data models and structures • Design and develop data pipelines, ETL processes, and data integration solutions for ingesting, processing, and transforming large volumes of structured and unstructured data • Optimize data pipelines for performance, reliability, and scalability • Oversee the management and maintenance of databases, data warehouses, and data lakes to ensure high performance, data integrity, and security • Implement and manage ETL processes for efficient data loading and retrieval • Establish and enforce data quality standards, validation rules, and data governance practices to ensure data accuracy, consistency, and compliance with regulations • Provide technical leadership and mentorship to junior team members, assisting in their skill development and growth • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand their data needs and deliver solutions that meet those needs • Communicate effectively with non-technical stakeholders to translate technical concepts into actionable insights and business value • Implement monitoring systems and practices to track data pipeline performance, identify bottlenecks, and optimize for improved efficiency and scalability • You actively contribute to the end-to-end delivery of complex software applications, ensuring adherence to best practices and high overall quality standards • You have a strong understanding of a business or system domain with sufficient knowledge and expertise around the appropriate metrics and trends. You collaborate closely with product managers, designers, and fellow engineers to understand business needs and translate them into effective software solutions • You provide technical leadership and expertise, guiding the team in making sound architectural decisions and solving challenging technical problems. Your solutions anticipate scale, reliability, monitoring, integration, and extensibility • You conduct code reviews and provide constructive feedback to ensure code quality, performance, and maintainability

Requirements

• Bachelor’s degree • 5+ years of experience in data engineering, with a focus on data architecture, ETL, and database management • Proficiency in programming languages like Python/Pyspark and Java /Scala • Expertise in big data technologies such as Hadoop, Spark, Kafka, etc • In-depth knowledge of SQL and experience with various database technologies (e.g., PostgreSQL, MySQL, NoSQL databases) • Experience and expertise in building complex end-to-end data pipelines • Experience with orchestration and designing job schedules using CICD tools like Jenkins and Airflow • Ability to work in an Agile environment (Scrum, Lean, Kanban, etc) • Ability to mentor junior team members • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., AWS Redshift, S3, Azure SQL Data Warehouse) • Strong leadership, problem-solving, and decision-making skills • Excellent communication and collaboration abilities

Benefits

• 11 paid holidays • Generous Accrued Time Off increasing with years of service • Generous paid sick time • Annual day of service

Apply Now
Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or lior@techjobsnewyorkcity.com