Software Engineer, Data

August 16

🏡 Remote – New York

Apply Now
Logo of Wpromote

Wpromote

We Turn Challengers Into Champions

Paid Search & Media • Creative Services • SEO • Earned Social • Content Marketing

201 - 500

Description

• Collaborate with senior engineers to design, implement, maintain, and unit test scalable data solutions with a focus on automation using DAG-based orchestration software like Airflow. • Build dbt models, leveraging macros and test-driven development practices. • Provide implementation, configuration, and deployment documentation. • Proactively address issues and problems, suggesting and implementing innovative solutions. • Participate in agile ceremonies and knowledge-sharing activities within the engineering team. • Monitor, troubleshoot, and optimize the performance of data pipelines and workflows. • Ensure data quality and integrity through testing and validation processes. • Stay updated with industry trends and technologies to support continuous improvement and innovation in data engineering practices.

Requirements

• Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent practical experience. • 3-5 years of experience in software development, with significant experience in Python, SQL, and data pipelines. • Experience in building and automating ETL/ELT pipelines using Airflow or other DAG-based orchestration software. • Experience managing dbt models using macros and test-driven development. • Proficiency in Python or comparable back-end, API development, and software architecture. • Experience with databases like PostgreSQL and BigQuery, including query optimization for performance and cost. • Understanding of business intelligence tools like Looker or comparable alternatives. • Familiarity with Google Cloud Platform, Kubernetes, and managing infrastructure as code using Terraform. • Knowledge of advanced data formats (Parquet, Avro, Delta Lake, Hive, JSONL) and data integration techniques. • Understanding of agile methodologies, continuous integration, and test-driven development. • Strong problem-solving skills and a willingness to learn from senior engineers. • Ability to work collaboratively within cross-functional teams and projects. • Familiarity with version control systems and CI/CD tools like GitHub Actions.

Benefits

• Half-day Fridays year round • Unlimited PTO • Extended Holiday break (Winter) • Flexible schedules • Work from anywhere options* • 100% paid parental leave • 401(k) matching • Medical, Dental, Vision, Life, Pet Insurance • Sponsored life insurance • Short Term Disability insurance and additional voluntary insurance • Annual Class Pass Credits and more!

Apply Now
Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or lior@techjobsnewyorkcity.com