Senior Data Engineer

November 15, 2023

Apply Now

Receive Emails with Similar Jobs

Midwestern

WebsiteLinkedInAll Job Openings

Serve each other. Serve our clients. Build Midwestern.

Cloud Software • Mobile Applications • Digital Strategy • Creative Solutions • Staff Augmentation

51 - 200

Description

• Drive daily product development efforts and implement and deliver on executive initiatives • Build data pipelines using Python, PySpark, and other applicable tools • Design and implement complex data solutions on the AWS platform • Lead a data team to ensure data solutions meet business requirements and deliver value • Design, build, and manage ETL pipelines • Implement and manage real-time data streaming and batch processing solutions • Leverage AWS Athena for complex SQL queries over large datasets • Use Python and PySpark for data transformation and cleansing • Ensure data quality and integrity through proper data governance strategies • Collaborate with cross-functional teams • Monitor performance and advise necessary infrastructure changes • Troubleshoot data issues and provide ongoing operational support • Develop technical documentation

Requirements

• T7-10 years of hands-on data engineering experience • 10+ years in AWS data engineering and architecture • Strong programming skills in Python and PySpark • Experience with Rest API integration • Proficiency in SQL and NoSQL databases • Knowledge of data governance and data security best practices • Familiarity with Terraform and other IAC methodologies • Experience with big data organization • Automotive industry experience (preferred) • Knowledge of machine learning (desirable) • Excellent communication and interpersonal skills • Strong organizational and time management abilities • Bachelor's or Master's degree in Computer Science or related field (preferred)

Benefits

• 100% remote work • High-energy and passionate team • Opportunity for contract-to-hire or direct hire • Full-time hours