Senior Data Engineer
2 days ago
🏡 Remote – New York
Description
• Design, develop, and maintain robust data pipelines to collect, process, and store large volumes of data. • Ensure data quality, integrity, and security across all stages of the data lifecycle. • Implement data ingestion, transformation, and loading (ETL/ELT) processes with Apache Spark and DBT. • Manage and optimize data storage solutions, including data warehouses and databases. • Implement and maintain data governance practices and policies. • Support and enhance existing data processing platforms deployed in AWS EKS. • Ensure compliance with data privacy regulations (e.g., HIPAA). • Work closely with software engineers, product managers, and business analysts to understand data requirements and deliver solutions. • Provide technical guidance and mentorship to junior engineers and data scientists. • Communicate complex technical concepts and results to non-technical stakeholders. • Stay up-to-date with the latest advancements in data engineering and machine learning. • Experiment with new tools and technologies to enhance our data infrastructure and ML capabilities. • Contribute to the development of best practices and standards for data engineering and machine learning.
Requirements
• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field. • 7+ years of production data engineering experience • Strong technical skills in python, SQL, and data modeling • Experience using and tuning data processing frameworks such as Apache Spark, Hadoop, or similar. • Experience with data warehouses, E(LT/TL) tools, and cloud services • Experience with cloud platforms such as AWS, GCP, or Azure. • Strong problem-solving skills and attention to detail. • Strong sense of ownership over your work • Comfortable working at startup pace and focus • Experience in the healthcare or pharmaceutical industry. • Knowledge of healthcare data standards and privacy regulations (e.g., HIPAA). • Familiarity defining and implementing security and data access policies • Experience with big data technologies and distributed computing. • Familiarity with DevOps practices and tools (e.g., Docker, Kubernetes). • Experience with AWS, GCP, Azure cloud development and deployment • Demonstrated experience improving data governance, accuracy, and latency
Benefits
• Medical • Dental • Vision • 401(k) • Group Life • AD&D • Employer paid STD/LTD • Generous PTO • Parental leave
Apply Now
