Principal Data Engineer

Remote · USA Full-time New today

Lead the design, development, and optimization of enterprise-scale data pipelines and architectures to drive data-driven decision-making. Architect efficient data tables and schemas to enhance query performance, ensuring seamless integration with cross-functional teams

Key Responsibilities - Data Pipeline

Design and implement high-performance data pipelines using ETL processes, batch/streaming frameworks (e.g., Apache Spark, Airflow), and cloud platforms (AWS).

Optimize data ingestion, transformation, and storage workflows to meet scalability, reliability, and latency requirements.

Key Responsibilities - Data Architecture & Query Efficiency

Architect database schemas and dimensional models (e.g., star/snowflake) to maximize query performance and reduce latency.

Implement indexing strategies, partitioning, and materialized views to optimize data retrieval.

Key Responsibilities - Collaboration & Governance

Partner with data scientists, product managers, and engineers to align data infrastructure with business needs.

Establish data governance frameworks, ensuring compliance with security, privacy, and quality standards.

Mentor junior engineers and foster best practices in data engineering

Key Responsibilities - Innovation & Leadership

Stay ahead of industry trends (e.g., AI/ML integration, real-time analytics) and advocate for emerging technologies.

Lead technical strategy for data infrastructure, balancing innovation with operational stability.

Technical Expertise

8+ years of experience in data engineering, with a focus on ETL, data modelling, and cloud-based architectures.

Proficiency in SQL, Python, and tools like Spark and Snowflake.

Strong knowledge of database design, dimensional modeling, and query optimization.

Leadership & Collaboration

Proven ability to lead teams, mentor engineers, and drive technical initiatives.

Experience translating business requirements into scalable technical solutions.

Preferred qualifications

Expertise in machine learning model deployment or real-time analytics.

Familiarity with DevOps practices (CI/CD, Docker, Kubernetes).

Our Core Values

Game Changers- A game changer is someone who looks at problems with an open mind and shares new ideas with team members, regularly reassesses existing plans and attaches a realistic timeline to goals, makes profitable, productive, and innovative contributions, and actively pursues improvements to Pattern’s processes and outcomes.

Data Fanatics- A data fanatic is someone who recognizes problems and seeks to understand them through data, draws unbiased conclusions based on data that lead to actionable solutions, and continues to track the effects of the solutions using data.

Partner Obsessed- An individual who is partner obsessed clearly explains the status of projects to partners and relies on constructive feedback, actively listens to partner’s expectations, and delivers results that exceed them, prioritizes the needs of your partners, and takes the time to create a personable experience for those interacting with Pattern.

Team of Doers- Someone who is a part of a team of doers uplifts team members and recognizes their specific contributions, takes initiative to help in any circumstance, actively contributes to supporting improvements, and holds themselves accountable to the team as well as to partners.

Additional Information

Pattern is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Apply to this Job

Apply

Principal Data Engineer

Key Responsibilities - Data Pipeline

Key Responsibilities - Data Architecture & Query Efficiency

Key Responsibilities - Collaboration & Governance

Key Responsibilities - Innovation & Leadership

Technical Expertise

Leadership & Collaboration

Preferred qualifications

Our Core Values

Additional Information

Related roles

Data Engineer

Senior Data and Applied Scientist-Operations

Senior Data and Applied Scientist

Partner Onboarding Manager (EU)

Partner Onboarding Manager (APAC)

Customer Support Specialist

CRM Specialist

Video Senior Editor / Motion Designer

Senior Production Designer

Senior Motion Designer

Looking for Tutors in Deerfield, IL

Software Engineer, Platform - Berlin, Germany

Remote Data Entry Clerk – Flexible Part-Time or Full-Time Opportunity with arenaflex

Seasonal Back Office Representative-Remote (Full Time, Part Time)

Experienced Full-Time Evening and Weekend Writer – Black Culture, Entertainment, and Lifestyle Content Creation

Cargo Agent (Customer Service Agent) - ORD

Experienced Epic Beaker Project Manager Expert - Remote Opportunity for Seasoned Professionals in Healthcare Technology and Project Management

Evening Shift Customer Service Professional- Full Time

Part Time arenaflex Remote Careers (Data Entry) – Driving Long-Term Success in Advertising

Experienced Data Entry Specialist – Remote Online Data Entry Jobs for Students from Home