Senior Data Engineer – Machine Learning Pipeline Development | US Federal Division at arenaflex
Join arenaflex: Shape the Future of Data Engineering Are you ready to be part of a transformative journey where data science meets innovation? At arenaflex, we are pioneering the future of big data analytics, helping businesses answer their most critical questions through cutting-edge research design and advanced data processing capabilities. Our mission is to develop new ways to extract meaningful value from massive data volumes while shaping innovative processes, tools, and models that drive real business impact. As a Senior Data Engineer at arenaflex, you will join a dynamic, growing team dedicated to supporting the US Federal Sales Division. This is your opportunity to bring your industry expertise to develop and maintain production data pipelines that power machine learning models at scale. If you're passionate about data engineering, thrive in collaborative environments, and want to make a meaningful impact, we invite you to explore this exciting opportunity. About arenaflex At arenaflex, we believe that each of us has the power to make an impact. That's why we put our team members at the center of everything we do. We are a unique family of companies that help people and organizations transform the way they work, live, and play. Our commitment to innovation, diversity, and inclusion sets us apart, fostering an environment where every voice matters and every contribution is valued. We collaborate with academic leaders, industry experts, and highly skilled engineers to enable our clients to generate sophisticated insights from big data. Our work spans multiple industries and domains, but our focus remains constant: delivering excellence through technology, teamwork, and transformation.
What You Will Do
As a Senior Data Engineer in our growing team, you will play a critical role in the development and maintenance of production data pipelines that support machine learning model training and deployment. Your expertise will be instrumental in driving the success of our US Federal Sales Division. Key Responsibilities: Pipeline Development & Maintenance: Design, develop, and maintain robust production data pipelines that support the training and deployment of machine learning models. Ensure pipelines are scalable, reliable, and performant. Technology Implementation: Support the implementation of advanced technology packages for US Federal market data science, including requirements gathering and comprehensive solution analysis. Cross-Functional Collaboration: Work closely with our core IT team to support the development and production data pipeline, ensuring seamless integration and optimal performance. Best Practices Implementation: Review and implement data engineering best practices consistent with industry standards, continuously improving our processes and methodologies. Data Quality & Monitoring: Establish and maintain monitoring systems for production pipelines, ensuring data quality and identifying issues proactively. Documentation & Knowledge Sharing: Create and maintain comprehensive documentation for data pipelines, processes, and best practices to support team knowledge transfer.
What We're Looking For
Essential Qualifications: Citizenship: Must be a U.S. citizen due to the nature of our federal work. Location: Must reside in the United States. This position offers flexibility with locations in Round Rock, Texas; Hopkinton, Massachusetts; or remote work arrangements across the U.S. Education: Bachelor's degree in Computer Science, Engineering, or equivalent professional experience. Experience: Minimum five years of professional experience in data engineering within an enterprise environment. Technical Expertise: At least three years of experience supporting end-to-end development of scalable data pipelines, including monitoring and production support. Data Technologies: At least three years of experience working with data warehousing, relational databases, JSON, Apache Hive, Spark, or Hadoop, or related technologies. Programming Skills: Strong proficiency in Python and SQL. Preferred Qualifications: Federal Experience: Prior experience working with U.S. Federal agencies or on federal contracts. Platform Expertise: Experience with the Cloudera Platform and Docker containers. Cloud Technologies: Familiarity with cloud-based data platforms and services. Machine Learning: Understanding of machine learning workflows and how data pipelines support ML model training and inference. Skills & Competencies Apply tot his job Apply To this Job