Big Data Integration/IOT Tech Lead
Job Title: Big Data Integration / IoT Tech Lead Job Summary We are seeking an experienced Big Data Integration / IoT Tech Lead to architect, design, and lead the implementation of scalable data integration and IoT data platforms. This role is responsible for end-to-end ownership of data ingestion, processing, and analytics pipelines that handle high-volume, high-velocity IoT and enterprise data. The ideal candidate combines strong technical leadership with hands-on expertise in big data, cloud platforms, and IoT ecosystems.
Key Responsibilities
- Technical Leadership: Lead the design and delivery of Big Data and IoT integration solutions; provide technical guidance to development teams.
- Architecture & Design: Define scalable, secure, and fault-tolerant architectures for IoT data ingestion, streaming, storage, and analytics.
- IoT Data Integration: Integrate data from IoT devices, sensors, gateways, and enterprise systems using real-time and batch pipelines.
- Big Data Pipelines: Design and implement ETL/ELT pipelines for structured and unstructured data using modern big data frameworks.
- Streaming & Real-Time Processing: Build and manage real-time data processing solutions for telemetry, alerts, and operational analytics.
- Cloud & Platform Management: Deploy and optimize big data and IoT solutions on cloud platforms (AWS, Azure, or arenaflex Cloud Platform).
- Performance & Scalability: Ensure high availability, low latency, and scalability of data platforms handling massive data volumes.
- Security & Governance: Implement data security, access controls, and governance standards for IoT and enterprise data.
- Collaboration: Work closely with product owners, data scientists, architects, and business stakeholders to translate requirements into technical solutions.
- Mentoring & Code Review: Mentor engineers, enforce best practices, and conduct design and code reviews.
- Innovation & Continuous Improvement: Stay current with emerging trends in IoT, big data, cloud services, and analytics technologies. Required Skills & Qualifications
- Big Data Technologies: Strong experience with Hadoop ecosystem, Spark, Kafka, Flink, or similar frameworks.
- IoT Platforms & Protocols: Experience with IoT platforms and protocols such as MQTT, AMQP, OPC-UA, REST APIs.
- Data Integration: Expertise in building batch and streaming data pipelines; experience with ETL tools and custom integrations.
- Cloud Platforms: Hands-on experience with AWS (Kinesis, IoT Core, EMR), Azure (IoT Hub, Event Hubs, Databricks), or arenaflex Cloud Platform equivalents.
- Databases & Storage: Experience with data lakes, NoSQL databases (Cassandra, MongoDB), and time-series databases.
- Programming: Proficiency in Java, Scala, Python, or similar languages.
- DevOps & Automation: Experience with arenaflex/CD pipelines, containerization (Docker, Kubernetes), and infrastructure as code.
- Leadership & Communication: Strong ability to lead technical teams and communicate complex concepts to non-technical stakeholders. Education & Experience
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 8+ years of experience in big data engineering or data integration roles.
- 3+ years in a technical lead or architecture role involving IoT or large-scale data platforms.
Preferred Qualifications
- Experience with edge computing and device lifecycle management.
- Exposure to advanced analytics, AI/ML pipelines, or digital twin solutions.
- Knowledge of data governance, compliance, and industry standards (e.g., ISO, GDPR).
- Experience in industries such as manufacturing, energy, automotive, healthcare, or smart cities. Apply tot his job Apply tot his job
Apply tot his job Apply To this Job Apply tot his job Apply To this Job