Description:
The Sr. Data Engineer will play a key role in delivering fairlife's ambition of building a best-in-class Data and Decision Intelligence (DDI) ecosystem. This role will support the digital transformation of our manufacturing operation and overall enterprise, translating technical requirements from our factories and stakeholders into targeted solutions that fit into fairlife’s broader data framework, architecture, and roadmap. This role will support the integration of enterprise applications and disparate data sources into our OneLake platform to create a single source of truth for the enterprise decision making.
responsibilities:
- Integration of factory data into on-premise and cloud-based Azure IoT tools to support the reliable, consistent consumption of real time data
- Design, implement, and operationalize data pipelines to support the data lifecycle for our factory IIoT data
- Design, develop, and deliver the platforms and tools needed for optimal extraction, transformation, and loading of factory IIoT data
- Support the development and delivery of a Unified Data Model for our factories and the fairlife enterprise
- Partner with manufacturing stakeholders to ensure data validity and platform buy-in
- Support delivery of a master data solution for IIoT and enterprise data
- Design and deliver solutions to support real-time factory data streaming, condition monitoring, and predictive maintenance
- Working closely with 3rd party data architects and internal data team to develop deep understanding of our data ecosystem
- Provide training and support the technical development of fellow team members
skills/qualifications:
required:
- Bachelor's degree in data/computer science, an engineering discipline, or related
- 3+ years of work experience
- Proficiency in SQL
- Proficiency in at least one object-oriented language (Python, Java, C#, etc.)
- Experience with ETL job schedulers (Apache Airflow, Azure Data Factory, etc.)
- Experience with SSIS
- Experience with data streaming and integration tools (WebSockets, REST APIs, etc.)
- Ability to handle ambiguity and work in a fast paced, entrepreneurial environment
preferred:
- Work experience in or related to manufacturing
- Experience with telemetry or time-series data sources
- Experience with pipeline automation and unit testing
- Familiar with Azure cloud resources and bicep templating