Data Engineering builds and manages the pipelines, applications and infrastructure for collecting, processing, and storing Nine’s data. We are responsible for collecting hundreds of millions of events from client devices each day and streaming them directly into our data warehouse. We extract data from the majority of Nine’s enterprise systems, centralise it in our data warehouse, and create rich data models for analysis and to inform business operations and strategy.
The team is also responsible for building solutions to surface data to users including dashboards, Slack integrations and automated static reports, as well as providing data feeds to downstream systems for personalising audience experiences and commercialisation.
Design, develop and maintain data pipelines that extract, load and transform data from various sources into the data warehouses.
Design and implement data models that align with business requirements and support efficient querying and analysis.
Ensure the pipelines are reliable, scalable, and efficient, considering factors including data volume, velocity, and variety.
Implement data quality checks and validation processes to maintain accurate and reliable data.
Set up monitoring and alerting to proactively identify and resolve issues.
Perform root cause analysis for incidents and implement corrective actions.
Contribute to the technical design and vision for the data platform.
Collaborate with cross-functional teams, including product managers, data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
Communicate technical concepts and solutions effectively to non-technical stakeholders.
Stay updated with emerging data engineering technologies and trends, and evaluate their potential benefits for the organisation's data ecosystem.
