Data Engineering Lead
Monterosa is a leading Real-time Engagement Platform (RTEP) powering the world's biggest entertainment and sports properties. Our platform, Monterosa / Interaction Cloud™, enables organisations to create interactive experiences for passionate audiences, driving real-time engagement, data acquisition, and revenue at scale. We are proudly one of the most successful, awarded, and recognised companies in our space.
Monterosa / Interaction Cloud continuously gathers data from fan activity which we use to build and enrich detailed fan profiles for our customers, enabling them to segment and target their audiences, as well as driving data orchestration within their CRM and CDP systems.
With Databricks integrated into our platform, we are able to process extremely high volumes of user data, sharing it with our customers via real time data pipelines as part of our Audience Profiles offering. Data governance is very important to our customers, and our processing is always compliant with GDPR, CCPA and other international data protection legislation.
Data analysis and development of data insights is also a key service that we provide to customers, through detailed dashboards and integration with 3rd party analytics services.
Our platform already includes a range of AI features, utilising LLMs to generate relevant content for customer experiences. We see huge potential in this area and we are continuously developing new ways in which to support our products and our customers through the use of AI tools.
We are seeking a Data Engineering Lead to lead and grow our data engineering efforts while remaining hands-on in the development of cutting-edge data solutions. This is a hybrid “player-manager” role, ideal for someone who thrives in both technical and leadership capacities. You will work closely with internal teams and customers, gathering requirements, writing detailed specifications, and executing projects alongside a small but capable team.
Technical Leadership: Lead a team of data engineers while contributing directly to the development of robust and scalable data pipelines.
Data Pipeline Development: Design and implement data pipelines including ETL/ELT processes, data delivery and orchestration using Databricks, AWS services and customer APIs.
Data Insights: Design and Build dashboards for customers and internal stakeholders, combining data from multiple sources. Support stakeholders in the use of these tools and work with them to identify trends and insights in the data.
Product Management: Continuously build and improve a set of data products, ensuring that all customers benefit from the latest features as they become available.
Collaboration: Work closely with customers and internal stakeholders to understand business requirements, define technical solutions, and deliver high-quality results.
Team Building: Mentor team members, foster a collaborative environment, and support professional growth within the team.
Execution: Drive projects from concept to completion, ensuring timelines, budgets, and quality standards are met.
Qualifications:
A minimum of 5 years’ experience in data engineering, including hands-on work with data pipelines, ETL/ELT processes, and cloud technologies (preferably AWS).
Strong expertise in Databricks on AWS or Azure, specifically the development and deployment of Notebooks in Python, Data Analysis in SQL, and development, monitoring and troubleshooting of Workflows.
Experience of current Databricks features including Unity Catalog, Serverless Clusters, Delta Sharing.
Strong understanding of software engineering principles and best practices, including Scrum/Agile development methodologies, segregation of environments, version management systems including git, code reviews, risk management, documentation and software security.
Knowledge of data governance best practices and data protection legislation, particularly GDPR. Experience designing systems that manage personal data from data subjects within this context.
Experience of the use of AWS cloud products including S3, Kinesis, Data Firehose, CloudWatch and SQL and No-SQL databases.
Knowledge of principles of Data Science, including maching learning and working with LLMs. Experience of fine-tuning models and ensuring privacy and security when working with LLMs.
Strong analytical and documentation skills, with experience in gathering and documenting requirements, writing stories and specifications
Preferred Attributes:
Excellent communication and interpersonal skills, with the ability to interact with technical and non-technical stakeholders effectively.
A proactive, problem-solving mindset with a passion for innovation and excellence.
Experience working in a dynamic, global organisation.
Appreciation of the value of opportunities for in-person collaboration within a remote organisation
Curiosity and a commitment to continual learning and self-development, in terms of technical skills, engineering leadership and technical management
Do you want to join our team as our new Data Engineering Lead? Then we'd love to hear about you!
At Monterosa we love one thing - interactive entertainment. The Monterosa / Interaction Cloud is the world's leading fan engagement and interaction platform, making it easy to deploy ready-made and tailored fan experiences at scale and on every screen. Our customers span the globe and include Liverpool FC, Fanatics, Formula E, ITV and Fanatics.