esynergy had previously built Ark Schools’ centralised data platform on Databricks. This gave the team an existing understanding of the technology environment and allowed the new platform to use infrastructure that was already in place.
The engagement began with a six-day, fixed price discovery phase. The team gathered reporting requirements, assessed the available data sources and application interfaces, and produced a solution design before beginning the build.
Rather than creating a separate technology estate, esynergy established a partitioned Ark Start environment within Ark Schools’ existing Databricks platform. This reduced implementation time, licensing requirements and technical risk.
The platform used Azure Data Factory and Databricks to ingest, process and organise data through raw, cleaned and curated layers. Automated pipelines brought together information from Famly, CEM Aspects and the Ark Schools data warehouse. Power BI dashboards then presented the data across demographics, attendance, CEM Aspects assessments, Good Level of Development assessments, Phonics Screening and safeguarding.
Where information was not available through the Famly application interface, including attendance data, the team developed an alternative ingestion approach and aligned the resulting logic with Famly’s daily reporting format.
The work was delivered through weekly agile sprints. The same core team supported discovery and implementation, preserving the original design decisions throughout delivery.
A second phase added safeguarding reporting, updated CEM data, refreshed the Index of Multiple Deprivation data and progressed the ingestion of Ark attainment records. esynergy also provided Power BI training to help the Ark Start team use and maintain the reporting environment with less external support.
The platform was designed to benefit from the existing shared infrastructure while retaining a clear route towards an independent data environment if needed.
Ark Start now has a centralised data platform bringing together nursery, assessment and school data. Automated pipelines have replaced manual extraction and preparation across its principal reporting sources.