Provide real-time analytics for publishers worldwide, that distribute their content through mCourser LMS. The reports should contain aggregation of fine grained metrics with statistical accuracy.
The analytical system should also serve school administrators, tutors and teachers who not only look at aggregates but also need to see accurate results for every single student.
Solwit implemented two data pipeline solutions: streaming and batch. Both utilise BigQuery as the final data destination.
Streaming provides the ability of real-time analytics with high accuracy. Each user interaction with the learning content is registered in a stream of events that are available for querying in under 2 minutes from the time of occurrence.
Batch loading of data to BigQuery provides the assurance that no record is missing, allows for regular loading of high volumes of data.
Real-time analytics through custom views with DataStudio provides publishers insights in to content popularity, geographical distribution, difficulty and content usage patterns.
Batch analytics better control over learning process for tutors and school administrators enabling the assessment of individual students and the assessment of the learning process as a whole. With this system it is not uncomment for a single teacher to guide over 10000 students in a single semester.