- This line was added.
- This line was removed.
- Formatting was changed.
This repository contains code that pulls data from a target Ed-Fi API and creates tables data marts in BigQuery that conform to the Analytics Middle Tier specificationserve the analytics use case.
Demonstration video: https://youtu.be/A1a7C9pDVL4
More specifically, this repository is a Dagster workspace that contains a job designed to:
- Extract data from a set of Ed-Fi API endpoints
- Store the data as JSON files in a cloud based blob storage service
- Query the JSON files from a cloud data warehouse to produce:
- Tables that represent the Ed-Fi API endpoints
- Tables that meet the spec of the Analytics Middle Tier
- Dimension and fact tables
- Code: https://github.com/K12-Analytics-Engineering/dagster
- Documentation: https://github.com/K12-Analytics-Engineering/dagster/blob/master/docs/edfi_api.md
- By: Alcozer Consulting
- License terms: Apache 2.0
- Released: December 2021
At a Glance
Generation: Tech Suite 3