Skip to end of metadata
Go to start of metadata

Description

This repository contains code that pulls data from a target Ed-Fi API and creates tables in BigQuery that conform to the Analytics Middle Tier specification.

Demonstration video: https://youtu.be/A1a7C9pDVL4

More specifically, this repository is a Dagster workspace that contains a job designed to:

  • Extract data from a set of Ed-Fi API endpoints
  • Store the data as JSON files in a cloud based blob storage service
  • Query the JSON files from a cloud data warehouse to produce:
    • Tables that represent the Ed-Fi API endpoints
    • Tables that meet the spec of the Analytics Middle Tier

This repository currently supports Google Cloud Storage, BigQuery, and the subset of the Analytics Middle Tier necessary to power the Chronic Absenteeism Starter Kit use case.

Download

Details