Versions Compared

Version Old Version 1 New Version 2
Changes made by

Ann Su

Ann Su

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Info
titleComing Soon!

This Academy course is in development. Availability is expected in Q4-2022.

Course Information

  • Course Title: Data Engineering Lifecycle
  • Course Code: 141
  • Tracks: Technical Track
  • Series: Fundamentals of the Ed-Fi Solution (100 Series)
  • Course Prerequisites: 
  • Learning Delivery Mode: Self-Guided Course (Online)
  • Time to Complete: TBD minutes
  • Registration Options: Online

Course Overview

Description

This course comes after the deployment of focuses on the data engineering lifecycle. This includes following data through its many stages:

  • Generation of data in a source system
  • Vendor-owned push of data from the source system to the Ed-Fi
platform and encompasses everything a LEA technical FTE needs to know to push an initial payload of data to their Ed-Fi API. This course will also introduce the idea of a Jupyter Notebook as a method of exploring an Ed-Fi API and have the student utilize one to verify that data has landed in their ODS.
  • API
  • Extract and load of Ed-Fi API and non Ed-Fi data sources into a data lake (storage layer)
  • Transformation of raw data into facts and dims using dimensional modeling (star schema) as a design process
  • Creation of data products from the analytics layer
  • DataOps and the cloud as a way to focus on data and less on infrastructure

Who Should Enroll

Course Outcome

By the end of this course, Academy students will be able to: 

  • Comfortably move between their SIS's Ed-Fi module, Ed-Fi's public Swagger, and the Ed-Fi SIS certification requirements drawing connections between each one
  • Create vendors and applications in the Admin App as a means of generating Ed-Fi API credentials for their SIS
  • Map their descriptors in the SIS (if applicable)
  • Push data to their /schools endpoint
  • Run an API call in a Jupyter Notebook to confirm data is in their ODS

  • This introductory course provides essential context to begin a hands-on learning journey using Analytics Engineering tools and Ed-Fi technology

Learning Objectives

The learning objectives for this course are: 

  • Understand how API endpoints relate to each other through associations and reference
  • Understand descriptor mapping, the various approaches, and be able to identify which one is right for them
  • Comfortably push data from their SIS to their Ed-Fi API and verify it has arrivedthe Analytics Engineering lifecycle
  • Understand the core tools and technologies used in the lifecycle, including Ed-Fi technology

Course Modules

  • Under development