TAG Meeting 2021-01-14

Participants

• Marcos Alcozer, InnovateEDU

• Britto Augustine, Arizona Department of Education

• David Clements Ed-Fi Alliance

• Rohith Chintamaneni Arizona Department of Education

• Thomas Christensen Wisconsin DPI

• Rosh Joshua Dhanawade Indiana University INsite

• Stephen Fuqua Ed-Fi Alliance

• Jean-Francois Guertin EdWire

• Jason Hoekstra Ed-Fi Alliance

• Matthew Jackson Spring Branch ISD

• Eric Jansson Ed-Fi Alliance

• Erik Joranlien Education Analytics

• Eshwar Kedari Georgia Department of Education

• Shannon Kerlick Ed-Fi Alliance

• Vinaya Mayya Ed-Fi Alliance

• Jim McKay Certica Solutions

• Jeffrey Miller Greenville County Schools

• Chris Moffatt Ed-Fi Alliance

• Lee Morrow Headspring

• Troy Neal Spring Branch ISD

• James Phifer Greenville County Schools

• Doug Quinton PowerSchool Group LLC

• John Raub Wisconsin DPI

• Josh Reimer Skyward

• Andrew Rice Education Analytics

• Jim Robertson PowerSchool Group LLC

• J. Pablo Rodriguez San Diego County Office of Education

• Audrey Shay Wisconsin DPI

• Sayee Srinivasan Ed-Fi Alliance

• John Watson San Diego County Office of Education

• Patrick Yoho InnovateEDU

Agenda

1. TAG topics (from November poll)

   1. Data validation and data quality - current and future roadmap

   2. More on Data Out (incl. streaming and pub/sub)

   3. Joining data from heterogenous systems / record ownership

2. Review of major efforts around data validation and data quality (30 mins)

   1. State Education Agency "canonical" architecture: Canonical State Ed-Fi Architecture.pptx

   2. Validations API - background materials can be found here:

      1. Validation API - original presentation from 2018 Technical Congress

      2. Ed-Fi Validation API Design

   3. Exchange contributions

      1. Ed-Fi Data Checker

3. Soliciting interest in Data Import Design reviews (10 mins/Jason Hoekstra)

4. "More on Data Out" - Next Steps (discussion) (15 mins)

5. "Joining data from heterogenous systems / record ownership" - Next Steps (discussion) (15 mins)

Materials

Original TAG poll (Google Sheets)

Notes

I. Updates

• End of TAG year; refresh TAG membership in March/April by open application.

II. Data validation and data quality - current and future roadmap

Current state data quality efforts:

• SEA use case reviewed (see canonical architecture image).

• Some variation in how databases are split, how validations are performed, etc.

Validations API

• background materials can be found here: Validation API - original presentation from 2018 Technical Congress

• agreement on the potential value to this by TAG members, generally bringing validation closer to the source

• needs filtering/authorization to accommodate multi-tenant systems

Open Source rules Engine

• backgroud here: https://edfi.atlassian.net/wiki/display/ESIG/Report+Out+-+Open+Source+Rules+Engine+and+Validation+API+SIG

• and here https://edfi.atlassian.net/wiki/display/ESIG/Ed-Fi+Data+Validation+Architecture

• Ed-Fi Data Checker (see Ed-Fi Exchange)

III. Soliciting interest in Data Import Design reviews 

• Asking TAG & data import users to provide inputs to design in Tech Docs: Ed-Fi Technical Designs- Data Import

• Several TAG members agreed to join subgroup

• Side note on the tech -- interest n the notion that the output of data import can be stored as json packets in a data lake before edfi injest. Response: There is intent to bring this work (done for the back to school dashboard) into the core Data Import tool. @jason - let's touch on this next week as well?

IV. "Joining data from heterogeneous systems / record ownership" - Next Steps 

• If SIS is not the source system, issue with record ownership when data is transferred from different systems.

• Managing security and authorization a problem area as well

• Not enough time to cover - cover at next meeting

Next meeting: Thursday 1/21/2021, 3:00-4:15pm CT

• Jim - add a ping for multi-tenancy discussion