Overview

The Ed-Fi API Publisher is a utility that moves data from one Ed-Fi ODS/API instance to another ODS/API instance of the same version (i.e ODS/API 6.1 → ODS/API 6.1). It operates as a standard API client against both API endpoints (source and target) and thus it does not require any special network configuration, direct ODS database access or a particular database engine. From a data security/privacy perspective, it is also subject to all authorization performed by the Ed-Fi ODS API endpoints with which it communicates.

The API Publisher is made to satisfy this user story:

As an IT professional at the state or district level, my objective is to securely and accurately transfer data between ODS/API instances of the same version. This ensures minimal data transmission errors, maintains data quality, and enables real-time reporting and analytics.

Primary features of API Publisher includes:

• Publishing, or copying, data between Ed-Fi ODS/API instances of the same version.  API Publisher supports a push, pull and publish strategies, see README.md for more details.
• Retry support for failed records
• Remediation scripting support to attempt to fix re-occurring data publishing errors using Node.Js
• Ed-Fi extension support including Education Preparation Programs
• Change queries, which will allow only changed data to be copied in subsequent runs

Release Information

The Ed-Fi API Publisher is currently at version v1.2.  Below are links to access the binary package and the Docker container for API Publisher:

Binary Package

• https://dev.azure.com/ed-fi-alliance/Ed-Fi-Alliance-OSS/_artifacts/feed/EdFi/NuGet/EdFi.ApiPublisher/overview/1.2.1 

Docker Hub

• The latest release of API Publisher is v1.2.1:
  • https://hub.docker.com/layers/edfialliance/ods-api-publisher/v1.2.1/images/sha256-5208508a8141c401660d10512cbdd11a6dfeac596fc3655ebec54f13d9336b05?context=explore

Documentation

Documentation for the API Publisher is available online at GitHub via the following links: 

• Developer Documentation
  • README.md - A technical overview of Ed-Fi API Publisher with quick start instructions.
  • API-Connection-Management.md - Reference for using Configuration Stores with Ed-Fi API Publisher
    • Aws-Parameter-Store.md - Details for using AWS Parameter Store as the Configuration Store 
    • PostgreSql.md - Details for using Postgres as the Configuration Store
    • Sql-Server.md - Details for using SQL Server as the Configuration Store
  • API-Publisher-Configuration.md - Reference for API Publisher's configuration with details for each option
  • Considerations-for-API-Hosts.md - Considerations for Ed-Fi API hosts and incorporating into production workflows
  • Extensibility.md - Developer notes for extensions and modifications.
  • Known-Issues-Details.md - Known issues with full details
  • Remediations.md - Information on using remediation scripts for failed POSTs
• Other Items
  • CONTRIBUTORS.md - A listing of contributors to the open-source Ed-Fi API Publisher product.
  • LICENSE - The Apache 2.0 license, as applies to the Ed-Fi API Publisher.
  • NOTICES.md - A listing of copyright notices for the Ed-Fi API Publisher and libraries in use.

Licensing

The API Publisher tool is licensed through the Apache 2.0 license.