Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Include Page
_Previous Version Note
_Previous Version Note

The Ed-Fi Console Bulk Loader (hereafter called the Loader) is a command-line tool used to initially populate an ODS database with XML data conforming to the Ed-Fi Data Standard. It is built using code generation techniques that take into account the database schema as well as the Ed-Fi XSD Schema definitions and metadata. The Loader can also be used during database initialization to create the Minimal ODS Template database by populating Ed-Fi Descriptors and education organizations into an empty ODS database. The Loader project is called EdFi.Ods.BulkLoad.Console.

Command-Line Parameters

The Loader accepts the following command line parameters:

 

Parameter

Description

Example Parameter Value

/h

Help

Displays help information

[ none ]

/d

Database Name

The name of the ODS database to receive the bulk data

EdFi_Ods_Sample

/c

Connection String

The SQL connection string specifying the target database server and user credentials

Data Source=localhost;Initial Catalog=EdFi_Ods_Sample;Integrated Security=True

/f

Source Folder

The path to a folder containing the interchange files referenced by the manifest

C:\Samples\Sample XML

/m

Manifest Filename

The path to a manifest XML file describing the interchange files to load

C:\Samples\Sample XML\Manifest.xml

The /h parameter may be used alone. The other four parameters are required when loading data.

Database

The target ODS database must already exist and be accessible using the “Connection String” (/c) parameter provided. This database must conform to the same database schema that was used to generate the Loader application.

Manifest File

The manifest file is a simple XML document containing a list of the interchange XML files to load. Because files of the same type are loaded in parallel, it is important that files loaded by the same manifest have distinct XML IDs. Large interchange files may show errors when loading due to the highly parallelized nature of the Loader application. Usually, this is resolved by simply re-running the loader with the same settings.

A manifest file takes the following form:

Code Block
languagexml
<Interchanges>
	<Interchange>
		<Filename>Standards.xml</Filename>
		<Type>standards</Type>
	</Interchange>
	<Interchange>
		<Filename>EducationOrganization.xml</Filename>
		<Type>educationorganization</Type>
	</Interchange>
</Interchanges>

The manifest file elements are described below:

  • The Interchanges element must exist at the root, and may only be present one time.
  • The Interchange tag may exist more than once, and contains a single Filename and Type element.
  • The Filename element contains the name of the interchange file to be loaded. This may be a long filename. Note that the file must exist in the directory provided by the “Source Folder” (/f) command line parameter at runtime.
  • The Type element contains the case-insensitive class name for the resource to be loaded.

Load Order

The load order of data is extremely important when creating a populated ODS database from a minimal one. The load order reflected in the “InterchangeOrderMetadata.xml” file (EdFi.Ods.CodeGen/App_Packages/Ed-Fi/Metadata) contains the correct load order information for the ODS database provided in the Ed-Fi repository. The following load order applies:

  1. Descriptors
  2. Standards
  3. EducationOrganization
  4. EducationOrgCalendar
  5. MasterSchedule
  6. StaffAssociation
  7. Student
  8. Parent
  9. AssessmentMetadata
  10. StudentCohort
  11. StudentAssessment
  12. StudentIntervention
  13. StudentTranscript
  14. StudentProgram
  15. StudentEnrollment
  16. StudentDiscipline
  17. PostSecondaryEvent
  18. StudentAttendance
  19. StudentGrade
  20. StudentGradebookFinance

Ed-Fi ODS Populated Template

The populated template was generated manually with the Loader using sample XML data contained in the public Ed-Fi-Standard GitHub repository (Ed-Fi-Standard\v2.0\Samples\Sample XML).

Ed-Fi ODS Minimal Template

The minimal template is generated dynamically during the build process. The Ed-Fi Descriptors, standards, and education organization sample data are loaded during the "initialize development environment" step of the build process.