Content Comparison

Define a CSV-to-ODS mapping for Student Assessements.

• In the top menu bar, click [Maps]. This takes you to the Maps listing, showing zero maps so far.

• Click [Add Data Map]

• Fill out the Data Mapper form:

  • CSV File:

    • Select the sample "ACCESS-ELL-sample-2018-GrandBend-Trimmed.csv" and click [Upload].
      • A grid will appear showing the first few rows of the CSV file.

  • Map Name: Student Assessments End to End Testing

  • Map To Entity: Student Assessments

    • Once this entity is selected, many new form fields appear under "CSV Fields".

  • CSV Fields:

    • Note that some values here are case sensitive, so enter them exactly as described here.

    • Assessment Reference:

      • Identifier:
        • Data Source: static
        • Static Value: ACCESS-ELL-2018
      • Namespace:
        • Data Source: static
        • Static Value: http://ed-fi.org/Assessment/Assessment.xml

    • Student Reference:

      • Student Unique Id:
        • Data Source: column
        • Source Column: sasid
        • Default Value: 0

    • Administration Date:

      • Data Source: static
      • Static Value: 08-01-2017

    • Identifier:

      • Data Source: static
      • Static Value: ACCESS-ELL-2018

    • Performance Levels:

      • Make no selections here. These are not required for this example.

    • Score Results:

      • Assessment Reporting Method Type:
        • Data Source: static
        • Static Value: Raw score
          • This value is case sensitive! Be sure to enter it as shown.
      • Result Datatype Type:
        • Data Source: static
        • Static Value: Integer
      • Result:
        • Data Source: column
        • Source Column: Overallss_adj

    • Student Objective Assessments:

      • Make no selections here. These are not required for this example.

  • Review the above settings for correctness, and then click [Save Map].

  • Your new map now appears in the Maps listing.

Define bootstrap data.

• Our Student Assessments CSV assumes the existence of an "ACCESS-ELL-2018" Assessement. Here, we ensure that the prerequisite will be defined ahead of importing our CSV data.

• In the top menu bar, click [Admin] \ [Bootstrap Data].

• Click [Add Bootstrap Data]. This takes you to the Bootstrap Data listing, showing zero entities so far.

• Fill out the Add Bootstrap Data form:

  • Entity: assessments
  • Processing Order: 0
  • Data: <Copy/paste the contents of Assessment Bootstrap.json>
  • Review the above settings for correctness, and then click [Save Lookup].
  • Your new bootstrap entity appears in the Bootstrap Data listing.

Define an Agent to execute this mapping for a given CSV file.

• In the top menu bar, click [Agents]. This takes you to the Agents listing, showing zero agents so far.

• Click [Add Agent]

• Fill out the Agent form:

  • Name: Agent for End to End Testing
  • Agent Type: Manual
  • Enabled: CHECKED
  • Data Map:
    • Select the map we just created, "Student Assessments End to End Testing" and click Add Map.
    • The map should appear in the Data Maps table.
  • Review the above settings for correctness, and then click [Save Agent].
  • Your new agent now appears in the Agents listing.

• Back on the Agents listing, find the section named "Manual Upload", and upload our sample file:

  • File: Select the sample "ACCESS-ELL-sample-2018-GrandBend-Trimmed.csv", the same file we used during the creation of our map.
  • Agents: Agent for End to End Testing
  • Review the above settings for correctness, and then click [Upload].

Initiate the Data Import

• At this point, we've defined a mapping from CSV to ODS JSON entities, and have uploaded a file to be processed. Now, we start the background job that will process the file and post to the ODS.

• The TransformLoad executable takes each row of the uploaded CSV file, uses our map to convert the row to valid ODS JSON, and posts it to the ODS.

• Run TransformLoad

  • Open a console window and cd to the directory with the TransformLoad executable: cd C:\Temp\DataImportDemo\DataImport.Server.TransformLoad
  • Run the TransformLoad executable: DataImport.Server.TransformLoad.exe
  • Scan the console output for success or diagnostic information.

• In addition to logging in the console window, TransformLoad logs data ingestion messages that are visible in the web application. In the top menu bar, click Logs and then the Ingestion tab to view the results of our data import.