Clinical Experience and Performance Setup Guide

Use this Setup Guide to install and configure your Clinical Experience and Performance solution using test data. This guide will walk you through setting up a test environment that closely mimics a staging or production environment. At the end of this Setup Guide you'll have a test environment with your own test data loaded, but to cover all required elements (credentials, candidates, surveys, and evaluations) for the Clinical Experience and Performance solution additional steps will be required as indicated at the end of Step 3. 

This test environment allows your tech team, administrators, and stakeholders to test configuration changes being considered for the production environment without an impact on end-users. It is important to note that this test environment is separate and distinct from the sample environment you accessed during the Quick Start.

This Setup Guide assumes that you have access to a the following data (in CSV format), which provides the data to power the dashboard:

  • Student Information System data
  • Candidates who have received credentials from the state or other licensing body
  • Data on Candidates who have received evaluations
  • Data on Candidates who have received survey feedback

The following steps to get this test environment up and running are very similar to the steps for setting up a production or staging environment.

Summary

More information

This Setup Guide builds on core skills and concepts in the Clinical Experience and Performance Quick Start. We recommend running that Quick Start before moving on to this more detailed Setup Guide.

Link: Clinical Experience and Performance Quick Start

Solution Overview


This section provides an overview of the components of your Clinical Experience and Performance solution to provide context for completing the remainder of the Setup Guide. The diagram below depicts the high-level architecture and component interactions. Names and acronyms in the diagram are explained below.

 

The core components involved in this solution are:

  • Student Information System (SIS) Data.
  • Program Data.
  • Survey and Evaluation Data.
  • Credentials Data.
  • The Ed-Fi ODS / API & Tools, which include Ed-Fi ODS / API, Ed-Fi Admin App, and Data Import Tool. 
  • Power BI Desktop, the application chosen to model, create, and deliver the Clinical Experience and Performance Dashboards.
  • Power BI Online, which allows you to publish the dashboard and manage the different users and roles.

The rest of this guide will instruct you on how to:

  • Install the above components.
  • Configure Education Organizations and apps in the Ed-Fi Admin App.
  • Load data via the Data Import Tool (SIS, Programs, Credentials, Surveys, Evaluations) to the Ed-Fi ODS.
  • Use the Clinical Experience and Performance Starter Kit to engage and provide support to staff, deans, and program managers. 


Important data security notes:

  • Adhere to your organization's data security guidelines regarding student data.
  • We recommend using test data for this walkthrough.

  • If you only have access to production data (i.e., live data about students), you'll want to ensure the platform is as secure as your production environment. Consult your organization's IT or security resources for specific guidance.




Step 1. Install the Ed-Fi Solution


In this step, you will install the components of the Ed-Fi solution needed for the Starter Kit. These components are:

  • ODS / API for Suite 3 v6.1
  • Analytics Middle Tier v3.1
  • Admin App for Suite 3 v3.0
  • Data Import v2.0

Basic Infrastructure and Prerequisites

The list of infrastructure items you need to be successful is provided below. 

  • Database Server (Windows Server 2019) with the following components installed:
    • PowerShell 5.0. 

    • .NET Core 6.0 SDK. 

    • Microsoft SQL Server 2019 Standard (or higher)

  • Web Server (Windows Server 2019) with the following components installed:
    • .NET Core 6.0 Hosting Bundle. The .NET Core 3.1 Hosting Bundle is required for running the API on IIS.

    • Internet Information Services. IIS is the web server that will run the ODS / API.

For more details on setting up required components and software, refer to Getting Started - Binary Installation. It is always recommended to follow your institution's best practices for maintenance and backups.

Install Ed-Fi ODS/API

Install the ODS / API for Suite 3 v6.1 by following instructions in the Getting Started - Binary Installation guide

Install Analytics Middle Tier

Install Analytics Middle Tier by following the instructions in the AMT Deployment Guide to install the 'EPP' and 'RLS' collections

Install Admin App

Install Instructions for Admin App can be found in the Admin App v3.1 guide

Install Data Import

Install Instructions for Data Import can be found in the PowerShell Installation for Data Import using NuGet Packages guide. Data Import configuration is also described below.


Time to complete

Installing the Ed-Fi Solution usually takes a few hours to a day, assuming you have access to the hardware and software prerequisites, and are comfortable working with Windows Server, IIS, and SQL Server.

The time to configure and coordinate data flowing from a certified SIS system typically takes anywhere from a couple of hours to a week or two of calendar time, depending on the type of SIS.

Step 2. Configure your Education Organizations and Applications


In this step, you will load test data from your SIS, credential, and financial aid providers to the Ed-Fi ODS / API for it to be available on the Clinical Experience and Performance dashboard. This step requires you to have access to data in CSV format for Data Import to load into the Ed-Fi ODS / API. If you would like to see sample data import templates and CSV data it can be found on our GitHub here.

Add Your Education Organizations in the Admin App

Once you have successfully installed the Admin App following the instructions provided above, you can continue to configure Admin App to add your Education Organizations. This configuration will allow your data to be loaded properly as much of it requires education organizations. You can also find instructions for AdminApp configuration at Admin App - Next Steps.

The first time you open Admin App will ask you to register a new user in order to get access to the utility. The user you set up can be used for any future access to the tool. You will also have the opportunity to create additional users later.

In order to register a new user you will need to provide an email address and create a new password.

As soon as you log in for the first time with your new user, you will see the following page to complete the set up of Admin App. You will need to click the continue button to complete the Admin App's initial configuration.

 

After this initial one-time set up you will see a screen like the following on your subsequent visits to Admin App. You can start by clicking on the "Settings" button within Admin App to configure your Education Organizations.

Click on the "Education Organizations" tab. You might see a spinning icon on screen as the admin app calls the ODS / API to retrieve existing education organizations. When the page finishes loading the "Local Education Agencies" radio button will be preselected. Choose the "Post-Secondary Institutions" radio button instead.

Click the "Add Post-Secondary Institution" button. This will pop up a new window that will allow you to add a Post-Secondary Institution, which represents the university or institution that your EPP is a part of.

Note: The Post-Secondary Institution ID, Name of Institution, Address, City, State and Zip Code fields are required. Post-Secondary Institution ID is a numeric field.

After you fill out the information click 'Add'. You will be taken back to the Education Organizations tab and should see the Post-Secondary Institution you just added. Now click on the 'Add School' button on the lower right under your Post-Secondary Institution. 

A popup that looks very similar to the one you used to create the Post-Secondary Institution will appear. Fill in this form with a School ID that is different from the Post-Secondary ID from that last step. At least one grade level from the dropdown list. As well as the Name of your EPP and Address information for your EPP. Click the 'Add' button when you're done. 

You will be taken back to the Education Organizations tab. You should see two education organizations. If you do, click the 'Home' button at the top right side of the page.


Click on the "Global" button within Admin App to configure the vendor and Application that will provide API keys and access for Data Import to load your data.

Click on the "Add Vendor" button within the Vendors tab to add the vendor you will be using with Data Import.

The Namespace prefix should be a URL which includes your institution's web domain (e.g., uri://www.demo.edu')

After you fill out the information and click on "Save Changes", you should see the new entry at the bottom of the screen.

Now that the vendor is created, the application needs to be added. Click on the "Define Applications" button to enter the Application menu. Click on Add Application

The application form will describe how the vendor will be used. Here is an example of how to fill out the Education Organization and Claim Set information. 
Note: For test environments using the Ed-Fi Sandbox claim set is appropriate, bur if this is a production environment we suggest using a claim set tailored specifically to this Starter Kit. 


The next screen will provide you a key and secret to be used with importing data. These values will be required in your data import configuration. Make sure to save this information off somewhere for safekeeping.

Finally, the information of the added application is displayed.

You will then submit the API URL and security information to your vendor so they can start to load data with you ODS / API.

  • Once you create an Application in the Admin App, you will store and use the generated "Key" and "Secret" in the next section.
    • Note: Treat the Key and Secret as secure information for your organization (because it will control API access to data in the Ed-Fi ODS).
    • Store it according to your local IT Security policy. Often this will be in a password keeper app, on a secure file server, or a similar method. 

Need help?

Having difficulty with your Clinical Experience and Performance Starter Kit? Reach out to an Ed-Fi Alliance representative for assistance. 



Step 3. Configure Data Import and Load Data


The Data Import tool is used for loading export files (typically in CSV format) generated manually, by the vendor, or one of their automated services. There are 4 steps to load data to the ODS:

  1. Configure Data Import for First Time Use
  2. Create your map
  3. Create an Import Agent
  4. Upload the file
  5. Execute the Data Import


The initial setup of data import will only need to happen once per server that Data Import is installed on.
The remaining steps will need to be repeated for each CSV you plan to upload. We have provided an example below using program data.


Configure Data Import for First Time Use

The first time you log in to you Data Import application you will see a log in screen. You will need to create a user for this site by clicking on the register link.

Enter an email address and password to get access to data import.

Now you can log in to the Data Import application. Under the Admin tab, select the "Configuration" menu item. This is where you will configure Data Import to access the ODS / API.

Click on the "Ed-Fi API Connections" button to configure the connection to the API.

Then click on the "Add API Connection" button.

Enter the API data and then the key and secret generated in the previous Admin App configuration step. Test the connection and confirm appropriate credentials. Click on Save Changes. The API Connection Name should match the name used in Admin App.

The new connection should appear in the API Connections list.

Go back to the Configuration item in the Admin dropdown menu to configure Admin App for template sharing service. Template sharing is a way to re-use existing assessment vendor templates. In the configuration page, click on Authorize to add the API key and secret. You can request a key and secret here if you do not already have one.

Enter the provided key and secret and confirm by clicking on "Test Template Sharing Service Connection".

Finally, click on the 'Update Configuration' button to save your changes.

Data Import is now configured and you are ready to create or import a template to load data.

Create or Import a Mapping Template

If you already have an import map created select the 'Import / Export' option from the Admin menu.

On the Import / Export Templates page, select 'Choose File'. This will open a file picker dialog where you can choose the JSON template to import.

To create a new map for importing data, select 'Maps' from the configuration menu.

Click 'Add Data Map'

Fill in the Map Name, for this example we will be using program data, so we will name the map 'EPP Programs'. Select '5.2' from the API Version drop down. Next choose the API resource that you would like data import to import into. Since we're importing program data, we'll select Programs. 

Finally, click on the 'Choose File' button and select your CSV program data. 

Click 'Upload'

Data Import will read the file looking at the first row for the column names, it will then show you those column names and the first five rows of data in the CSV.

You can now map columns in the CSV to fields in the Programs API resource. 

Once you have completed the mapping, click 'Save Map'

This will bring you back to the Maps page. You should now see your new map in the map list.

Create an Import Agent

With the map created, Data Import needs an agent to execute the mapping against data. Select 'Agents' from the Configure menu.

Click 'Add Agent'


Give the agent a name that represents the data being imported. For this example we're using program, so select your API connection created previously. Data Import has a number of different ways to import data, including over FTP or SFTP as well as from the file system.

We're choosing to use a manual template. Make sure your agent is enabled and choose the map created in the previous step. Make sure to click 'Add Map' after you've selected your map from the dropdown list.


 Confirm that the map is now listed above the dropdown list control.

Click 'Save Agent.' Your new agent will show in the list of agents.

Upload a file

Click on the upload icon to the right of the agent

Click 'Choose a File'

Select the program data file and click 'Upload'.

You will be taken to the activity page that will show your agent and if the file was able to be uploaded and read. The status should say Uploaded. You can now tell Data Import to import your data into the Ed-Fi ODS.

Execute Data Import

When the configuration is completed and the data files are loaded, import the data in: c:\inetpub\wwwroot\Ed-Fi\Data Import\DataImport.Server.TransformLoad

Run the DataImport.Server.TransformLoad.exe executable

A successful import will look similar to this, lots of scrolling text, but no red errors

To import the data necessary for the Clinical Experience and Performance Starter Kit, you will need to upload data for people, candidates, credentials, programs, surveys, and evaluations. This will require repeating Section 3, beginning with Create or Import a Mapping Template for each of the remaining data sources until all of the required data is loaded. 

Deep dive

For detailed information on the data requirements to be able to power the Clinical Experience and Performance Dashboard, see the data loading requirements linked below.

Link: Clinical Experience and Performance Data Requirements

Step 4. Install and Test the Clinical Experience and Performance Dashboard



In this step, you'll install Power BI prerequisites, as well as download and run the Clinical Experience and Performance Dashboards. 

Prerequisites

  • At this point, you should have an operational Ed-Fi ODS / API with data loaded through Data Import.
  • Additionally, you should have installed the AMT views on your ODS database.
  • You will also need a machine that has access to the ODS database and has Power BI Desktop installed.

Install Power BI Desktop

The Clinical Experience and Performance Dashboard was built with Microsoft's Power BI Desktop application.

To run the dashboard you will need a machine with:

Download and Configure the Clinical Experience and Performance Dashboard

The latest version of the Clinical Experience and Performance Power BI Dashboard file is located in a GitHub repository.

Use the machine that has Power BI and create the following folder structure: C:\Ed-Fi\QuickStarts\EPP_Performance\.

Save this file onto that location by clicking this link: https://github.com/Ed-Fi-Exchange-OSS/EPP-PowerBI-Report-Starter-Kit/raw/main/Clinical%20Experience/Ed-Fi%20EPP%20Performance.pbix .

Once the download completes, navigate to the folder where you downloaded the file and double-click it. This should open Power BI and load the Clinical Experience and Performance Dashboard as depicted below:


Connect your Power BI Dashboard to your Ed-Fi ODS

The data that is pre-populated is a set of data that mimics real world data in a educator preparation program..

To connect to your Ed-Fi ODS, use the top menu and navigate to Home and then Transform Data. Click the dropdown arrow and select "Data source settings".

When the modal opens click on the "Change Source..." button.

A second modal will popup with inputs to configure your SQL Server server connection. Use the IP address or the hostname of the server that contains the database. Then input the name of your Ed-Fi ODS database. Usually the name of your database will be Ed-Fi_ODS.

Depending on your organization's security configuration, you may use integrated or SQL server security. 

Once you click ‘OK’, you will see SQL statements. Click ‘OK' or ‘Run’

Additionally, it might show you the following screen:

This is where you can switch from Windows Integrated Security to MsSQL security if you desire.

Click on connect and accept the defaults.

You will see a screen that will load data from your ODS like the one below. Note that it might take a minute or two to finish loading. This depends on the amount of data and students you have in your Ed-Fi ODS.


Once it loads, the Clinical Experience and Performance Dashboard will display your data.


If you haven't already, visit the Clinical Experience and Performance Dashboard Walkthrough to learn more about how to use the Clinical Experience and Performance Dashboard.


Step 5. Publish the Clinical Experience and Performance Dashboard and Plan Your Rollout


The final step is to publish the Clinical Experience and Performance Dashboards to Power BI Online. This release is targeted to your internal test users, allowing them to log in, view, use, and test the data visualizations. At the end of this step, you will be able to plan your rollout and deployment.

Basic Power BI Online Setup 

We will guide you through some of the basics around Power BI Online.

For this dashboard to work you will need:

  • A subscription to Power BI Online
  • A few users created in Office 365 
  • A Workspace to be able to publish the dashboard

Creating Users in Power BI Online

If you already have users created in your Power BI account you can skip to the next section.

To create users follow these simple steps:

  • Login to Power BI Online.
  • Click on the  menu on the top left of the screen and select  as depicted below.

  • This will open the 365 admin center. From here click on  button indicated on the image below.

  • This will open a modal window that will allow you to add a user. Follow the instruction on that modal to create a user.
  • It is important to note that the user's email address in Power BI should be the same as the ones in your SIS and in the Ed-Fi ODS. This is how we match the user that is logged in with a role in the Ed-Fi ODS.
  • You can repeat this process to add all the users who will be accessing the Clinical Experience and Performance Dashboard on Power BI.

Creating a Workspace to Hold the Dashboard

Back on the main screen of Power BI Online, click on the menu icon and then on the "Workspaces" subsection, which expands a side modal. At the bottom, click on the "Create a workspace" button to toggle a slide-out form on the right. This slide out form allows you to create and name the workspace. For this demo we named it "Ed-Fi Demonstration Workspace".

At this point you are done with this step.

image2021-7-29_13-21-44.pngimage2021-7-29_13-36-25.png

Publishing the Dashboard

Open Power BI Desktop and sign in with the account that has access to publish to Power BI online.

Click on the "Home → Publish" menu entry as depicted below.

This will open a modal popup window. Select the workspace you created in the section above and click on the "Select" button.

image2021-7-29_13-30-27.png

In a few seconds you will see the modal popup indicating that it is publishing. When complete you will see a "Success!" message.

To confirm, we recommend that you login to Power BI Online and ensure you can see the Dashboard.

To do this, open your favorite browser and navigate to https://powerbi.microsoft.com/ and login.

Click on your workspace and you should see the "Clinical Experience and Performance Dashboard" in the list.

Enabling Security on the Report

The report comes configured with two security roles:

  • Supervisor - Has full access to all data
  • Standard - This role is meant to restrict access to Personally Identifiable Information and does not have access to the details page of the Starter Kit.

To enable it in Power BI Online, follow these steps:

Open your browser and navigate to Power BI Online. Then proceed to open the workspace where you published the "Clinical Experience and Performance Dashboard" report. Ensure that the "All" submenu has been selected, and click on the context menu for the row showing the "Dataset". In the context menu select the security option.

In the Row-Level Security page, ensure you click either 'Standard' or 'Supervisor'. Then add either a role or an individual user who will be able to view the report.

Click on the "Save" button once you are done adding groups or users to the members section .

To test the security, hover over the "Standard" or "Supervisor" role and click on the context menu, then select "Test as role."

This will load the report and you should see the widgets show blank data as the user you are using will most likely not be part of the security.

On the top blue menu, click on "Now viewing as: " and enter the email of a previously configured user. In this case, we are going to use Sandra Atkins, who is a faculty member. This is our sample data set. The report will show data specific to that user profile. 

 

Explore by impersonating other users.

Here is a screenshot impersonating MaryAnn Flores who is a dean.

When an actual user logs in, the data will be filtered specifically to that user’s profile.

Additional Recommended Reading and Live Dataset Connectivity

We recommend reading the following articles. They explain how to setup a live database connection from Power BI Online to your Ed-Fi ODS SQL Server database.

Note

Regarding identity mapping, it is important to note that a user's email address in Power BI Online should match the email in your SIS and in the Ed-Fi ODS. This is how the Dashboard matches the user that is logged in to a role in the Ed-Fi ODS.

Success! You are Ready to Plan Your Rollout and Production Deployment With Your Team.

At this point you have completed all the steps required to launch your "Clinical Experience and Performance Dashboard" with your organization. You are now in a position to:

  • Verify functionality and support from key systems
  • Explore the dashboard (follow the use cases and guide described in: Clinical Experience and Performance Dashboard Walkthrough to help you and your users)
  • Understand what resources and technical skills you need to support it
  • Test this solution with your key audiences in a pilot (Note: it is recommended to have a small pilot group so that they help by looking at data and provide feedback on the displayed metrics)
  • Plan and conduct a production rollout of your solution