ETL Developers' Guide - Application Configuration

Sets the logging level for the ETL. Performance may be adversely affected when the logging level is set to "Verbose", so this setting should only be used for active troubleshooting. The default setting is "Information".

<add key="MinimumLogLevel" value="Information" />

Shows log output in the console.

<add key="EnableConsoleLogging" value="false" />

Sets the SQL query command timeout. Specified in seconds.

<add key="SqlQueryCommandTimeout" value="120" />

For Daily Attendance Rate calculations, this setting determines which method below is used.

• If the flag is set to "School", then Daily Attendance is used.
• If the flag is set to "Section", then Section Attendance is used.

• If the flag is set to "Both" (which is the default), then both are used. In the case of a student having both, priority is given to Daily Attendance.

<add key="DailyAttendanceCalculationSource" value="Both" />

For attendance calculations, this setting provides the range of instructional days upon which to perform the metric calculation. For example, a reporting period of four weeks is 20 instructional days.

<add key="ReportingPeriodLastXDays" value="20" />

For attendance calculations, this setting provides range of instructional days to perform the metric calculation. For example, a reporting period of eight weeks is 40 instructional days.

<add key="ReportingPeriodLastYDays" value="40" />

For student advanced course mastery calculations, this setting provides the threshold for AP score mastery.

<add key="APScoreMasteryLevel" value="3" />

For student advanced course mastery calculations, this setting provides the threshold for IB score mastery.

<add key="IBScoreMasteryLevel" value="4" />

For student information calculations, this setting provides the number of calendar days after which a student is considered for late enrollment.

<add key="DaysNeededForLateEnrollment" value="14" />

If set to true, the ETL will roll over the end-of-year metric calculations from the DDS to the DDW. The ETL will not re-calculate metrics in the DDS prior to the rollover.

<add key="RunOnlyYearEndSnapshot" value="false" />

When true, students who have withdrawn from school or are not enrolled will be processed normally. If false, students not enrolled in school will be excluded from output and metric calculations. The default is true.

<add key="IncludeWithdrawnStudents" value="true" />

Comma-separated list of container metric projects to exclude from the ETL execution. Commonly used to debug.

<add key="ExcludeExtensionList" value="" />

Caches streamed objects in bus. Commonly used for debugging the ETL but may also be necessary if dealing with large datasets to avoid timeouts.

<add key="CacheAllQueries" value="false" />

When DryRun is true the ETL does not write to the output databases. Commonly used for debugging the ETL.

<add key="DryRun" value="false" />

When the streamed data reaches the BulkCopyBufferSizeMax, the data in the buffer will be written to a file, to free up memory. The file will be read into SQL Server using SQL Bulk Copy.

This feature is useful when dealing with large datasets (i.e., 250K+ students).

<add key="UseFileBuffer" value="false" /> 

When UseFileBuffer is true, FileBufferLocation specifies the directory into which the file will be written. SQL Server must have permissions to read the directory. The ETL application must have permissions to write to the directory.

The disk containing the directory must be able to store the amount of data being buffered to the server, which depends on the amount of data in the ODS. The storage requirements listed in the ETL Developers' Guide - Overview should be sufficient for this process.

<add key="FileBufferLocation" value="C:\Windows\Temp" />

Determines if daily historical attendance calculations are performed. Daily historical attendance is a time-consuming process, so the feature can be turned off. However, the historical graph for attendance will not show the daily period link.

<add key="CalculateDailyHistoricalAttendance" value="true" /> 

When true, the ETL will recalculate historicals for all time periods in the current school year. When false, the ETL will only calculate historical metrics for time periods that have not been completed previously.

<add key="RebuildHistoricalCalculations" value="true" />

Turns on SQL Server trace flags for executed queries.

<add key="SessionTraceFlags" value="" />

Used for advanced linked server configurations only: for most configurations, this option should be left as default, which is empty.

Linked server name for the instance containing the Dashboard.

For users with a linked server configuration where the Data Warehouse and Dashboard exist on different instances, ensure that the Data Warehouse has a linked server configured by this name with access to the Dashboard.

<add key="DashboardLink" value="SERVER\DDSLINK" />

Used for advanced linked server configurations only. For most configurations, this option should be left as default, which is empty.

Linked server name for the instance containing the ODS.

For users with a linked server configuration where the Data Warehouse and ODS exist on different instances, ensure that the Data Warehouse has a linked server configured by this name with access to the ODS.

<add key="OdsLink" value="SERVER\ODSLINK" />