SAH DEV0 / Canvas Update - Phase 1 Details
What is included in Phase 1
Canvas Update
Infrastructure (the vendor for Canvas) changed the format and delivery frequency for Canvas (LMS) summarized / batch data.
This is the data set used for most reporting / analytic purposes.
There was no change to the live event streaming data.
Up until this change, summary data has been delivered in a full set each day with up to a 48-hour lag in events appearing in the summary.
Data with the Canvas 2 update implementation is delivered incrementally every 4 hours resulting in timely updates and reduced processing time.
Our Canvas views are refreshed daily meaning the latency at the time of the view refresh is no more than 4 hours.
DEV0 Phase 1
DEV0 is the work being done to prepare SAH for data loads from TSS.
This first phase included:
Demographics
Student Stats Per Term
As these two key views are included in many to most of our SAH core view set, all views leveraging data from these two views were also included in the validation that has been done by ITS prior to delivering this first phase out for UAT. Impacted views include:
SAH-APP-Application Narrow-View (restricted – not yet ready for UAT)
SAH-ClassComponentSchedule-View
SAH-ClassComponentScheduleCensus-View
SAH-Degree-View
SAH-Demographics-View
SAH-Enrollment-View
SAH-EnrollmentCensus-View
SAH-InstructorAssignment-View (IR only)
SAH-InstructorAssignmentCensus-View (IR only)
SAH-InstructorSchedule-View (IR only)
SAH-InstructorScheduleCensus-View (IR only)
SAH-MajorMinorDetail-View
SAH-MajorMinor-View
SAH-MajorMinorNarrow-View
SAH-MajorMinorNarrowCensus-View
SAH-Retention-View
SAH-RetentionCensus-View
SAH-RetentionDetail-View
SAH-RetentionDetailCensus-View
SAH-StudentHoldsNarrow-View
SAH-StudentSchedule-View
SAH-StudentStatsPerTerm-View
SAH-StudentStatsPerTermCensus-View
SAH-StudentWithdrawalNarrow-View
SAH-WaitlistAudit-View
Expanded records now included
Current PROD
All records from ISIS and Med Hub (clinical residents).
Includes records for admissions where the person never actually registered for classes.
Historical to 2004
New QA
All records where the person has ever had a registration status, been a clinical resident, or received a degree.
No historical filter. All records from ISIS meeting the above condition are included.
This is implemented for phase 1 data (Demographics / Student Stats Per Term).
Other areas, such as Enrollment, will see this change in future phases.
Additional Improvements
As the views that build SAH-Demographics and SAH-StudentStatsPerTerm were reviewed a number of areas of improvement were identified.
Country Name
In our current production environment, the country name displayed represents the value at the time the event occurred leading to issues when trying to summarize things by country as values change.
The new DEV0 implementation in QA presents the current country name for all rows – historical and current.
Text fields
All text field values have been trimmed to remove extra spaces.
Aside from making the display of these fields cleaner, this trimming of values has resulted in better matching of code values for things such as calculated flags and lookups.
Contact information
This includes address, phone, and email fields.
Prioritization of data information for source of record:
Students – primary source is ISIS
Instructors – primary source is ISIS
Clinical Residents – primary source is Med Hub
Improved process for tracking changes to assure current data is displayed
Improvements across the following areas:
Contact information
Latest term selection
Room capacity changes
Highest Grade Point
Improved detection of known deleted items
In the current ISIS environment there are items that are physically deleted from the underlying database causing issues if the data has already been loaded to HANA.
In TSS it is expected by design that this will no longer occur and the records will be instead marked as deleted within the underlying database, rather than actually being deleted.
The improvements in the DEV0 implementation are designed for processing ISIS data up until the TSS rollout.
We have implemented this strategy for all fields where BIA is aware that the deletion is occurring. There may be other items for which this process needs to be implemented, in which case we ask that you advise us that the deletion is occurring if you are aware.
SAH will mark the field as deleted from ISIS but will not physically delete the item.
Instructor job data
Enhanced logic to match EAH in selection of primary job record.
Unit aggregation
Issues were identified and resolve relating to a rounding process within calculated unit sums.
Clinical Residents
Improved process for detecting latest visa status
Added ability to tie in historic academic events where resident was previously a student at UCSD.
ITS Validation of Changes
The BIA team with assistance from volunteers performed the following change validation:
All records were compared to SAH production, discrepancies were identified and either resolved or included in the changes above.