SAH DEV0 / Canvas Update - Phase 1 Details

Owned by Saparnell
Last updated: Jul 22, 2024
3 min read

What is included in Phase 1

Canvas Update 

  • Infrastructure (the vendor for Canvas) changed the format and delivery frequency for Canvas (LMS) summarized / batch data.   

    • This is the data set used for most reporting / analytic purposes. 

    • There was no change to the live event streaming data. 

  • Up until this change, summary data has been delivered in a full set each day with up to a 48-hour lag in events appearing in the summary. 

  • Data with the Canvas 2 update implementation is delivered incrementally every 4 hours resulting in timely updates and reduced processing time. 

  • Our Canvas views are refreshed daily meaning the latency at the time of the view refresh is no more than 4 hours. 

DEV0 Phase 1 

DEV0 is the work being done to prepare SAH for data loads from TSS. 

  • This first phase included: 

    • Demographics 

    • Student Stats Per Term 

  • As these two key views are included in many to most of our SAH core view set, all views leveraging data from these two views were also included in the validation that has been done by ITS prior to delivering this first phase out for UAT.  Impacted views include: 

    • SAH-APP-Application Narrow-View (restricted – not yet ready for UAT) 

    • SAH-ClassComponentSchedule-View 

    • SAH-ClassComponentScheduleCensus-View 

    • SAH-Degree-View 

    • SAH-Demographics-View 

    • SAH-Enrollment-View 

    • SAH-EnrollmentCensus-View 

    • SAH-InstructorAssignment-View (IR only) 

    • SAH-InstructorAssignmentCensus-View (IR only) 

    • SAH-InstructorSchedule-View (IR only) 

    • SAH-InstructorScheduleCensus-View (IR only) 

    • SAH-MajorMinorDetail-View 

    • SAH-MajorMinor-View 

    • SAH-MajorMinorNarrow-View 

    • SAH-MajorMinorNarrowCensus-View 

    • SAH-Retention-View 

    • SAH-RetentionCensus-View 

    • SAH-RetentionDetail-View 

    • SAH-RetentionDetailCensus-View 

    • SAH-StudentHoldsNarrow-View 

    • SAH-StudentSchedule-View 

    • SAH-StudentStatsPerTerm-View 

    • SAH-StudentStatsPerTermCensus-View 

    • SAH-StudentWithdrawalNarrow-View 

    • SAH-WaitlistAudit-View 

Expanded records now included

Current PROD 

  • All records from ISIS and Med Hub (clinical residents).   

  • Includes records for admissions where the person never actually registered for classes. 

  • Historical to 2004 

New QA 

  • All records where the person has ever had a registration status, been a clinical resident, or received a degree. 

  • No historical filter.  All records from ISIS meeting the above condition are included. 

  • This is implemented for phase 1 data (Demographics / Student Stats Per Term). 

  • Other areas, such as Enrollment, will see this change in future phases. 

Additional Improvements

As the views that build SAH-Demographics and SAH-StudentStatsPerTerm were reviewed a number of areas of improvement were identified.

Country Name 

  • In our current production environment, the country name displayed represents the value at the time the event occurred leading to issues when trying to summarize things by country as values change. 

  • The new DEV0 implementation in QA presents the current country name for all rows – historical and current.   

Text fields 

  • All text field values have been trimmed to remove extra spaces. 

  • Aside from making the display of these fields cleaner, this trimming of values has resulted in better matching of code values for things such as calculated flags and lookups. 

Contact information 

  • This includes address, phone, and email fields. 

  • Prioritization of data information for source of record: 

    • Students – primary source is ISIS

    • Instructors – primary source is ISIS

    • Clinical Residents – primary source is Med Hub

Improved process for tracking changes to assure current data is displayed

Improvements across the following areas: 

  • Contact information 

  • Latest term selection 

  • Room capacity changes 

  • Highest Grade Point 

Improved detection of known deleted items

  • In the current ISIS environment there are items that are physically deleted from the underlying database causing issues if the data has already been loaded to HANA. 

  • In TSS it is expected by design that this will no longer occur and the records will be instead marked as deleted within the underlying database, rather than actually being deleted. 

  • The improvements in the DEV0 implementation are designed for processing ISIS data up until the TSS rollout. 

  • We have implemented this strategy for all fields where BIA is aware that the deletion is occurring.  There may be other items for which this process needs to be implemented, in which case we ask that you advise us that the deletion is occurring if you are aware. 

  • SAH will mark the field as deleted from ISIS but will not physically delete the item.

Instructor job data 

  • Enhanced logic to match EAH in selection of primary job record. 

Unit aggregation 

  • Issues were identified and resolve relating to a rounding process within calculated unit sums. 

Clinical Residents 

  • Improved process for detecting latest visa status 

  • Added ability to tie in historic academic events where resident was previously a student at UCSD. 

ITS Validation of Changes

The BIA team with assistance from volunteers performed the following change validation:

  • All records were compared to SAH production, discrepancies were identified and either resolved or included in the changes above.