Data Analysis Learning Resources

Data Refresh Rate

As the use and complexity of the data analysis tool evolves, some changes have been necessary to ensure the tool continues to have a high level of performance. As a result, the time from when a user changes data in Clarity Human Services to when those changes appear in the data analysis tool may not occur in real-time.

The data refresh rates fall into the following categories:

  • Real-time
  • Persist: Current when initially accessing the data analysis tool, then will persist for the pre-defined amount of time until refreshed
  • Triggered: Refreshed at pre-defined time(s) during the day

The following table identifies the various models and views that use either the Persist or Trigger method of refresh and the rate at which the data is refreshed. For efficiency reasons, all "Training" and "Mig" instances of the data analysis tool only refresh once per week.

Note: Custom fields may be impacted by refresh rates.

View Name

Model(s)

Persist for

Trigger

Chronic Homeless
  • Client
  • Coordinated Entry
  • Data Quality
  • HMIS Performance
  • Population Over Time  
  Refreshes once per day at midnight, Pacific
Household Move-In Date
  • Client
  • Coordinated Entry
  • Data Quality
  • HMIS Performance
  • Population Over Time  
  Refreshes every hour starting at midnight, Pacific

Client Program Screening Base

Affects changes to the screens data for:

  • Update
  • Exit
  • Follow-up
  • Client
  • Coordinated Entry
  • Data Quality
  • HMIS Performance
  • Population Over Time 
  Refreshes every two hours starting at midnight, Pacific
Determinable Households
  • Data Quality
  • HMIS Performance/SPM
  Refreshes once per day at midnight, Pacific
DQ Data Error Applies to Program
  • Data Quality
24 hours  
HoH Client Location
  • HMIS Performance
  Refreshes every two hours starting at midnight, Pacific
Household Screens
  • Client
  • Coordinate Entry
  • Data Quality
  • HMIS Performance
  Refreshes every hour
Household Screens - Area Median Income
  • Client
  • Coordinate Entry
  • Data Quality
  • HMIS Performance
24 hours  
Import Files
  • Data Import
  Refreshes once per day at midnight, Pacific.
Inbound Recidivism
  • HMIS Performance
  • Population Over Time
  Refreshes once per day between 10 - 11pm, Pacific 
Outbound Recidivism
  • HMIS Performance
  • Population Over Time
  Refreshes every two hours starting at midnight, Pacific
Outbound Recidivism Homeless System Reentry
  • HMIS Performance
When the "Reentry Project Type Filter" is NOT used in the query then the data persists for 10 minutes. When the "Reentry Project Type Filter" is used in the query then the refresh rate is the same than the "Household Move-In Date" view.
Reservation Slots
  • Reservation
  Refreshes every two hours starting at midnight, Pacific
System Performance Measure 1
  • HMIS Performance/ SPM
  Refreshes once per day at midnight, Pacific
Client Care Team Members
  • Client
  • Coordinated Entry
  • HMIS Performance
  Refreshes every two hours starting at midnight, Pacific

Geolocations - Individual/Encampment

  • Outreach
  Refreshes every two hours starting at midnight, Pacific

Geolocations - CoC

  • Outreach
30 minutes  

Services - Is Latest Service Based on Enrollment

  • Client
  • Coordinated Entry
  • Data Quality
  • HMIS Performance
  • Services
  Refreshes every two hours starting at midnight, Pacific

Population

  • Population Over Time
  Refreshes once per day at midnight, Pacific

Screens

  • Project Descriptor
  Refreshes once per day at midnight, Pacific

Coordinated Entry Event - Is Latest Event per Client? (System Wide)

  • Client
  • Coordinated Entry
  • Data Quality
  • HMIS Performance
30 minutes  

Client Assessments:

- Is First Assessment per Processor

- Is First Assessment per Client

-Is First Assessment per Kind

  • Client
  • Coordinated Entry
  • HMIS Performance
  • Service
30 minutes  

Client Assessments - Is Last Assessment per Kind

  • Client
  • Coordinated Entry
  • HMIS Performance
  • Service
10 minutes  

Client Assessment Enrollments

  • Coordinated Entry
  • HMIS Performance
The system could take up to 30 minutes to assimilate the deleted records.  

Entry Screen - Disability Information (Multi-Row)

  • HMIS Performance
30 minutes  

Members:

- New Clarity Interface Last Switch

- Clarity 2.0 Interface Last Switch

  • Client
  • Coordinated Entry
  • Data Quality
  • HMIS Performance
  • Project Descriptor
  • Service
30 minutes  

Encampments Boundaries - Is Last Boundary per Encampment

  • Outreach
24 hours  

DQ Client UDE

All the error dimensions and measures into the "Veteran Information Errors" groups.

  • Data Quality
24 hours  

DQ Client Program Specific

All the error dimensions into the "SSVF and VA" group.
All the  error measures into the "SSVF Error Counts" group

  • Data Quality
24 hours  

Inventory and Outreach Modules

Inventory and Outreach module updates can take up to 30 minutes to appear in Looker once changed in Clarity. Original data will populate the Look until the updated data appears in Looker. 

 

 

Updated: 04/13/2023