Sector Evaluation Framework

Designed as a two-tiered framework, the Sector Evaluation Framework tracks quality of life broadly at the sector level while providing a bank of robust indicators for each subsector to cater to the sector's diversity. 

sector-evaluation-framework-graph

Tier 1: Quality of Life 
The ultimate objective of the social service sector is to improve the lives of vulnerable groups that we serve. Hence, well-being or 'Quality of Life' (QOL), is an appropriate overarching goal common to all of the services and programmes in the sector, regardless of service user profile or service model. Using the QOL measure, we can also track the broader progress of our vulnerable groups. The current QOL measures are tabulated below: 

Name

What is Measured

Availability

Measure Type

Number of items

Duration to Complete

Domains

WHOQOL-BREF

Quality of life

Free

Self-report

26

<10 mins

Physical health; Psychological health; Social relationships; Environmental health; Level of Independence; Personal Beliefs

KIDSCREEN

Quality of life

Free

Self-report, Proxy for U7

30

<15 mins

Physical well-being; Psychological well-being; Moods and emotions; Autonomy and parent relation; Financial resources; Social support and peers; School environment; Social acceptance (bullying)

 

Tier 2: Metrics Bank
The Metrics Bank is repository of common outcome metrics that SSAs can choose from. For similar programmes with similar intended outcomes, NCSS identifies a metric for SSAs to use for evaluation. In this way, SSAs will be able to measure their programme outcomes using robust measures, and as a sector we achieve consistency in how programme outcomes are measured. The current Metrics Bank measures are tabulated below.

Name

What is Measured

Availability

Measure Type

Number of items

Duration to Complete

Domains

Zarit Burden Interview

Perceived caregiving burden

Free

Self-report

6-item version

<2 mins

 

Pearlin Mastery Scale

Assesses one aspect of psychological coping resources (Mastery).

Free

Self-report

7

<2 mins

 

ACT SG

Measures 13 core skills for success in school/life

Free

Self-report

39

>

<15 mins

Achieving tasks; Connecting with others; Thriving as a person

Social Provisions Scale

Perceived social support

Free

Self-report

10-item version (full version 24 items)

<5 mins

Guidance; Reassurance of Worth; Social integration; Attachment; Nurturance; Reliable Alliance

Work Self Efficacy Scale

Perceptions of self efficacy at work

Free

Self-report

10

< 5 mins

 

NCSS is currently exploring and testing measures in the domains of family relationships and functioning, employment, and general and mental health counselling. We will add more measures as new programme types and subsectors emerge, and are open to explore other domains or measures that social service agencies feel may be useful. Interested agencies may contact us at research@ncss.gov.sg.

Implementation
Since the launch of the Sector Evaluation Framework in Sep 2021, NCSS has engaged more than 100 social service agencies, funders / grant makers, Government agencies, and sector stakeholders at both large scale and one-to-one platforms. 

To allow for smoother transition, the Sector Evaluation Framework will be implemented gradually, starting with a select pool of programmes and social service agencies based on their funding renewal, research and evaluation capability, and strategic importance. We expect to fully onboard 38 programmes, covering more than 5,000 service users by the end of 2021. Progressively, we seek to roll this out to all social service agencies in the coming years.

The Sector Evaluation Framework allows social service agencies to validate their programmes and services, ensures programmes are effective and resources are allocated appropriately, therefore leading to better service quality and outcomes for the service user.