Maximising the value of survey data in adult social care (MAX)

The Adult Social Care Survey (ASCS) and the Personal Social Services Survey of Adult Carers in England (PSS SACE, widely referred to as the Carers Survey) capture data on the quality of and outcomes from social-care services for all publicly-funded social care service users and (informal) carers. These data are used to populate indicators in the Adult Social Care Outcomes Framework (ASCOF) which are used by central government to monitor the quality of social care.

All local authorities (LA) in England are required to run the ASCS and PSS SACE as part of the data returns to the Health and Social Care Information Centre (HSCIC) and are encouraged to use the data to inform local social-care related planning and service improvements. Informal feedback from LAs, however, indicated that staff from all groups and within many organisations are not engaging with the surveys and/or are making limited local use of the data. Preliminary and anecdotal evidence suggests a number of reasons for this: (1) Some LAs report that the data are not useful because the survey does not ask the right questions; (2) Careful analysis is required to interpret the data accurately, and particularly to establish the impact of services; (3) LAs work with increasingly limited resources and a decision to invest in the surveys potentially means a cut elsewhere.

Aims

The aims of the Maximising the value of survey data in adult social care (MAX) project were twofold: first, to find out more about the challenges to collecting and using ACSC and PSS SACE data faced by LA staff and the local practices implemented to overcome them; and second, to develop resources to help LAs maximise the relevance, value and use of survey data for local planning and performance improvement (as indicated by more positive ratings of service-user- and carer-reported outcomes in the longer term). It was envisaged that such resources would be provided in the form of a toolkit, consisting of practical guides and tools, and would be developed in collaboration with LA staff.

Methods

Five research activities were conducted during the initial fact-finding stage of the project to: [1] explore the key challenges faced by LA staff in collecting and/or using the data; [2] identify the practices implemented by LAs to overcome challenges and/or maximise the local value and/or use of the data; and [3] establish the kinds of support LA staff would like the MAX project to provide. These activities were completed by 139 staff from 95 upper-tier LAs between December 2012 and December 2014 and are summarised in Table 1 below.

QORU - MAX summary (TABLE 1)

Findings

The initial fact-finding research activities found that some LAs were implementing local practices and solutions to maximise the local value and use of ASCS and PSS SACE data within their organisation. For example, adding questions to the surveys or conducting further analysis on the survey data to fulfil local information needs. Many LAs, however, were experiencing a range of barriers and challenges to collecting and using ASCS and PSS SACE data. Some barriers were associated with key stages of the survey process. For example, identifying local information needs and the most appropriate strategies for fulfilling them using survey data and existing resources (planning and analysis stages); knowing how to navigate and analyse survey data (analysis stage); and making sense of analysis findings, such as the significance of direct-benchmarking comparisons and/or the potential reasons underlying reported outcomes (interpretation stage). Other barriers affected all stages of the survey process and included insufficient time and resources, widely held perceptions about the purpose and local value of ASCS and PSS SACE data, and a lack of engagement among key survey stakeholders within the organisation. These local practices and barriers are discussed in the MAX working paper, further analysis case study report and a series of blogs.

The MAX Toolkit

The findings of these initial fact-finding activities were used to inform the development of the MAX toolkit which aims to support LA staff to maximise the relevance, value and use of ASCS and PSS SACE data for local performance improvements. The MAX toolkit consists of guides and tools associated with the key stages of the survey process and (stakeholder) engagement throughout (see Figure 1 below) and is designed to supplement existing survey guidance provided by the Health and Social Care Information Centre (HSCIC).

QORU - MAX summary (FIGURE 1)

A draft version of the MAX toolkit was reviewed by a group of LA collaborators between December 2015 and April 2016. The feedback provided through this consultation was used to make minor refinements to individual elements (e.g. guides and tools) and further work by the project team improved the overall accessibility and practicality of the toolkit.

An online version of the MAX toolkit will be made available to LA staff in June 2016. See the project website www.maxproject.org.uk for further information.

Outputs

Alongside the MAX toolkit, the project also produced a number of papers and blogs. These are summarised below along with a journal article that is currently in planned submission.

Outcomes-based performance management in practice: a case study of local authority use of self-reported quality of life data to inform adult social care service delivery in England – to be submitted to Health and Social Care in the Community

Heath C, Razik K, Jones K, Beecham J, Forder J, Malley J (2015), Further analysis of ASCS and PSS SACE data: Case studies of local authority (LA) practice. PSSRU discussion paper 2897, Canterbury [LINK]

Heath C, Malley J, Razik K, Jones K, Forder J, Fox D, Caiels J, Beecham J (2015), How can MAX help local authorities to use social care data to inform local policy? Maximising the value of survey data in adult social care [MAX] project. MAX working paper. PSSRU discussion paper 2896, Canterbury [LINK]

Heath C, Malley J, Razik K, Jones K, Forder J, Fox D, Caiels J, Beecham J (2015), How can MAX help local authorities to use social care data to inform local policy? Maximising the value of survey data in adult social care [MAX] project. Executive summary of MAX working paper. Canterbury [LINK]

Razik K, Beecham J (2015), Review of factors important in use of survey data for quality and performance improvement: report from literature review. PSSRU discussion paper 2898, Canterbury [LINK]

A series of blogs were also posted on the project website and can be accessed here.

Research Team

Julien Forder, Karen Jones, Clara Heath and Danielle Roche
Juliette Malley, Stacy Rand, Kamilla Razik, Jennifer Beecham, Diane Fox and James Caiels

Future Research

A new project will commence in June 2016 to oversee the implementation and evaluation of the MAX toolkit. Further details will be added to the QORU website in due course.

Research Team

Julien Forder, Karen Jones, Clara Heath and Danielle Roche

For further information please look at the project website www.maxproject.org.uk or contact the MAX team at maxproject@nullkent.ac.uk.