Find information about

Related documents

Guide to How We Regulate
(17/11/2008)
Guide to how we regulate page more...

Governance Matters
(01/09/2008)
Governance Matters Report (PDF) more...

Performance Standards
(14/03/2008)
Performance Standards page more...

How we work

Section 2 Key principles of quality in research and consultation

2A Assessing quality in research and consultation

Social landlords will often need to assess the quality of research and consultation. Figure 2.2 proposes some criteria by which to assess both quantitative and qualitative research, principally for use with written research outputs. They are not meant to be applied rigidly or prescriptively, but are an aid to informed judgement, which must also draw on professional experience and the weighting that might be given to particular criteria in specific contexts. Further guidance on the assessment of qualitative research is available elsewhere(1).

It is suggested that the findings of the research are given attention first, as this will assist in assessing features of the research and consultation process.

Figure 2.2 Criteria for assessing quality in research and consultation

Findings and interpretation

    • Are the findings based in the evidence presented, or do they draw inferences based on external material or opinion? If so, is this clearly stated?

    • Do the conclusions/findings make sense and have a coherent logic?

    • Does the research explain key concepts and definitions that it employs?

    • Does the research address the aims and objectives as set out in the brief or as redefined during the study?

    • What is the scope for drawing wider inferences from the findings and how well is this explained?

    • Is there any reason to think that the evidence presented here may not be applicable in other contexts or not apply to particular groups of people? (e.g. urban/rural; men/women)

    • Is there any reason to think that important contextual or other factors may have altered since the research was undertaken?

Research design, sampling and data collection

    • Is the case made for different features of the research design to meet the aims of the study?

    • Were the research methods used appropriate to the questions being asked?

    • How appropriate is the sample design or selection of cases?

    • Were the methods conducted properly – is there information on how the approaches were implemented? (e.g. response rates for surveys, sampling information, copy of questionnaires/questions used).

Analysis

    • Has comprehensive, appropriate and accurate analysis been conducted?

    • Are the issues considered from a range of perspectives?

Reporting and action

    • How clear and coherent is the reporting?

    • Is there a clear link between the data, interpretation and conclusions?

    • Are the key messages highlighted and summarised?

    • Are the research outputs presented in an appropriate format for the audiences?

    • Does the research identify the implications for practical action in terms of service delivery?

Reflexivity and objectivity

    • Are the assumptions, theoretical perspectives and values that have shaped the research made explicit?

    • Is there evidence of openness to new and alternative ways of viewing the subject?

    • Is there awareness of the limitations of the approach, methods and evidence and discussion of possible bias?

Ethics and access

    • Were appropriate ethical guidelines adhered to? (eg. confidentiality, anonymity, informed consent)

    • Is there evidence of sensitivity to the particular context and participants?

    • Did the research make provision to enable the participation of all relevant parties?

    • Did the researchers have sufficient level and type of experience to undertake the research?

Audit

    • Has the research process been well-documented?

    • Is there documentation and discussion of changes to the research design?

    • Are the main study documents included?

_________________________________

(1) Quality and Qualitative Evaluation: A framework for assessing research evidence, Liz Spencer et al, Cabinet Office, 2003

Previous page Next page