MODULE 5: MEASURING IMPACT

5.1         INTRODUCTION AND LEARNING OBJECTIVES

Module 4 described how to empirically verify a project’s impacts by using qualitative methods. The next
step in social impact measurement is to quantify the identified effects. Therefore, the aim of this module
is to explain how to select which identified impacts to measure and how to measure them.

After explaining the scientific criteria in quantitative research, we elaborate on the possibilities and limits
of different research designs. Next, we explain how the study’s purpose, time, and financial resources
available, the existence of secondary data, study context (e.g., culture, region), and stakeholders’
characteristics affect the study design. Knowledge about the possibilities and limits of possible research
design allows selecting the most appropriate data collection and data analysis method. Finally, we explain
how the measurement of the impacts can be presented and used, for example, in management control.

5.2         CONTENT

 

1. Purpose of measuring the impact

2. Scientific criteria for quantitative research

3. Research approaches, possibilities, and limits

4. Data collection

4.1. Types of data (quantitative and qualitative; primary and secondary)

4.2. Methods (surveys)

4.3. Guidelines for data collection

5. Data analysis

5.1. Outcomes

5.2. Deadweight and impact

6. Presentation and use of the outcomes and impacts measured

5.3         LEARNING OUTCOMES

 

After completing this module, the participants are able to:

      explain the importance of measuring impact and the need for it;

      identify cases where you need to measure impact and cases where you do not;

      describe the possible approaches to collect and analyse data to measure impacts;

      select/propose the most suitable approach to measure impact in a specific context.

5.4         TEACHING METHODS

 

Lectures, demonstration through case-study analysis, discussion, group or individual practical work on case studies, presentations.

Possibility of blended learning and flipped classroom: lectures and demonstration of case studies online; discussions, practical work, and presentations offline.

5.5         ASSESSMENT

 

Assessment and feedback is based on the case-study work and presentation by participants.

5.6         STUDY MATERIALS

 

      Lecture slides

      Case studies

      Then et al. (2017). Social Return on Investment Analysis. Measuring the Impact of Social Investment. Chapter 6, Chapter 7, Chapter 9.

      The Guide to Social Return to investment (2012), The SROI Network. Stage 3 and Stage 4

      Nicholls, J., Lawlor, E., Neitzert, E., & Goodspeed, T. (2009). A guide to social return on investment. Office of the Third Sector, Cabinet Office.

      Arvidson, M., Lyon, F., McKay, S., & Moro, D. (2010). The ambitions and challenges of SROI. Working Paper. TSRC, Birmingham, section 4.6