Social innovation and its impacts in disadvantaged rural areas: a new evaluation framework

An agreed and well-consolidated evaluation framework for the assessment of social innovation (SI) and its impacts has not been developed yet, despite tentative made by scholars (e.g., Nicholls et al. 2015). The EU funded H2020 project SIMRA – Social Innovation in Marginalised Rural Areas (www.simra-h2020.eu) – aims to conceptualize an evaluation framework for SI initiatives in disadvantaged rural areas of Europe and non-EU Mediterranean countries. Within SIMRA, SI is defined as “the reconfiguring of social practices, in response to societal challenges, which seeks to enhance outcomes on societal well-being and necessarily includes the engagement of civil society actors” (Polman et al., 2017). The evaluation framework has been co-constructed with project partners and a panel of international stakeholders in the fields of agriculture, forestry and rural development (Nijnik et al. 2019). It is structured into dimensions and sub-dimensions. It follows the phases of a SI initiative, from the trigger that generates the idea, to the reconfiguring process, and to its impacts. Eight tools for data collection have been developed, tested in pilot cases, and applied in 11 case studies. Empirical results allowed to set 166 indicators: 73 indicators describe the SI dimensions; 63 indicators analyse the process, the project and the whole SI initiative by following relevance, efficiency, effectiveness, impact and sustainability evaluation criteria (OECD, 1991 and 2010); 30 indicators focus on the key aspects of the SI SIMRA definition. Social Network Analysis helps in visualizing the increasing collaborative network of actors involved in the SI process, from core group composed by innovators and followers, to the reconfigured network with new project partners. The approach integrates qualitative-pure methods (e.g., focus group) with quantitative ones. The proposed evaluation framework would like to contribute to current debates, both within the scientific and practitioners’ communities, on evidence-based policy and self-evaluation by rural development agencies.