To date, researchers in our network have conducted over 90 ongoing or completed randomised evaluations of social programmes and policies across 21 European countries, with a particular focus on the education and labour market sectors.
Here we highlight a selection of insights generated by these studies over the past decade.
Research conducted by J-PAL affiliates in Education in Europe has focused on narrowing the achievement gap for students from poor or marginalised backgrounds, including through promoting access to high-quality education for all, helping children develop skills associated with improved learning, increasing access to information about educational opportunities for both children and parents and providing targeted remedial education to help students catch up as needed.
Children from economically disadvantaged backgrounds or regions often have access to fewer resources—in and out of school—for academic success, and those from immigrant or minority backgrounds may face additional barriers. These factors can become obstacles to obtaining quality employment opportunities later in life.
A growing body of randomised evaluations has sought to understand what forms of targeted interventions can help better connect these students to school resources in an effort to improve learning outcomes and promote social mobility. A recent review of experimental evidence on tutoring programmes from North America showed that tutoring generally led to large improvements in student learning, particularly for students in earlier grades and when conducted during school by teacher or paraprofessional tutors.
Researchers measured the effects of offering free access to kindergarten, providing financial incentives to parents, and informing parents about the benefits of kindergarten.
While all three interventions led to increases in kindergarten participation, parental aspirations for their children, and household income, offering free access to kindergarten was the most cost-effective way to increase participation.
Initially the intervention led to a decrease in minority children’s learning, which was associated with a decrease in time children spent at home benefiting from activities with their parents and to a kindergarten curriculum not adapted to their needs. However, in a follow-up study three years after the intervention, the impact was shown to have reversed: kindergarten participation was associated with an improvement in minority children’s learning.
An extracurricular programme on perspective-taking—the ability to consider another person’s viewpoint—was delivered in classrooms to Syrian refugee students and their Turkish classmates. Researchers then tested whether participation in the programme could reduce anti-social behaviours, such as bullying, violence, and social exclusion. While aiming to foster social cohesion in schools serving both Turkish and Syrian refugee students, the programme never explicitly mentioned ethnicity.
Both refugee and host students who were part of the programme became less violent and showed higher levels of trust, reciprocity, and altruism towards their peers, mainly due to improvements in their perspective-taking and ability to control their impulsiveness.
The programme also helped refugee children improve their host language skills.
In Germany, researchers conducted several randomised evaluations2 of a low-intensity programme aimed at fostering informal learning and psycho-social development by providing primary school children with a high-skilled volunteer mentor for one year.
Providing a mentor increased children’s prosocial behaviour (i.e., behaviour intended to benefit others), helping close the gap between students from different socioeconomic backgrounds.
The programme also improved educational outcomes among children from low socioeconomic backgrounds, who received better teacher assessments and were more likely to enrol in more advanced secondary school tracks.
Four years after the intervention, children who had a mentor were more honest, as measured through a game involving predicting and reporting the outcome of rolling a dice, particularly for children whose parents have a less warm parenting style or are less trusting.
In Italy, in response to potential learning losses following the closure of schools at the outbreak of the Covid-19 pandemic, researchers evaluated the impact of an online tutoring programe on the academic outcomes of middle school students (grades 6 to 8) from disadvantaged backgrounds. The programme was delivered by volunteer university students for free and consisted of help with homework in three subjects: Math, Italian, English.
The researchers found that the programme increased academic performance, especially for students from lower socioeconomic backgrounds, and improved psychological well-being, particularly for immigrant children.
1Sacerdote, Bruce. 2011. “Peer effects in education: How might they work, how big are they and how much do we know thus far?” In Handbook of the Economics of Education, ed. Eric Hanushek, Stephen Machin, and Ludger Woessmannno, 3:249–277. Elsevier. doi: https://EconPapers.repec.org/RePEc:eee:educhp:3-04.
2Kosse, Fabian, Thomas Deckers, Pia Pinger, Hannah Schildberg-Hörisch, and Armin Falk. 2020. "The formation of prosociality: causal evidence on the role of social environment." Journal of Political Economy 128, no. 2: 434-467.
Falk, Armin; Kosse, Fabian; Pinger, Pia. 2020. "Mentoring and Schooling Decisions: Causal Evidence." IZA Discussion Papers, No. 13387, Institute of Labor Economics (IZA), Bonn.
Falk, Armin, Fabian Kosse, Hannah Schildberg-Hörisch, and Florian Zimmermann. 2020. "Self-assessment: The role of the social environment." CESifo Working Paper Series 8308, CESifo.
Abeler, Johannes, Armin Falk, and Fabian Kosse. 2021. "Malleability of preferences for honesty." CEPR Discussion Paper No. DP16164.
Researchers are increasingly exploring the role of non-cognitive skills—such as patience, self-control, and perseverance—in driving successful performance at school. Recent work has shown that these skills are indeed malleable in children and adolescents, and new evaluations are helping us understand how development of non-cognitive skills may help children perform better in certain learning tasks, set higher aspirations and exert more effort in learning. These interventions tend to have generally small, yet positive impacts, often at low costs.
Researchers conducted a computer-based intervention to measure the impact of a programme designed to encourage a “growth mindset” among students, as well as their subsequent effort in school.
After being exposed to the programme, students were more likely to believe intellectual ability is malleable, to seek out challenges, and to display improved academic performance three weeks later.
The intervention led to short-term improvements in academic performance among lower-performing students and among those who began the session with a fixed mindset and thus had limited confidence in their ability to learn. These findings suggest that students’ perseverance can be shaped by their beliefs in their ability to learn.
Researchers evaluated the impact of a low-intensity series of classroom discussions (three one-hour sessions per year for four years) on students’ beliefs and perceptions of their abilities to succeed in life.
The program’s effect was concentrated among girls; impacts on boys’ performance were insignificant.
Students exposed to the curriculum had higher scores in maths and were more likely to engage in challenging tasks, persevere after negative feedback, set goals, and engage in skill-building activities.
The programme also helped close the gender gap in student competitiveness by increasing girls’ willingness to compete.
Based on these results, researchers are now working with the Ministry to scale up the programme.
Providing information about schooling and encouraging parents to be more involved in their children’s education can be a highly effective, low-cost way to help students and their parents set more realistic expectations. However, the content of the information and student characteristics such as academic standing may be an important determinant of effectiveness for these programmes.
2Abdul Latif Jameel Poverty Action Lab (J-PAL). 2011. “Getting Parents Involved.” J-PAL Policy Briefcase. Last modified February 2011. https://www.povertyactionlab.org/publication/getting-parents-involved.
3Abdul Latif Jameel Poverty Action Lab (J-PAL). 2011. “School Communication Strategies and School Outcomes in France.” J-PAL Evaluation Summary. https://www.povertyactionlab.org/evaluation/school-communication-strategies-and-school-outcomes-france.
4Kuhnen, Camelia N. and Tymuła Agnieszka. 2012. “Feedback, Self-Esteem, and Performance in Organizations.” Management Science 58, no. 1 (August): 94–113. doi: https://doi.org/10.1287/mnsc.1110.1379.
Extensive research from other regions, including the United States and India, has shown how tailoring instruction to students’ learning levels—regardless of grade level—can be a powerful tool for helping narrow the attainment gap for students who have fallen behind. New research is evaluating different models for offering intensive learning support at different schooling levels.
Students experienced reductions in an overall measure of their well-being in their first year, as they faced separation from friends and family and a more demanding academic environment. However, they adjusted to their new environment by the program’s second year.
The boarding school also shifted students’ schooling choices over the longer term, leading them to opt for more selective baccalaureate tracks at the end of high school.
In Denmark, researchers evaluated the impact of a two-week, school-based intensive learning camp for low-performing students who were deemed ‘not ready’ for further education at the end of compulsory schooling (age 15-16). Researchers measured two versions of the camp: one focused on maths and Danish and one where 30 percent of time was dedicated to developing students’ non-cognitive skills.
The programme led to small improvements in academic outcomes 5 weeks later but these did not persist after one year.
The programme had no impact on participants’ non-cognitive skills. Researchers suggest that the reason why this programme may have failed to generate such impacts where others have succeeded (see “Shaping Minds”) could be linked to the older age of the students, and that non-cognitive skills might be less malleable among this age group.
A body of evidence from North America points to the potential power of nudges for shifting individual consumption habits.
In Europe, we look forward to generating more policy-relevant evidence on programmes and policies related to climate change, environment, and energy, with a particular focus on climate action. As part of this work, we published a blog post on the potential of rigorous evaluations to help European policymakers tackle climate change.
Research by J-PAL affiliates has evaluated the impact of financial services and products in helping households smooth consumption, make investments, and manage risk. Many of these studies have drawn on interventions evaluated in low- and middle-income countries elsewhere and sought to test their applicability in Europe. A separate stream of research has explored how changes to the ways that charitable organisations raise money can lead to increased donations.
Cash transfers, microcredit, and targeted remittances are financial management tools that can be useful in helping households face unexpected expenses and take advantage of opportunities.
Despite its potential to expand access to credit for low-income borrowers, traditional microcredit has not had a transformative impact on borrowers’ income and long-term consumption on average.
Researchers found that the amounts loaned were insufficient for households to finance their investments, leading households to reduce either their savings, when available, or their food consumption, to free up additional resources.
The loans also led to a decrease in school participation, as young adult children of microloan recipients spent more time working for the family business.
Remittances are one of the largest types of international financial flows to low- and middle-income countries and have been shown to improve educational outcomes of migrant workers’ relatives, as migrants tend to spend a large part of their income on the education of relatives back home.
Targeted cash transfers are another tool for reducing poverty and influencing household spending that have been evaluated in many contexts around the world. This global evidence suggests that the impact of these payments may depend in part on who in the household receives these payments.
5Karlan, Dean and Leigh Linden. “Loose Knots: Strong versus Weak Commitments to Save for Education in Uganda.” Yale University Economic Growth Center Discussion Paper No. 1037, Yale Economics Department Working Paper No. 12, April 2016.
6Benhassine, Najy, Florencia Devoto, Esther Duflo, Pascaline Dupas, and Victor Pouliquen. 2015. “Turning a Shove into a Nudge? A ‘Labeled Cash Transfer’ for Education.” American Economic Journal: Economic Policy 7, no. 3 (August): 86–125. doi: http://dx.doi.org/10.1257/pol.20130225.
Consumer protection remains central to financial inclusion efforts to ensure consumers can select and use the most appropriate financial products. However open questions remain on how consumers make financial decisions and how best to protect consumers.
Charitable organisations often rely on private donors to support activities that may advance the public good. How can choices charities make about how they ask for donations impact the amount of funds they are able to raise?
J-PAL affiliated researchers in Europe have evaluated a range of interventions designed to contribute to women’s empowerment, including through efforts to improve soft skills to reduce gender gaps among school children, provide cash transfers to increase women’s decision-making power, and promote gender equality in hiring.
European governments face an array of challenges related to labour markets, from a rising unemployment gap between persons with lower and higher levels of education, to large discrepancies in long-term unemployment rates across different European countries, to the rapidly changing nature of jobs.7 Many of these challenges are likely to grow in the wake of the Covid-19 crisis. To identify potential lessons to some of these challenges, J-PAL affiliates have conducted rigorous evaluations of programmes aiming to help jobseekers (re)enter the labour force, foster skills in entrepreneurship among youth, increase demand for labour, and reduce discrimination in hiring.
7Eurostat. 2020. “Unemployment statistics and beyond.” Eurostat Statistics Explained. Last modified June 25, 2020. https://ec.europa.eu/eurostat/statistics-explained/index.php/Unemployment_statistics_and_beyond#Unemployment_by_level_of_education.
Job search assistance programmes have generally been shown to be effective in improving employment outcomes for jobseekers in high-income countries, but questions remain about how to best structure this assistance. By partnering with public employment agencies across Europe, researchers have sought to answer what forms of assistance—and how much—jobseekers need.
Delivery method is another important aspect to consider when designing job search assistance programmes. Are individual programmes more effective than group ones? Can private providers deliver these programmes more effectively than public actors?
8Countries include Germany, Sweden, Finland, Denmark, and the United Kingdom. For more information, please see Behncke, Stefanie, Markus Frölich and Michael Lechner. 2009. “Targeting Labour Market Programmes – Results from a Randomized Experiment.” Swiss Society of Economics and Statistics 2009, no. 145(3): 221–268. doi: http://www.sjes.ch/papers/2009-III-1.pdf.
Evidence from two studies suggests that where available jobs are scarce, job placement programmes may have unintended displacement effects: The recipients of these services may obtain jobs at the expense of non-participants, leaving the latter potentially worse off than before the programme.
Another policy strategy to increase employment may be to stimulate firms’ demand for labour through interventions that target firms’ recruitment costs. Efforts to trigger increased demand in markets where it is low may be an alternative strategy that is potentially more cost-effective and less likely to create negative displacement effects as some job search assistance programmes mentioned above.
Evaluations of programmes designed to foster entrepreneurship in Europe have shown mixed results and have not generally led to an increase in business creation. In France, two seemingly similar entrepreneurship interventions targeting young people from lower socioeconomic backgrounds showed different impacts on youth employment:
Research suggests there are many instances of hiring discrimination against minority and underrepresented groups on the basis of factors such as race, ethnicity, immigration status, gender, religion, and sexual orientation. Randomised correspondence studies, in which researchers send out fictitious resumes to job openings to test responses, have found cases of discrimination in a number of European countries, including Czechia, France, Germany, Ireland, Italy, Sweden and the Netherlands.
One proposed policy response to address this kind of hiring discrimination has included removing identifying information from job applications, but the impact of such measures appears to depend on the characteristics of hiring firms, namely whether they were discriminating against minority groups in the first place.
Research by J-PAL affiliated researchers in Europe in the Political Economy and Governance sector has focused on evaluating measures to increase electoral participation across Europe as well as how simple tweaks to how governments collect taxes can increase compliance.
To identify potential mechanisms to improve voter participation in Europe, a number of studies have measured the impact of various partisan and nonpartisan information campaigns on citizens’ electoral participation, including voter registration, turnout, and election results.
In France, researchers evaluated the impact of organising home visits to facilitate voter registration by providing unregistered voters with information or assistance regarding the registration process. These visits increased both registration and engagement, suggesting that lowering registration costs can encourage participation. This was particularly true for groups who may be less engaged in elections (including immigrants and those who spoke a language other than French at home).
The salience and strength of national identity (including as compared to individual regional identities) can play an important role in shaping the nature of individuals’ political participation.
In Spain, researchers estimated the impact of the temporary exposure of men performing compulsory military service to individuals from different regions. Before compulsory service was abolished in 2001, young Spanish men were assigned to different regions for military service at random.
They found that increased exposure to individuals from different regions led to improved sentiments and attitudes towards people from the region of service.
This effect was stronger among individuals who originated from regions with strong secessionist movements, for whom sustained interactions with people from different regions also led to an increase in national identity sentiments.
Despite being the main source of national revenue and of funding for public goods, tax is often imperfectly collected. To help countries increase tax compliance, a series of studies have tested the effect of shifting how their communications are framed and simplifying steps for compliance.
Efforts to promote social inclusion can take many forms: from programmes to reduce obstacles to educational achievements for children, to labour market policies focused on improving the employment prospects of all, and to measures to better meet the health and housing needs of disadvantaged communities.
In launching the European Social Inclusion Initiative in 2019, J-PAL Europe reviewed a broad range of evidence generated from evaluations of different programmes and policies designed to help break the intergenerational transmission of poverty. A short four-page summary of the review's key insights and priority research questions can be found here.
To learn more about our work on social inclusion, see our European Social Inclusion Initiative page.