A mid-term evaluation of the EU Framework was carried out in response to the Council Conclusions of 8 December 2016. It covers the 2011-2017 period and assesses the relevance, coherence, effectiveness, efficiency, coordination, equity, sustainability and the EU added-value of the framework. The evaluation is based on an extensive desk review of secondary literature, reports and databases, 11 in-depth country studies, interviews with stakeholders in 16 other EU Member States, interviews at EU level and in three enlargement countries, an open public consultation, a survey among non-governmental organisations, 2016 survey data from the Fundamental Rights Agency (EU-MIDIS II) and a validation workshop.
The evaluation, inter alia, concluded that the four priority areas (employment, education, health and housing) continue to be key for Roma inclusion. However, a specific non-discrimination goal alongside the four Roma integration goals and a stronger focus on the fight against antigypsyism should complement the inclusion approach more forcefully.
The evaluation found, that the framework had a positive EU added value by putting Roma inclusion on the EU and national agendas, developing structures and increasing coherence between EU policy, legal and funding instruments that have been mobilised and aligned for Roma inclusion.
The evaluation noted that the framework provided flexibility to Member States to adapt their objectives to specific national contexts. While this allowed Member States to follow a tailored approach, the evaluation found that it contributed to fragmented implementation, reducing effectiveness, and limiting progress towards EU Roma integration goals.
The evaluation also concluded that the framework had limited capacity to deal with diversity within the Roma population. It did not pay sufficient attention to targeting specific groups among Roma (Roma women, youth, children as well as EU mobile Roma).
Finally, the evaluation found that governance mechanisms are in place at the EU and national level, but that their function is still limited. Civil society participation has been fostered, but Roma still have only limited opportunities to participate effectively in political life and in all stages of the policy process.
On 5 September 2019, to complete the picture, the Commission adopted its most recent report on national implementation of Roma inclusion measures. The main sources of the assessment are :
- reports from National Roma Contact Points (NRCPs) ;
- civil society reports from the Roma Civil Monitor EP Pilot project ;
- data on the situation of Roma from the EU Agency for Fundamental Rights (FRA) ;
- a meta-evaluation on Roma inclusion interventions (European Commission, Joint Research Centre, forthcoming 2019)
The Communication summarises the most important trends focusing on the four policy areas of the EU framework (education, employment, health, housing), as well as fighting discrimination and antigypsyism. In each area, the Communication highlights the situation of Roma, summarises the main types of inclusion measures, achievements and challenges of their implementation (as reported by NRCPs) and formulates policy learning in terms of promising approaches and priorities to be addressed.