The Evaluation Policy approved by the Committee of Ministers in 2019, foresaw an external peer review in 2022. The Peer Review Report prepared by the independent panel of experts on the evaluation function of the Organisation, as well as the management response and action plan, are now available and published.

Overall, the findings revealed that the evaluation function in the Council of Europe has been noticeably strengthened over the past years. Whilst the organisational evaluation culture has improved, the review found that it was still not mature. Recommendations were made to:

• Optimise the selection of evaluation subjects by inviting the Secretary General, Committee of Ministerand senior management to propose evaluation topics;
• Assure coverage of the evaluation universe, including the Parliamentary Assembly of the Council of Europe, the European Court of Human Rights standard setting and monitoring mechanisms;
• Enhance resources for evaluation by earmarking a percentage of the total budget of the Council of Europe;
• Strengthen the usefulness of evaluation reports through better stakeholder engagement and learning products;
• Strengthen the visibility and authority of the Evaluation Division;
• Invest more in decentralised evaluations by increasing their coverage, resources and capacities; establishing a simple criterion for mandatory evaluations, strengthening their independence, establishing focal points and publishing final evaluation reports.

The independent peer review panel was made up of:

• Mr. Arild Hauge, Chair of the Peer Review Panel, former Deputy Director of the lndependent Evaluation Office of UNDP, Oslo
• Ms. Claudia lbarguen, Peer Review Panel Member, Head of Evaluation at UNESCO, Paris
• Mr. Guy Thijs, Peer Review Panel Member, Director, Office of Evaluation, ILO, Geneva
• Mr. Urs Zollinger, Peer Review Consultant, Evaluator, Zurich

Related links:

• Peer Review Report of the Council of Europe Evaluation function 
• Management response and action plan

The report on the Evaluation of the Council of Europe’s support to member states in addressing challenges related to the Covid-19 pandemic, as well as the management response and action plan are now available on the webpage of the Directorate of Internal Oversight (DIO).

The purpose of the evaluation was to assess the extent to which the Council of Europe’s programmatic response to the crisis through its support to member states assisted them in fulfilling their commitments to maintaining human rights, rule of law and democracy in the context of threats and challenges posed by the pandemic.

Overall, the findings reveal that the Council of Europe was able to respond despite little preparedness for a crisis of such magnitude.

The evaluation provides a number of recommendations to further strengthen institutional capacity to manage crisis, to optimise the Organisation’s crisis preparedness and to reinforce the strong resilience the Organisation demonstrated during the pandemic.

The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.

Related links:

• Evaluation report on the Council of Europe’s support to member states in addressing challenges related to the Covid-19 pandemic
• Abridged version
• Key takeaways
• Management response and action plan
• Infographics (facts and figures)

The evaluation report on the Council of Europe’s monitoring mechanism as well as the Management response and Action plan are now available on the webpage of the Directorate of Internal Oversight (DIO).

The purpose of the evaluation was to assess the Council of Europe’s monitoring mechanisms with a view to identify lessons from past experiences and good practices and to make recommendations on how their relevance, effectiveness, efficiency and added value can be improved. The evaluation also looked at possibilities of developing synergies and benchmarked against mechanisms in other organisations.

The evaluation found that while monitoring mechanisms are very relevant, generally effective, efficient and high in added value, some aspects could be improved to further increase their effectiveness and efficiency.

The report recommends to:

• further strengthen follow-up given to recommendations of monitoring mechanisms and direct dialogue with member states,
• ensure there is a forum for discussing good practices and working methods,
• explore further increasing the co-operation and co-ordination, including the links between the monitoring and co-operation dimensions,
• enhance gender mainstreaming and consideration of equity,
• increase the accessibility and the visibility of monitoring mechanisms’ products and ensuring that necessary resources are provided to them.
   

The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.

Related links:

• Evaluation report on the Council of Europe’s monitoring mechanism
• Management response and action plan
• Infographics (facts and figures)

The report on the Evaluation of the Council of Europe’s work under the sub-programme Violence against women and domestic violence (VAWDV) (2016 to 2020), as well as the management response and action plan are now available on the webpage of the Directorate of Internal Oversight (DIO).

The objectives of the evaluation were to draw lessons on how the Council of Europe’s standard setting, monitoring, cooperation and partnerships have contributed to changes towards the elimination of VAWDV, and to inform the Organisation in its future decision making.

The evaluation finds that the holistic approach of the Istanbul Convention to VAWDV requires continuous learning and coordination, both within the Council of Europe and in the countries which implement it. This continuous learning process is long and demanding, but there is gradual progress linked to the Convention, its monitoring, and related cooperation programmes.

The evaluation report makes a number of recommendations. In order to further optimise its work, the sub-programme needs to sharpen its focus, building on the Council of Europe’s legal innovation trademark, to expand its synergies with other international organisations and international civil society organisations, and rally further supporters.

The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.

Related links:

• Evaluation report: Violence against women and domestic violence (2016-2020)
• Management response and action plan
• Facts and figures (Infographics) 

The report on the Evaluation of the European Commission for Democracy through Law (Venice Commission), as well as the management response and action plan are now available on the webpage of the Directorate of Internal Oversight. 

The aims of the evaluation were to assess the Venice Commission’s relevance, effectiveness and efficiency for the period 2016-2020 and evaluate its impact since its establishment in 1990.  The report’s findings contribute to decision-making needs and provide recommendations to support learning opportunities, innovation and change for the Venice Commission.

The evaluation found that the Venice Commission is a highly relevant body of the Council of Europe, but that it requires additional resources to maintain its high standards and quality of work. Recommendations address strategic as well as operational issues, such as clarifying the rules of procedure and internal working processes; revising the process for the appointment of members; strengthening internal and external communication efforts; increasing the dialogue-based approach with member states as well as developing an internal monitoring and evaluation framework to measure impact of its work.

The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.

Related links:

• Report on the Evaluation of the European Commission for Democracy through Law (Venice Commission)
• Management response and action plan
• Infographics (facts and figures)

An organisation-wide pool of evaluation consultants has been established through a Framework Contract valid until 30 June 2026 (Contract No. 2021/FC/01).

The pool of evaluators, established by the Directorate of Internal Oversight is part of the decentralised evaluations quality assurance framework, enabling all entities to select evaluation consultants with strong qualifications and experience, as well as thematic and geographic expertise.

The Framework contract aims to support the implementation of evaluations/evaluation-related assignments and is divided into the following:

• Lot 1:  implementation of or contribution to an evaluation,
• Lot 2: provision of evaluation-related consultancy services (e.g. Monitoring and Evaluation (M&E) advice, theories of change, evaluation quality assurance, trainings, etc).
   

Evaluation consultants from the pool can be called upon by simply submitting an order form to the selected Service Provider(s).

As part of the framework, entities are requested to provide to the DIO the Terms of Reference for the planned tasks stating the required consultant expertise. The DIO will review the ToR and propose suitable consultants including their CVs.

Detailed instructions on the steps that MAEs are to follow when calling upon an evaluation consultant can be found in the following information note.

Related links:

• Information Note on the Procurement of Consultants for Decentralised Evaluations
• Website on decentralised evaluations

The report on the evaluation of the Council of Europe’s Conference of International Non-Governmental Organisations (INGOs) as well as the management response and action plan are now available on the DIO webpage.

The evaluation aimed to assess the relevance, effectiveness and added value of the Conference’s support to INGOs within the Council of Europe.

The evaluation findings show that the Conference is a unique civil society consultation mechanism whose institutional role remains insufficiently defined. The report underlines that it is crucial for the Conference to maintain and enhance the quality of its activities, the level of commitment and the diversity of its membership, while deepening the Conference's synergies with other relevant actors.  The Council of Europe should ensure an adequate level of support to the Conference to achieve these objectives.

The evaluation makes a number of recommendations:

• At strategic level, recommendations concern the definition of the mission statement, alignment of the Conference’s priorities and objectives with the Council of Europe’s Programme and Budget and resources required to achieve these objectives.
• At operational level, recommendations concern the strengthening of co-operation during and between sessions, reassessment of eligibility criteria, cooperation with national NGOs, development of a communication strategy, and more active cooperation with PACE.
   

A management response and action plan in respect of the recommendations has been prepared by the Secretariat and is available on the DIO website together with the report.

The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.

Related links:

• Conference of INGOs Evaluation report
• Management response and Action plan
• Infographics (facts and figures)

The report on the evaluation of the Council of Europe’s work under the programme line “Prisons and police” 2016-2019 as well as the management response and action plan are now available on the DIO webpage.

The evaluation assesses the relevance, effectiveness and added value of the programme line. It looks at the standard-setting and co-operation work that, along with monitoring, form the three elements of the Council of Europe’s dynamic triangle.

The evaluation finds that the Council of Europe’s programme line “Prisons and police” has undertaken very relevant and mostly effective work to protect human rights in the field of prisons and police and that a high degree of added value has been provided by the Organisation’s work.

The evaluation makes a number of recommendations that aim to:

• encourage a greater focus on policing in standard setting and co-operation;
• expand the scope of co-operation activities;
• increase the effectiveness of standards and co-operation;
• promote consideration of the gender dimension of activities and involvement of civil society;
• promote reflection on the arrangements in place to set standards and provide assistance for places of detention outside criminal justice.

A management response and action plan in respect of the recommendations has been prepared by the Secretariat and is available on the DIO website together with the report.

The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.

Related links:

• Report on the evaluation of the Council of Europe’s work under the programme line “Prisons and police” 2016-2019
• Management response and Action plan
• Infographics (facts and figures)

The report on the evaluation of Results-based management in the Council of Europe as well as the management response and action plan are now available.

The evaluation assesses whether the current RBM system provides pertinent information for both policy and performance management and if this information is used for decision making.

In respect of the four major purposes generally associated with RBM:

• Accountability,
• Communication,
• Decision making,
• Learning.
   

The evaluation finds that the Organisation currently has most of the elements required to support good accountability and communication and recommends that a strategic choice is made on how to meet all four purposes in future.

The evaluation makes a number of recommendations for improving the current system. The recommendations have been situated at two levels: 1. the strategic choice that the Organisation needs to make on the level of ambition for, and the purpose of RBM; and 2. improvements that can be made irrespective of the strategic choice made.

All recommendations have been accepted by management and a management response and action plan in respect of the recommendations has been prepared by the Secretariat. This is available on the DIO website together with the report.

The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.

Related links:

• Evaluation of Results-based management in the Council of Europe
• Management response and Action plan
• Facts and figures (Infographic)

The report on the evaluation of the Strategy Development and Reporting in the Council of Europe as well as the management response and action plan have been published.

The evaluation assesses the processes of preparation and formulation of and reporting on Council of Europe strategies, including the factors that influence the quality of their development and uptake. The report also correlates the impact of these strategic planning processes with enhanced organisational performance.

As such, the evaluation identifies several lessons learnt and makes a number of recommendations for improving the preparation of future strategies in general and for the Secretary General’s strategic outlook that is being developed, in particular.

All recommendations have been accepted by management and a management response and action plan in respect of the recommendations has been prepared by the Secretariat. This is available on the DIO website together with the report.

The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.

Related links

• Report on Strategy Development and Reporting
• Management response and action plan
• Facts and figures (Infographic)

The Directorate of Internal Oversight cordially invites members of the Permanent Representations and staff to a presentation and discussion of the results of the Evaluation of Intergovernmental Committees report on Thursday 10 October 2019 from 10 am to 12.30 pm in Room 1 of the Palais. The presentation will be made by the evaluation team from the "Centre for Strategy and Evaluation Services".

Following the presentation, participants will have an opportunity to ask questions and discuss the evaluation report, including the proposed follow-up.

Related links:

• Agenda
• Evaluation report of the intergovernmental committees
• Management Response

The report on the evaluation of the intergovernmental committees and management response are now available on the DIO webpage.

The Council of Europe’s intergovernmental committee system lies at the heart of the organisation and has a critical role to play in helping to deliver its mandate. Do the committees address the needs of member states and are they relevant to the objectives of the organisation? Do they achieve their objectives? Are they efficient?

The evaluation found that the intergovernmental committees have achieved a great deal over the years and play an essential role in developing common standards in the field of human rights, democracy and the rule of law across the Council of Europe’s 47 member states. These common standards are also used as reference by the European Court of Human Rights and the monitoring mechanisms. In wide-ranging policy areas the committees are an essential link between the Council of Europe and its member states and in some cases, like the Cultural Convention, also with non-member states. Overall, they play a key role in achieving greater unity between member states, which is an aim set out in the Statute of the Organisation. The activities of the committees are generally very relevant both in addressing the needs of the member states and the objectives of the Council of Europe. The evaluation found however that in recent years the intergovernmental committee system has faced increasing financial constraints that have made the fulfilment of some tasks more difficult. Findings also revealed that there is a need for improved coherence, more flexible deployment of resources, greater accessibility to real-time information and a more focused sense of strategic orientation.

The evaluation identifies three possible scenarios for the future and makes a number of recommendations in respect of the committee system, including:

• The establishment of strategic frameworks for the committees and reporting at strategic level;
• Clarification on how committees are established and dissolved;
• Reinforced coordination and cooperation between the committees;
• Mobilisation of extra-budgetary resources to support the work of the committees;
• Increased flexibility in the planning and deployment of human and financial resources available to committees;
• Improved communication of activities of committees, including a single gateway;
• Increased evaluation of the performance of individual committees; and
• Changes to Resolution CM/Res(2011)24 to put into effect the accepted recommendations.
   

A management response in respect of the recommendations has been prepared by the Secretariat and is available on the DIO website together with the report.

The Evaluation Division of the DIO would like to express its gratitude to the members of intergovernmental committees, Permanent Representations and the Council of Europe staff involved in the exercise.

Related links:

• Evaluation of the intergovernmental committees
• Management Response
• Facts and figures (Infographic)

The report on the evaluation of the Council of Europe support to the protection and promotion of freedom of expression is now available on the DIO web page.

The evaluation found that the CoE’s work on freedom of expression is addressing partner needs and effectively encourages compliance with CoE standards, most notably via the Platform for the Protection of Journalism and via cooperation activities. The evaluation also suggests that the CoE conducts its work with a view to sustainability by systematically involving civil society organisations as multipliers, and in the design of cooperation activities.

The evaluation makes a number of recommendations, including:

• developing a strategic framework on freedom of expression that involves all relevant actors in the CoE;
• enhancing leadership and coordination, for example by creating the function of a "Special Representative" or "Special Adviser" of the Secretary General on freedom of expression;
• further promoting the visibility of the Platform;
• prioritising capacity development for civil society organisations and ombudsperson offices as prominent defenders of standards;
• strengthening Field Office human resources in selected thematic areas of freedom of expression, and
• further facilitating access to CoE outputs on freedom of expression beyond the framework of cooperation activities.
   

The Evaluation Division of the DIO would like to express its gratitude to the partners in member States and the Council of Europe staff involved in the exercise.

Related links:

•  Evaluation of the support to the protection and promotion of freedom of expression 
•  Facts and figures (Infographic)

The report on the evaluation of the Council of Europe’s support in the fight against corruption is now available on the DIO webpage.

The evaluation finds that the Council of Europe’s support to states in the fight against corruption is highly relevant for member States as well as non-member States and addresses high level corruption in particular sectors of key concern. The Council of Europe is valued as a trustworthy and unbiased international player that offers good quality expertise and provides the unique added value of its dynamic triangle of well-established anti-corruption standards, country monitoring and technical co-operation.

The evaluation recommends that the Organisation further improves its visibility and leverage, internal and external cooperation and coordination as well as its working methods related to GRECO monitoring procedures, project management and follow-up activities of the opinions of the Venice Commission.

The Evaluation Division of the DIO would like to express its gratitude to the partners in member States and the Council of Europe staff involved in the exercise.

Related links:

• Evaluation report of the support in the fight against corruption

Voluntary contributions to support the Council of Europe’s work have considerably increased in the past few years. These contributions provide significant support to cooperation activities. The evaluation report on resource mobilisation and allocation noted the progress made and provides input to inform future review of policies and practices in this field.

The following key aspects were highlighted:

• Through the combined effect of donor trust, and resource mobilisation efforts and tools, extra-budgetary contributions have considerably increased and fuelled the emergence of strong thematic sectors capable of planning and implementing cooperation activities,
• Voluntary contributions have yet to cover all the financial needs in the area of cooperation. To ensure greater coverage, the report suggests the exploration of so far untapped sources within the different entities in the European Union,
• The internal processes governing resource mobilisation prioritisation and predictability could be improved and rendered more transparent,
• Whilst the Council of Europe has invested considerably to develop its cooperation capacity and to raise extra-budgetary resources, some internal administrative and structural constraints need be addressed, and communication between the relevant internal actors should be strengthened.
   

The Evaluation Division of the DIO would like to express its gratitude to the Council of Europe staff and donors interviewed as well as to the staff members of other international organisations who were interviewed or provided documentation during this evaluation.

Furthermore, please note that the Evaluation report of Digital communications and access to information is also available.
 

Related links

• Evaluation report on Resource mobilisation and allocation in the Council of Europe
• Evaluation report of Digital communications and access to information

On behalf of the Deputy Secretary General, Gabriella Battaini-Dragoni, the Evaluation Division of the DIO cordially invites you to a High-level Event which will take place on Friday 9 November 2018 from 10 am to 1 pm, in Room 1 of the Palais.

High-level guest speakers from UNESCO, OECD, the European Commission and the Oversight Advisory Committee, will be present to share their experiences on standards and practices with regard to evaluation functions in international organisations.

Related links:

• Agenda