Common Evaluation Methodology

Explanation of the EU-CEM

The FAME project is currently developing a European Common Evaluation Methodology (EU-CEM) for CCAM that provides guidance on how to set up and carry out an evaluation or assessment of direct and indirect (wider socio-economic) impacts directed to different user groups. EU-CEM will be part of European framework for testing [of CCAM] on public roads.

The first draft of the EU-CEM Handbook will become available in May 2024 and the final version will be published in June 2025.

Objectives for EU-CEM:

• Ensure high quality evaluation of CCAM.
• Provide common language and basis for CCAM evaluation in different projects.
• Allow all CCAM projects to benefit from methodological lessons learned and best practices.
• Support comparability and complementarity of evaluation activities.

Evaluation areas:

CCAM affects vehicles, people, transport system as well as the society in multiple ways. CEM provides evaluation area specific guidelines for the following areas:

Level of evaluation	Evaluation area
Vehicle	Technical functioning
	Driving behaviour
Human	User
	People mobility
	Quality of life
Traffic and transport	Services and operation
	Goods logistic
	Transport activity and fleet composition
	Traffic safety
	Traffic flow efficiency
	Energy and environment
	Accessibility
Society	Land use
	Liveability
	Equity
	Economic activity and employment
	Socio-economics
	Sustainability

Inventory of existing methodologies and best practices

The work on the EU-CEM in the FAME project started with an inventory of existing methodologies. The approach for this milestone was as follows:

• A template was developed which was filled in by representatives of the evaluation teams of various projects and methodologies (EU and national). The template included questions about the type of projects and methodologies, which impact areas were addressed, and whether certain parts of FESTA methodology were used and in which way.
• Interviews were held with representatives of the evaluation teams of a subset of projects and methodologies, to discuss relevant aspects not reported on in deliverables, e.g., what went according to plan and what didn’t, which achievements in the project were considered best practices, which pitfalls were encountered and what they would like to see addressed in the EU-CEM.
• Material from two workshops was used: (1) the FAME workshop held on March 8, 2023, in Brussels, where challenges encountered in CCAM evaluations were inventoried among the participants, and (2) ARCADE online workshop (2020) in which gaps to be addresses in the EU-CEM were identified by the participants.

---