Automated Driving Testing and Evaluation Materials Toolkit

This page offers a condensed view on automated driving testing and evaluation materials available from a series of European Commission support actions: FOT-Net, CARTRE and ARCADE. The materials are sorted according to FESTA V phases.

Function Identification & Description

FESTA Handbook

Webinar: Context, functions, use cases, research questions and hypotheses

Connected and automated vehicles – Vocabulary BSI Flex 1890 v4.0:2022-03

Use Cases

FESTA Handbook

Webinar: Context, functions, use cases, research questions and hypotheses

• SCOUT D2.3 Report on use cases and comprehensive vision for connected and automated driving in EU
• ERTRAC CAD Roadmap, March 2019
• CAR 2 CAR Roadmap, Nov 2018
• A joint white paper by three 5G projects, Oct 2020

Research Questions

FESTA Handbook

Webinar: Context, functions, use cases, research questions and hypotheses

• L3Pilot D3.1 From Research Questions to Logging Requirements

PIs & Study Design

FESTA Handbook

Webinar: Performance indicators, study design, measures and sensors

• CARTRE D5.3 Societal impacts of automated driving
• Key performance indicators for assessing the impacts of automation in road transportation: Results of the Trilateral key performance indicator survey
• L3Pilot D3.2 Experimental Procedure, 2019

Measures and Sensors

FESTA Handbook

Webinar: Performance indicators, study design, measures and sensors

• FOT-Net Tool Catalogue (content not updated since 2016)

Using / Driving

FESTA Handbook

• Micro-FESTA – lessons learned from small tests, regulator perspectives
• One-pager on the importance of piloting
• Checklist for participant introduction
• Informed consent checklist
• L3Pilot Evaluation Methods, questionnaires as annexes
• L3Pilot D3.2 Experimental Procedure, 2019
• Starting Your Own Pilot – Sohjoa Baltic. The Roadmap to Automated Electric Shuttles in Public Transport

Ethical and Legal Issues

FESTA Handbook

Webinar: Legal and ethical issues

Webinar: Data sharing

• Checklist for participant introduction
• Informed consent checklist

Database

FESTA Handbook

Webinar: Databases, data analysis and hypothesis testing

• Data Sharing Framework
• Common Data Format as suggested by L3Pilot
  • GitHub for L3Pilot Common Data Format
• European Data Protection Board’s Guidelines 1/2020 on processing personal data in the context of connected vehicles and mobility related applications

Data Analysis

FESTA Handbook

Webinar: Databases, data analysis and hypothesis testing

Webinar: Impact assessment and socioeconomic cost–benefit analysis

• UDrive dataset and key analysis results, including a video annotation codebook
• Key performance indicators for assessing the impacts of automation in road transportation: Results of the Trilateral key performance indicator survey
• FOT-Net Data anonymisation workshop materials
• FOT-Net Tool Catalogue

Impact Assessment

FESTA Handbook

Webinar: Impact assessment and socioeconomic cost–benefit analysis

• CARTRE D5.3 Societal impacts of automated driving
• Trilateral Impact Assessment Framework for Automation in Road Transportation
• System Dynamics Modelling of CAD Impacts
• C-Roads evaluation plan
• Online calculator for Economic Efficiency Evaluation of road safety counter measures
• L3Pilot Evaluation Methods

Materials planned for the next knowledge-base update:

• More handbook-level links and useful documents. Please use the feedback form to suggest!