Data specification and data tools

The data specification and data tools step provides guidance on: What data needs to be collected, Why the data is collected, How data is processed and stored, and Who are the actors involved.  This ensures that the collected data will support the evaluation.

The data specification and data tools guidelines in the EU-CEM are relevant if any of the cases below apply:

1. An evaluation method has specific requirements for its input data to be collected within the project, and the evaluation partner is not directly collecting that data.
2. It is planned that multiple partners will collect comparable data.
3. Data is shared between partners.

Data specification describes what kind of data the project collects, how it is formatted, and how it is stored. It ensures that data can be exchanged and used seamlessly among project partners. While data specification does not describe the experimental design of the data collection, it should describe contextual data that facilitate correct understanding of the design and usage and interpretation of the data. This includes whether the data was collected under baseline or treatment conditions, and situational variables relevant for the planned method. The data specification is the basis for a common data format, which is used for storing and processing the data with common tools. 

Data collection tools refer to devices and programs used for data collection, such as data loggers installed in vehicles. In some cases, partners must agree on using common tools and how they are calibrated and configured to ensure comparable results. In other cases, simply harmonising the data format may be sufficient.

Data processing tools refer to a chain of scripts or programs used to process the data. Processing includes converting logged data into the common data format and calculating derived measures. A project may also need to agree on data storage and exchange tools

It is recommended that data specification and tools are clearly documented, either as part of the evaluation plan or in a dedicated data management document. Version control systems are highly recommended to ensure that every partner is using the same version of the specification and tools at all times. A documented data specification and a description of data tools is essentially an agreement between the data providers and the evaluation team on the technical characteristics of the data.

The guidelines in this chapter do not mandate any specific data formats or data handling methods, leaving it for each project to decide. The CCAM Data Sharing Framework gives detailed advice on data sharing, both from technical and contractual perspectives. 

The EU-CEM has guidelines on the following topics:

• How to set up a process for defining data specification and data tools
• How to define common data formats
• How to define the roles and access rights related to data
• How to define the data flow in the processing chain
• How to overcome common pitfalls related to data