Research questions

Research questions are the primary inquiries the study aims to answer, directing every step from planning to conclusion. They provide a foundation for planning subsequent evaluation steps, such as method selection, data specification, and experimental design.

When the evaluation scope is broad, a hierarchical structure of research questions is recommended. This involves organising research questions in a structured manner that reflects their level of detail and scope, breaking down large, complex topics into smaller, more precise sub-questions.

For research questions in CCAM projects to be effective, they should be:

• Specific: Clearly defined and focused on a particular aspect of CCAM, its use or impacts.
• Measurable: Designed to yield qualitative or quantitative results.
• Relevant: Aligned with the evaluation scope and project objectives.

Research questions should address knowledge gaps, challenges, or key issues in CCAM. Their development must be based on a thorough understanding of the technology and its operational scale, the deployment context, and the potential and expected users and impacts.

Developing a practical evaluation plan is inherently iterative. It involves repeated cycles of refining research questions and incorporating feedback based on feasibility checks for methods, experimental design, and data collection.

Evaluating the feasibility of research questions and prioritising them are essential to ensure the evaluation is realistic and achievable. Feasibility checking is not a quick or superficial process. It requires substantial groundwork across multiple evaluation plan components before it can be conducted, essentially drafting a full evaluation plan. To determine whether a research question can be addressed within the project’s constraints, the following elements of the evaluation plan must be checked for their feasibility

1. Availability of necessary data
2. Possibility to implement required experimental design
3. Availability of appropriate tools and methods

Only after significant progress in the evaluation methodology planning can a proper feasibility check be conducted. This structured process ensures project-level commitment to realistic and achievable research questions by engaging the entire project team in discussions. However, these steps are interconnected and iterative rather than strictly sequential, and the order may differ from the sequence of guidelines given in the EU-CEM which cover the following topics:

• How to elaborate the scope of evaluation
• How to formulate and organise research questions
• How to prioritise research questions
• How to check the feasibility of research questions
• How to set hypotheses