This is an old revision of the document!
Table of Contents
Feedback and Ratings System
General Description
The Feedback and Review system represents an essential component within DaMSym, designed to ensure qualitative control over the results returned by the semantic search engine. This functionality allows users with the Reviewer role to express an evaluation of the relevance and semantic accuracy of the results, thus contributing to the continuous improvement of the corpus and to the scientific validation of the contents. The review mechanism is based on a simple but structured model: for each displayed result, the Reviewer can provide either positive or negative feedback, optionally accompanied by an explanatory note. All feedback is stored in the system and can be consulted by the WP Lead, who is also able to export it in tabular format for analysis and reporting purposes.
Access to the Functionality
The feedback system is available exclusively to authenticated users with the Reviewer role. Other roles interact differently with the system, as described below:
| Role | Interaction with the feedback system |
|---|---|
| Guest | No access or interaction. |
| Researcher | Cannot submit evaluations; can only consult search results. |
| Reviewer | Can submit positive or negative evaluations and add descriptive notes. |
| WP Lead | Cannot submit evaluations, but can view all feedback and export it from the Dashboard. |
Interface and Workflow
For each result displayed on the search results page, Reviewers see two dedicated icons:
- 👍 (Thumbs up) → positive feedback
- 👎 (Thumbs down) → negative feedback
By clicking on one of these icons, a feedback modal opens, allowing the Reviewer to:
- confirm the selected feedback type;
- optionally add a textual note to justify the evaluation or describe observations;
- submit the evaluation definitively.
After submission, the feedback is recorded in the system with the following metadata:
- ID of the evaluated result and associated resource;
- type of evaluation (positive / negative);
- feedback author (authenticated Reviewer);
- optional descriptive note;
- submission date and time.
The system does not allow feedback to be modified after submission, in order to ensure data integrity and traceability of the review process. (Figures 6–7)
Figure 6, Feedback
Figure 7, Feedback details
Feedback Visualization (WP Lead)
Users with the WP Lead role do not see the feedback buttons. Instead, they see a clickable item labeled “See Ratings” displayed under each result. (Figures 8–11) By selecting this option, a summary window opens containing:
- the complete list of feedback received for the selected result;
- notes entered by Reviewers;
- the date and author of each evaluation.
In addition, the WP Lead can access the Dashboard, where a dedicated panel allows:
- visualization of aggregated feedback by language, author, or date;
- export of data in CSV or Excel format for further analysis or archiving.
Figure 8, Export Ratings
Interaction Between Feedback and Corrections
In addition to the evaluation system based on positive/negative ratings, both Reviewers and Researchers can contribute to content quality by proposing direct text corrections or metadata modifications. In this case:
- the Reviewer opens the More Details view of a result;
- proposes a modification using Edit Text or Edit Metadata;
- the WP Lead receives the proposal in the Dashboard and can approve or reject it.
Approved corrections are integrated into the corpus and become part of the definitive text, progressively improving the reliability of the semantic engine.
Feedback Export
The export functionality, accessible exclusively to the WP Lead, allows the generation of a structured file containing all ratings and related notes provided by Reviewers. The exported file includes the following fields:
| Field | Description |
|---|---|
| Resource ID | Unique identifier of the evaluated text or document |
| Language | Linguistic domain of the resource (Arabic, Slavic, Greek, etc.) |
| Feedback type | Positive (👍) / Negative (👎) |
| Note | Additional comment provided by the Reviewer |
| Reviewer | Username of the reviewer who submitted the evaluation |
| Date and time | Timestamp of the feedback submission |
The export function provides the WP Lead with a control and documentation tool, also useful for reporting activities and project progress verification.
Data Traceability and Security
All feedback is persistently stored in the DaMSym database, with cross-references to the Reviewer user ID and the evaluated result. The system guarantees complete traceability of reviews, in compliance with the security and privacy policies adopted by ITSERR and RESILIENCE. Sensitive information (such as user IDs and timestamps) is processed exclusively for technical monitoring purposes and is not made publicly accessible.
