Table of Contents
Feedback and Ratings System
General Description
The Feedback system represents an essential tool within DaMSym, designed to ensure qualitative control of the results returned by the semantic search engine.
This functionality allows users with the Reviewer role to express a judgment on the relevance and semantic accuracy of the results, thereby contributing to the continuous improvement of the corpus and to the scientific validation of the content.
The rating mechanism is based on a simple yet structured model: for each displayed result, the Reviewer may leave a positive or negative feedback, accompanied by an optional explanatory note.
All feedback entries are stored within the system and can be consulted by the WP Lead, who has the possibility to export them in tabular format for analysis and reporting purposes.
Access to the Functionality
The feedback system is available exclusively to authenticated users with the Reviewer role.
Other roles interact with the feedback system in a differentiated manner:
| Role | Interaction with the Feedback System |
|---|---|
| Guest | No access or interaction. |
| Researcher | No possibility to evaluate results; can only consult search results. |
| Reviewer | Can leave positive or negative evaluations and add descriptive notes. |
| WP Lead | Cannot leave evaluations but can view all feedback and export them from the Dashboard. |
Interface and Operation
For each result displayed on the search results page, Reviewers see two dedicated icons:
- 👍 (Thumbs up) → positive feedback
- 👎 (Thumbs down) → negative feedback
By clicking on one of these icons, a rating modal window opens, allowing the user to:
- confirm the selected type of feedback;
- add, if desired, a textual note to justify the evaluation or describe observations;
- definitively submit the evaluation.
After submission, the feedback is recorded in the system with the following metadata:
- ID of the evaluated result and resource;
- type of evaluation (positive/negative);
- author of the feedback (authenticated Reviewer);
- optional descriptive note;
- date and time of submission.
The system does not allow modification of feedback after submission, in order to guarantee the integrity and traceability of review data.
Feedback Visualization (WP Lead)
Users with the WP Lead role do not see the feedback buttons. Instead, they see a clickable entry labeled “See Ratings” under each result.
By selecting this option, a summary window opens containing:
- the complete list of feedback received for the selected result;
- the notes provided by Reviewers;
- the date and author of each evaluation.
In addition, the WP Lead may access the Dashboard, where a dedicated panel allows the user to:
- view aggregated feedback by language, author, or date;
- export the data in CSV or Excel format for subsequent analysis or archival purposes.
Interaction Between Feedback and Corrections
In addition to the like/dislike rating system, users with the roles of Reviewer, Researcher, and WP Lead may contribute to improving text quality by proposing textual corrections or metadata modifications.
In this context, the interaction flow provides that:
- the Reviewer and/or the Researcher access the More Details view of the selected result;
- for the Edit Text functionality, the user selects a contextualized portion of text, initially highlighted by the system; the selection may be manually extended. Through the contextual icon displayed, the user may proceed with the proposal of a text modification;
- similarly, it is possible to propose modifications to metadata through the Edit Metadata function, or to add new metadata through Add Metadata, using the dedicated available buttons;
- all modification proposals are sent to the Corrections section of the Dashboard, where the WP Lead receives the requests and may approve or reject them.
Corrections approved by the WP Lead are then applied to the corpus, becoming an integral part of the definitive text and resulting directly effective and visible within the platform, thereby contributing to the progressive improvement of the reliability of the semantic engine.
Feedback Export
The export functionality, accessible exclusively to the WP Lead, allows the generation of a structured file containing all ratings and related notes provided by Reviewers.
The exported file includes the following fields:
| Field | Description |
|---|---|
| Resource ID | Unique identifier of the evaluated text or document |
| Language | Linguistic domain of the resource (Arabic, Church Slavonic, Greek, etc.) |
| Feedback Type | Positive (đź‘Ť) / Negative (đź‘Ž) |
| Note | Additional comment provided by the Reviewer |
| Reviewer | Username of the Reviewer who submitted the evaluation |
| Date and Time | Timestamp of feedback submission |
The export is designed to provide the WP Lead with a control and documentation tool, also useful for reporting purposes and for monitoring project progress.
Traceability and Data Security
All feedback entries are persistently recorded within the DaMSym database, with cross-reference to the Reviewer’s user ID and the evaluated result.
The system guarantees full traceability of revisions, in compliance with the security and privacy policies adopted by ITSERR and RESILIENCE.
Sensitive information (such as user ID and timestamp) is processed exclusively for technical monitoring purposes and is not made publicly available.