User Tools

Site Tools


damsym:feedback_and_ratings

This is an old revision of the document!


Feedback and Ratings System

General Description

The Feedback and Review system represents an essential component within DaMSym, designed to ensure qualitative control over the results returned by the semantic search engine. This functionality allows users with the Reviewer role to express an evaluation of the relevance and semantic accuracy of the results, thus contributing to the continuous improvement of the corpus and to the scientific validation of the contents. The review mechanism is based on a simple but structured model: for each displayed result, the Reviewer can provide either positive or negative feedback, optionally accompanied by an explanatory note. All feedback is stored in the system and can be consulted by the WP Lead, who is also able to export it in tabular format for analysis and reporting purposes.


Access to the Functionality

The feedback system is available exclusively to authenticated users with the Reviewer role. Other roles interact differently with the system, as described below:

Role Interaction with the feedback system
Guest No access or interaction.
Researcher Cannot submit evaluations; can only consult search results.
Reviewer Can submit positive or negative evaluations and add descriptive notes.
WP Lead Cannot submit evaluations, but can view all feedback and export it from the Dashboard.

Interface and Workflow

For each result displayed on the search results page, Reviewers see two dedicated icons:

  • 👍 (Thumbs up) → positive feedback
  • 👎 (Thumbs down) → negative feedback

By clicking on one of these icons, a feedback modal opens, allowing the Reviewer to:

  • confirm the selected feedback type;
  • optionally add a textual note to justify the evaluation or describe observations;
  • submit the evaluation definitively.

After submission, the feedback is recorded in the system with the following metadata:

  • ID of the evaluated result and associated resource;
  • type of evaluation (positive / negative);
  • feedback author (authenticated Reviewer);
  • optional descriptive note;
  • submission date and time.

The system does not allow feedback to be modified after submission, in order to ensure data integrity and traceability of the review process. (Figures 6–7)

Figure 6, Feedback

Figure 7, Feedback details


Feedback Visualization (WP Lead)

Users with the WP Lead role do not see the feedback buttons. Instead, they see a clickable item labeled “See Ratings” displayed under each result. (Figures 8–11) By selecting this option, a summary window opens containing:

  • the complete list of feedback received for the selected result;
  • notes entered by Reviewers;
  • the date and author of each evaluation.

In addition, the WP Lead can access the Dashboard, where a dedicated panel allows:

  • visualization of aggregated feedback by language, author, or date;
  • export of data in CSV or Excel format for further analysis or archiving.

Figure 8, Export Ratings


Interaction Between Feedback and Corrections

In addition to the evaluation system based on positive/negative ratings, both Reviewers and Researchers can contribute to content quality by proposing direct text corrections or metadata modifications. In this case:

  • the Reviewer opens the More Details view of a result;
  • proposes a modification using Edit Text or Edit Metadata;
  • the WP Lead receives the proposal in the Dashboard and can approve or reject it.

Approved corrections are integrated into the corpus and become part of the definitive text, progressively improving the reliability of the semantic engine.


Feedback Export

The export functionality, accessible exclusively to the WP Lead, allows the generation of a structured file containing all ratings and related notes provided by Reviewers. The exported file includes the following fields:

Field Description
Resource ID Unique identifier of the evaluated text or document
Language Linguistic domain of the resource (Arabic, Slavic, Greek, etc.)
Feedback type Positive (👍) / Negative (👎)
Note Additional comment provided by the Reviewer
Reviewer Username of the reviewer who submitted the evaluation
Date and time Timestamp of the feedback submission

The export function provides the WP Lead with a control and documentation tool, also useful for reporting activities and project progress verification.


Data Traceability and Security

All feedback is persistently stored in the DaMSym database, with cross-references to the Reviewer user ID and the evaluated result. The system guarantees complete traceability of reviews, in compliance with the security and privacy policies adopted by ITSERR and RESILIENCE. Sensitive information (such as user IDs and timestamps) is processed exclusively for technical monitoring purposes and is not made publicly accessible.

damsym/feedback_and_ratings.1768490806.txt.gz · Last modified: by fincons