Publishing Results

see Calculation of Results to learn how the grades are calculated

Publishing Results

When results are published, the evaluation is accessible from the results index page and other users can see the detailed results.
There are several ways to publish results:

• Staff users move an evaluation from the reviewed to published state by using the operation on the semester page.
• When the evaluation period ends, EvaP checks if the text answers of the evaluation have been fully reviewed and the grading process has been completed (wait_for_grade_upload_before_publishing is false, a grade document with final grades has been uploaded, or it's been confirmed that grades have been received but won't be uploaded). If both are true, the results will be published automatically.
• When a grade uploader uploads a grade document with final grades, or confirms that grades have been received but won't be uploaded, EvaP checks if the text answers of the evaluation have been fully reviewed. If so, the results will be published automatically.

What gets published

The results of an evaluation consist of overall values like the number of participants and voters, the total average and median grades as well as answers to multiple questionnaires. There are general questionnaires and questionnaires about the contributors.

Some users can see more detailed information within the results. Please note that any assigned delegate can also see the results if the represented person can see them (with the exemption of private text answers).

In case only a single person votes in an evaluation, this person can decide whether given text answers will be published in case no other person votes. Once a second person votes, the text answers will be published as described below regardless of the decision.

These are the different types of answers and the respective publishing levels:

Results	standard user	contributor	export	staff
#participants, #voters	yes	yes	yes	yes
average grade	yes*	yes*	yes*	yes*
answers to general rating questions	yes**	yes**	yes**	yes**
answers to rating questions about contributors	yes**	yes**	yes, aggregated**	yes**
general text answers	no	yes, if permission given	no	yes
text answers about contributors	no	yes, about themselves***	no	yes

* The average grade is only shown if the number of voters divided by the number of the evaluations's participants is higher than or equal to VOTER_PERCENTAGE_NEEDED_FOR_PUBLISHING_AVERAGE_GRADE (standard value: 20%)

**) These results are only visible if the number of voters for the evaluation is higher than or equal to VOTER_COUNT_NEEDED_FOR_PUBLISHING_RATING_RESULTS (standard value: 2)

The variables can be defined in the settings.

***) Text answers can be marked as private during the review process. Such answers can only be seen by the person about whom the comment was written (and by staff users). Delegates can not see them.

Users can only access the results page if they can see at least a part of the results. Otherwise the results are not linked at the semester's result overview page. Staff users can see all results in all stages and even if they haven't been published.

Warnings

Warnings above a evaluation are shown to staff and contributors if they open the results of a evaluation that wasn't published. Additionally all users see warnings next to single grades within a evaluation if there was only a small number of answers based on which the grade was calculated.

Calculation of the warning thresholds

For each questionnaire type of an evaluation a median value of the maximum number of voters is calculated. The result tells for each type of questionnaire (lecturer, tutor, ...) that was used in this evaluation, what the median value of the individual questionnaires' maximum number of participants is.

Results which are based on less than RESULTS_WARNING_PERCENTAGE (configurable in the settings, standard value: 50%) of the median value of the maximum number of voters for this questionnaire get a warning message displayed next to them. Additionally, all questions for which less than RESULTS_WARNING_COUNT (default: 4) answers have been given, show this warning. Questionnaires where all questions would have a warning message just show one message on top.

Example: There are 3 lecturer questionnaires consisting of 2 questions each and they got this distribution of answers (the maximum is highlighted):

• Lecturer 1:
• Question 1: 5 answers
• Question 2: 9 answers
• Lecturer 2:
• Question 1: 3 answers
• Question 2: 1 answer
• Lecturer 3:
• Question 1: 6 answers
• Question 2: 5 answers

The median value for the lecturer questionnaire is now the median of 9, 3 and 6, which is 6. 50% of 6 is 3, so every question that got less than 3 answers will have a warning. Because of the additional fixed minimum count of 4, every question that got less than 4 answers will have a warning. Because lecturer 2 has a maximum number of voters of 3, all of the questions would have a warning, so they are combined and displayed as one warning on top of the questionnaire.

Exports

EvaP allows to export the results of semesters as Excel sheets. The export contains the overall values for the evaluations (number of participants and voters, the total average) and the average grades for rating questions. The grades for contributors are aggregated for all contributors of the same type.