Prevent deletion of graded peer reviews #7263

hemmatio · 2024-10-10T03:06:06Z

Proposed Changes

(Describe your changes here. Also describe the motivation for your changes: what problem do they solve, or how do they improve the application or codebase? If this pull request fixes an open issue, use a keyword to link this pull request to the issue.)
This PR aims to fix #7119. Currently, instructors are able to unassign peer reviewers no matter the situation. This PR prevents peer reviewers from being unassigned in the case that grade data exists, annotations exist, or the peer review is set to complete.

Screenshots of your changes (if applicable)

Case 1: Successfully unassigned all

Case 2: Could not unassign any

Case 3: Unassigned some, could not unassign rest (less than 5)

Case 4: Unassigned some, could not unassign rest (more than 5)

Associated documentation repository pull request (if applicable)

Type of Change

(Write an X or a brief description next to the type or types that best describe your changes.)

Type	Applies?
🚨 Breaking change (fix or feature that would cause existing functionality to change)
✨ New feature (non-breaking change that adds functionality)	X
🐛 Bug fix (non-breaking change that fixes an issue)
🎨 User interface change (change to user interface; provide screenshots)	X
♻️ Refactoring (internal change to codebase, without changing functionality)
🚦 Test update (change that only adds or modifies tests)
📦 Dependency update (change that updates a dependency)
🔧 Internal (change that only affects developers or continuous integration)

Checklist

(Complete each of the following items for your pull request. Indicate that you have completed an item by changing the [ ] into a [x] in the raw text, or by clicking on the checkbox in the rendered description on GitHub.)

Before opening your pull request:

I have performed a self-review of my changes.
- Check that all changed files included in this pull request are intentional changes.
- Check that all changes are relevant to the purpose of this pull request, as described above.
I have added tests for my changes, if applicable.
- This is required for all bug fixes and new features.
I have updated the project documentation, if applicable.
- This is required for new features.
If this is my first contribution, I have added myself to the list of contributors.

After opening your pull request:

I have updated the project Changelog (this is required for all changes).
I have verified that the pre-commit.ci checks have passed.
I have verified that the CI tests have passed.
I have reviewed the test coverage changes reported by Coveralls.
I have requested a review from a project maintainer.

Questions and Comments

(Include any questions or comments you have regarding your changes.)
09/10/24: This is still a WIP, I just wanted to save my work on GitHub.

15/10/24: Added more error/success flashes, moved flash messages to locale file, modified logic of mark checking to check for non-nil mark criteron

22/10/24: Updated error messages to include reviewer and reviewee pairs to prevent any confusion in the case that the same reviewer cannot be unassigned in multiple different cases. Updated error flashes to be truncated when more than 5 reviewers could not be unassigned. Updated the exclamation mark in error flashes to be centred when the message is more than one line long. Added testcase which mocks that has_marks_or_annotations? returns true, then ensures that no peer reviews are deleted in that case.
Also: Is it necessary to update the project documentation for this? I see that the peer review wiki does not have anything yet, which I believe would be the related documentation.

23/10/24: Added more comprehensive testcases to cover all written lines of code. Mocks behaviour for each flashed message, and fully covers logic of has_marks_or_annotations? checking each criterion for a non-nil mark.

24/10/24: When selecting an entire row, the necessary checks were being bypassed. To fix this, I processed each row selection to be treated as if individual reviewers were selected.
For reference, an image of "row selection":

… issue-7119

…r and reviewee pairs. Updated css stylesheet to centre the exclamation mark in error flashes when the error message is multiple lines. Added testcase to ensure that has_marks_or_annotations? works as expected, and prevents peer reviewers from being unassigned

… issue-7119

hemmatio · 2024-10-23T21:48:38Z

Sorry, I requested a review prematurely. I'll re-request once I am fully prepared for a review.

coveralls · 2024-10-23T22:02:41Z

Pull Request Test Coverage Report for Build 11493476708

Details

80 of 80 (100.0%) changed or added relevant lines in 4 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.01%) to 91.665%

Totals
Change from base Build 11452193434:	0.01%
Covered Lines:	40733
Relevant Lines:	43764

💛 - Coveralls

…iews_controller.rb

…ections (Previously row selections bypassed the necessary checks)

david-yz-liu · 2024-10-24T14:08:45Z

app/models/peer_review.rb

+        unless reviewee_group.nil? || reviewer_group.nil?
+          peer_review = reviewer_group.review_for(reviewee_group)
+          unless peer_review.nil?
+            if peer_review.has_marks_or_annotations?


This check (peer_review.has_marks_or_annotations?) is good, but you should reorganize as follows: instead of adding it here, add it as a before_destroy callback. The delete_peer_review_between method calls destroy, and will trigger the callback. This is more robust because it will affect everywhere that a peer review is attempted to be destroyed, not just this particular method.

(It's possible to also skip callbacks, in case we ever want to enable that in the future.)

david-yz-liu · 2024-10-24T14:09:30Z

app/models/peer_review.rb

+          unless peer_review.nil?
+            if peer_review.has_marks_or_annotations?
+              delete_all_reviews = false
+              undeleted_reviews.append(reviewer_group.get_all_students_in_group +


Use the group name rather than the students (the latter will make the message look weird when students are working in groups)

Make this entire string internationalized

david-yz-liu · 2024-10-24T14:10:04Z

app/models/peer_review.rb

+  def has_marks_or_annotations?
+    result = self.result
+    marks_not_nil = false
+    result.marks.each do |mark|


This is inefficient, and can be simplified into a single query with exists?

david-yz-liu · 2024-10-24T14:11:41Z

app/models/peer_review.rb

+    deleted_count = 0
+    undeleted_reviews = []
+
+    # When an entire row is selected for unassignment


This is interesting, it's seems you're actually fixing a separate bug here; please pull this out and make into into a new pull request with a description of just this bug.

david-yz-liu · 2024-10-24T14:18:48Z

app/controllers/peer_reviews_controller.rb

-      PeerReview.unassign(selected_reviewee_group_ids, reviewers_to_remove_from_reviewees_map)
+      reviews_deleted, deleted_count, undeleted_reviews = PeerReview.unassign(selected_reviewee_group_ids,
+                                                                              reviewers_to_remove_from_reviewees_map)
+      if !reviews_deleted && deleted_count == 0


I don't think this case needs a separate message, you can merge it with the next one (length <= 5). See also my suggestion for rewording the message down below.

david-yz-liu · 2024-10-24T14:23:36Z

app/assets/stylesheets/common/core.scss

@@ -498,6 +498,8 @@ option.uncollected {
 .flash-content {
  display: inline-block;
  padding-left: 5pt;
+  vertical-align: middle;
+  max-width: calc(100% - 3em);


Keep all rules alphabetically ordered (I'm surprised the pre-commit hooks didn't pick up on this, but that's something I'll look into separately!)

david-yz-liu · 2024-10-24T14:25:45Z

config/locales/views/peer_reviews/en.yml

@@ -9,6 +9,9 @@ en:
    assigned_reviewers_header: Reviewers
    errors:
      cannot_allow_reviewer_to_be_reviewee: A student cannot be a reviewer and reviewee
+      cannot_unassign_all_reviewers: 'Cannot unassign all selected peer reviewers due to existing marks or annotations. %{deleted_count}  peer reviewer(s) were unassigned, but the following could not be: %{undeleted_reviews}.'


Reword to "Successfully unassigned %{deleted_count} peer reviewer(s), but could not unassign the following due to existing marks or annotations: ..."

david-yz-liu · 2024-10-24T14:28:07Z

spec/controllers/peer_reviews_controller_spec.rb

+          @reviewer = Grouping.find_by(id: @selected_reviewer_group_ids[0])
+          @reviewee = Grouping.find_by(id: @selected_reviewee_group_ids[1])
+          allow_any_instance_of(PeerReview).to receive(:has_marks_or_annotations?).and_return(true)
+          selected_group = {}


It's not really necessary to create separate hash variables like this, you can define it inline as { @reviewee.id => { @reviewer.id => true } } or something similar

david-yz-liu · 2024-10-24T14:29:01Z

spec/controllers/peer_reviews_controller_spec.rb

+          end
+        end
+
+        it 'does not delete the peer review' do


It's good to be testing whether or not the database was actually changed here, and you should be doing it in the other tests as well

david-yz-liu · 2024-10-24T14:29:53Z

spec/models/peer_review_spec.rb

@@ -88,4 +88,23 @@
      end
    end
  end
+
+  describe '#has_marks_or_annotations?' do


This set of test cases is incomplete, you should be adding more cases (don't just rely on code coverage to tell you whether the tests are complete or not)

hemmatio added 7 commits October 9, 2024 23:00

Rubocop fixes 3

6255df2

Merge branch 'master' of https://github.com/MarkUsProject/Markus into…

2e2abfc

… issue-7119

rubocop fixes

a91abc0

normalized i18n keys in locale file

1fb0715

Merge branch 'master' of https://github.com/MarkUsProject/Markus into…

f875fef

… issue-7119

fixed grammar error in success flash

da725bb

hemmatio marked this pull request as ready for review October 23, 2024 21:36

hemmatio requested a review from david-yz-liu October 23, 2024 21:37

Updated changelog.md

d07e887

hemmatio marked this pull request as draft October 23, 2024 21:48

hemmatio marked this pull request as ready for review October 23, 2024 21:48

hemmatio removed the request for review from david-yz-liu October 23, 2024 21:49

hemmatio marked this pull request as draft October 23, 2024 22:13

Created testcases to improve coverage for peer_review.rb and peer_rev…

0c18900

…iews_controller.rb

hemmatio marked this pull request as ready for review October 24, 2024 03:19

Process entire row selection to be treated as individual checkbox sel…

3d0b8dc

…ections (Previously row selections bypassed the necessary checks)

david-yz-liu reviewed Oct 24, 2024

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Prevent deletion of graded peer reviews #7263

Prevent deletion of graded peer reviews #7263

hemmatio commented Oct 10, 2024 •

edited

Loading

hemmatio commented Oct 23, 2024

coveralls commented Oct 23, 2024 •

edited

Loading

david-yz-liu Oct 24, 2024

david-yz-liu Oct 24, 2024

david-yz-liu Oct 24, 2024

david-yz-liu Oct 24, 2024

david-yz-liu Oct 24, 2024

david-yz-liu Oct 24, 2024

david-yz-liu Oct 24, 2024

david-yz-liu Oct 24, 2024

david-yz-liu Oct 24, 2024

david-yz-liu Oct 24, 2024

Prevent deletion of graded peer reviews #7263

Are you sure you want to change the base?

Prevent deletion of graded peer reviews #7263

Conversation

hemmatio commented Oct 10, 2024 • edited Loading

Proposed Changes

Type of Change

Checklist

Questions and Comments

hemmatio commented Oct 23, 2024

coveralls commented Oct 23, 2024 • edited Loading

Pull Request Test Coverage Report for Build 11493476708

Details

💛 - Coveralls

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

hemmatio commented Oct 10, 2024 •

edited

Loading

coveralls commented Oct 23, 2024 •

edited

Loading