Flow Basic regression testing Data approval

Testing Data approval prototype

Currently we have two data approval types in place, ordered and unordered. Only the ordered one is fully supported and thus when testing only focus on the ordered one.

Creating a data approval group

1. Go to Data tab in dashboard - check new subtab is shown - Data approval
2. Click on Data approval subtab - check that you see a list of existing workflows (or an empty list if none are created yet) with 3 columns (Name, Type, two action links - edit and delete) and that you have the button Add approval group available
3. Click on Add approval group and the editing window should open with Name, Approval type, Steps, + Add step, cancel and save
4. Add name "cancel test" and hit Cancel > you are brought back to the list of existing approval groups and the Cancel test approval group does NOT exist
5. Create a new approval group - Name: release version-ordered; type: ordered with 5 steps and save > you are brought back to the list and the new group is shown in the list in alphabetical order
6. Click on edit of the new group and check all settings are still the same, all 5 steps are shown and in the proper order; click cancel that will bring you back to the list
7. SKIP NOW: Create a new group - Name: release version-unordered; type: unordered with 3 steps and save. The 1st step you create should indicate that it is the 'default step'
8. SKIP NOW: Repeat step 6 for the unordered group
9. Create a third new approval group - Name: to delete, type - ordered with 2 steps > save
10. Open the "to delete" approval group again, delete the 2nd step and add it a new one with a different name. Save and check all changes are save.
11. In the list click on delete for the 'to delete' group > group is deleted and not in the list anymore
12. Refresh Flow dashboard and cross check that the deleted group is still deleted, that the ordered and unordered groups have all settings still properly set

Adding an ordered approval group to a survey

To run this test you need to have a few test user accounts in place.

1. Open a survey on the dashboard
2. Go to Survey basics > Advanced Settings - you should see two unchecked boxes, one for enabling monitoring and one for enabling data approval
3. Enable monitoring on the survey if it is not monitored (you should select a survey that has some data already collected)
4. Check the Save button is now enabled as well - is blue again and not grey
5. Select Enable data approval > a dropdown with the list of existing approval groups show, with the new ones you have created
6. Select release version - ordered group and click on Show approval
7. All step are shown in proper order, the type is indicated correctly as well
8. Click on the user icon for a step
9. You receive a list of users to select from (users who have view data permission for this survey)
10. Select one or multiple user per step > user is assigned to the step. (Make sure you assign test users you have access to to cross check if assignment logic works when executing the approval)
11. Save changes for the survey
12. refresh the dashboard, open the survey again and cross check all changes are saved properly
13. Open another survey and repeat the above steps, make sure that you can add everything differently for the same approval group but for a different survey
14. Open and 3rd survey and repeat steps: Add an ordered approval group. Do not assign users to this approval group

Approving data

You will need all three surveys that you have assigned data groups to to have data points with data.

For Ordered approval groups with no user limitation

1. Go to the Data tab and Monitoring subtab
2. Open the survey that has an approval group assigned to it, but NO responsible users and click to find data
3. Data points are shown in the list. In the new column Approval status all points have the 1st step and status 'pending'
4. No user (your current user, all your test users) can change the points approval status

For ordered approval groups with user limitations

(You are logged in user was assigned to step 2)

1. In Monitoring subtab of the Data tab select your survey that has an ordered approval group and responsible users per steps assigned to it
2. The data points are shown on the list of points and for the Approval status they all have 1st step - pending
3. Open a data point, you cannot make any changes - you do not see the dropdown, comment box or submit for the 1st or any steps, not even step 2 that you are responsible for.
4. Log out of the dashboard and log in with the test user account who is responsible for step 1
5. Select the survey in the Monitoring tab again.
6. Open a data point, you should now be able to change the point status for step 1
7. For the 1st data point make the status approved and add a comment > the status change, timestamp and user name are logged down. The 2nd step is now in status 'pending' but there is no submit not comment box for you open to change it.
8. For the 2nd data point change the status to 'pending'. Change is logged down, and the 1st step is still open while the 2nd step is still closed for editing
9. For the 3rd data point change the status to 'rejected'. Change is logged down and the 1st step is still open while the 2nd step remains closed
10. Log out of the dashboard and log in with the test user who is responsible for the 2nd step of the approval group.
11. Select the survey in the monitored tab and you should see the changed statuses for the 3 data points.
12. Open the point where the status is now in the 2nd step - pending. You cannot make any changes to the 1st step but only to the 2nd step. Approve the 2nd step. Now the status is in the 3rd step - pending, but you cannot edit it.
13. Open the point where the status is in the 1st step - pending. You cannot make changes to the step.
14. Open the point where the status is in the 1st step - rejected. You cannot make changes to the step.

SKIP NOW: For unordered approval groups with no user limitations

1. In the Monitoring subtab of the Data tab, select the survey where you have an unordered approval group with no users assigned to it.
2. Data points are shown in the list and the approval status is the default status (1st step in the approval group).
3. Open the 1st data points approval status > you see a dropdown with all steps for this approval group, a comment box and a submit button.
4. Select one step from the dropdown, write a comment and hit submit. The status is now logged down with the step name, time stamp, your name and comment you added.
5. Repeat 4. twice. You should be able with all attempts to choose from all steps in the list regardless if they were selected before or not and each submission is logged down with the latests on the top of the list.
6. Change the status of 2 more data points. Make sure each of the three points has a different status in the end.

SKIP: For unordered approval groups with user limitations

1. In the Monitoring subtab of the Data tab, select the survey where you have an unordered approval group with users per steps assigned to it.
2. Data points are shown in the list and the approval status is the default status (1st step in the approval group).
3. Open the 1st data points approval status > you see a dropdown with only the steps you are responsible for, a comment box and a submit button.
4. Select is from the dropdown, write a comment and hit submit. The status is now logged down with the step name, time stamp, your name and comment you added.
5. Repeat once more. You can only, with all attempts, choose from the steps you are responsible for in the list regardless if they were selected before or not and each submission is logged down with the latests on the top of the list.
6. Change the status of 2 more data points.