Feature: Send Jobs to Orca #275

williams-jack · 2023-07-29T22:28:26Z

Problem

Bottlenose should be able to send a job to Orca with the requisite execution information, priority, response information, and more. It should then be able to take in a response, verify it is coming from the correct source, and then record its output to be compared to its current output later on.

Solution

Grading job creation with file URLs, a grading script to be executed on a worker, queue information, and response information.
New response route that saves the complete logs and output (if available) from Orca.
Secret handling as a source of authentication to ensure no bogus files are created.

Location of generate_grading_job_metadata_table moved

fix: empty starter zip should not be added feat: docker file for junit grader

Feature: Handle Orca Response

…sons Feature: Grading Job Generation

Additionally, response URL is added in the grading_job

app/models/graders/junit_grader.rb

* Move route to collection since no specific grade. * Fetch grade and grader spearately -- they should not take in id. * Process boolean, int and null from string.

chore: add experimental warning to use orca label

Status column should only indicate if the grader is supposed to use Orca; everything else is saved to a file. Additionally, no build key needed given that grade id can be specified in the url.

* Pushing grader builds to Orca, as well as the ability to retrigger this flow. * Statuses from Orca for both individual grading jobs and image builds. * UI for build logs and job build logs.

app/models/grade.rb

app/views/grades/_orca_output.html.erb

refactor: unnecessary setting of optparse banner

williams-jack and others added 22 commits July 2, 2023 13:39

feat: grading job json generation

d8189aa

refactor: move script location and delay computation

08c1eb0

fix: destructuring array doesn't work in each loop

dee2012

refactor: resource_files moved out of grader

b8aee58

Location of generate_grading_job_metadata_table moved

refactor: move delay_for_sub to grader.rb

51ef051

fix: replace cmd strings with string[]

137fab1

feat: zip processing for junit grader

aa445a8

fix: typos, conditional logic, and tree cmds

86b4e9a

feature: include starter and/or testing zips in job

926d678

fix: empty starter zip should not be added feat: docker file for junit grader

feat: bottlenose saves Orca TAP

43803fa

Merge branch 'master' into feature/handle-orca-response

1aee430

Merge branch 'master' into feature/create-grading-job-jsons

e7b5fac

chore: rename grader_path to grader_dir

12be1b3

chore: rename java dockerfile with shasum name

404da95

feat: docker sha for java image spec

f68bb9d

feat: orca response shell logs and errors saved

f38728b

fix: response key used; route post spec

8385fa0

Merge pull request #2 from williams-jack/feature/handle-orca-response

423d106

Feature: Handle Orca Response

Merge pull request #1 from williams-jack/feature/create-grading-job-j…

d3f7f14

…sons Feature: Grading Job Generation

feat: orca POST req and secret creation

43ddb54

fix: typo and addition of status to exception

ee8eabb

feat: response route with secret handling

c7717c6

Additionally, response URL is added in the grading_job

williams-jack marked this pull request as draft July 29, 2023 22:28

fix: rm secret file after verification

da0df7d

williams-jack commented Jul 29, 2023

View reviewed changes

app/models/graders/junit_grader.rb Outdated Show resolved Hide resolved

williams-jack added 5 commits July 29, 2023 23:18

qa: testing all states given for response handling

de5951b

fix: response handler params and resource fetching

ab74ec5

* Move route to collection since no specific grade. * Fetch grade and grader spearately -- they should not take in id. * Process boolean, int and null from string.

refactor: pull out retry/backoff with req into helper

0f9017d

fix: orca_response remove before action

8f148e0

feat: settings orca default URL for dev

f885167

williams-jack added 13 commits July 18, 2024 21:07

feat: block grader secrets from file endpoint

3e590a6

refactor: move grader secret path check to grader class

6612be5

Merge branch 'master' into feat/add-orca-status

997e7c7

feat: initial controller and ui for build results

9c6a574

feat: build log ui and link from edit assignment

17ef005

chore: add experimental warning to use orca label

fix: only render red highlight for specific error

470d111

fix: orca_response doesn't need assignment or course id

0a1df40

chore: remove old junit script json file

705f49e

feat: render orca tap output for junit

ca6ea90

fix: starter and testing zip files generated properly

f212585

fix: change mime types and adjust script based on orca run

b9b5ec4

Merge branch 'feat/add-orca-status' into feature/send-jobs-to-orca

b24b015

refactor: move build result to file, use status col as boolean

67ac27e

Status column should only indicate if the grader is supposed to use Orca; everything else is saved to a file. Additionally, no build key needed given that grade id can be specified in the url.

williams-jack mentioned this pull request Jul 26, 2024

Feature: status Column on Graders to Indicate Orca Usage #284

Closed

williams-jack added 6 commits July 30, 2024 23:40

feat: build request, rebuilding, logs, and statuses

641abd6

* Pushing grader builds to Orca, as well as the ability to retrigger this flow. * Statuses from Orca for both individual grading jobs and image builds. * UI for build logs and job build logs.

feat: handle new job status data definition from orca

b90d8d3

feat: use orca api key for mutation endpoints

4c65ed3

fix: use find module to include dot files in zip

dddccb8

fix: missing host in response_url for image build

eed9fc0

feat: tap comparison between bottlenose and orca

60a3ee8

blerner reviewed Aug 3, 2024

View reviewed changes

app/models/grade.rb Outdated Show resolved Hide resolved

app/models/grade.rb Outdated Show resolved Hide resolved

app/views/grades/_orca_output.html.erb Outdated Show resolved Hide resolved

williams-jack added 6 commits August 4, 2024 17:59

feat: rails agnostic script to push custom grader to orca

484d335

fix: up/down chevron dynamic based on click

b0ef09c

refactor: updated tap comparison handling

5f9de07

feat: get all submissions with orca tap diff

5ea0ca0

refactor: unnecessary setting of optparse banner

feat: lock down orca-related controllers and views to admins

c8c77ce

fix: updated grades api tests

cec0e70

williams-jack marked this pull request as ready for review August 5, 2024 02:19

test: grades api missing key and job status update

731c183

blerner merged commit 4cff5db into CodeGrade:master Aug 12, 2024
1 check passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Feature: Send Jobs to Orca #275

Feature: Send Jobs to Orca #275

williams-jack commented Jul 29, 2023

Feature: Send Jobs to Orca #275

Feature: Send Jobs to Orca #275

Conversation

williams-jack commented Jul 29, 2023

Problem

Solution