Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Runtime: automated end-to-end integration tests #55

Open
camerondurham opened this issue Mar 9, 2022 · 0 comments
Open

Runtime: automated end-to-end integration tests #55

camerondurham opened this issue Mar 9, 2022 · 0 comments
Labels
runtime Engine runtime handles safely executing user submitted code

Comments

@camerondurham
Copy link
Owner

Create end-to-end integration tests for limiting behavior. Should create runner struct and send code that will test the num procs limit, timeout limit and other limits as needed.

Requirements:

  1. verify runtime agent returns an error when program exceeds timeout limit
    1. and that execution does not exceed TimeoutLimit + epsilon
  2. verify runtime agent returns an error when program exceeds max num procs limit
    1. (note: this will be hard to verify at an OS level, at least returning an error should be okay for now)
  3. verify runtime agent returns an error when program exceeds max file size creation limit
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
runtime Engine runtime handles safely executing user submitted code
Projects
Development

No branches or pull requests

1 participant