Execute all test controller items in one go

[vinistock]

Motivation

Currently, each test item in the controller is executed in a separate process, which is a bit wasteful given that we only display the tests for the current file.

We can instead execute all tests in a single command and then just parse the output to show to the user.

Implementation

The basic idea is:

1. Flatten the test list. Initially, the test items are nested (i.e.: test methods are inside classes). We need a flat list that only includes the specific examples that will be executed
2. Then we generated the command to execute all selected examples in one go. For Minitest and test-unit, that means creating a big regex that will match all selected examples. For Rails, it just means adding all paths and line numbers (e.g.: test/foo_test.rb:5 test/foo_test.rb:15...)
3. If all tests pass, then we just update that they all passed. If something fails, then we need to parse the output, match the failure message with the test item and only fail those

Manual Tests

Suggested repos:

• ruby-lsp -> minitest
• ruby-lsp-rails -> rails
• yarp -> test-unit

1. Open any test file
2. Execute tests, verify that all results show up simultaneously
3. Introduce an intentional failure
4. Run the tests
5. Verify the failure shows up with the correct message

[KaanOzkan]

I can't get the failures to show up when I run all tests in a file. For both exceptions and incorrect assertions.

[KaanOzkan]

Getting Variable 'testItem' implicitly has type 'any' in some locations where its type cannot be determined. locally from TS lsp.

[vinistock]

This is quite complicated to get right and feels a bit too rigid. I'm closing this for now.