Upmerge 7 24 #19
Merged
Upmerge 7 24 #19
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This is required dependendy for MCP.
Allows to use PyPTS without having a PTS Bluetooth device plugged in. Useful in autopts tools e.g. for listing test cases enabled in PTS workspace.
Refactor to use PyPTS interface and autopts client methods.
The get_filtered_test_cases will be used by other autopts tools.
The run_or_not() will be used by other autopts tools
All variables used in: if __name__ == '__main__': are seen as global variables and waste namespace that could be used for loacal variables in functions.
Time duration was printed with microsecond accuracy. It's unnecessary and looks weird: Execution Time: 0:36:36.852818
- Add AutoPTSMagicTagParser to parse additional options like -e option used for listing prefixes of excluded test cases, - Extend cron comment with info about estimated time duration and number of test cases to be run, - GitHubCron is more independent module now and can be reused more easily.
Useful for cleanup cron comments while testing the cron features.
Add script for parsing compatibility.csv. The compatibility.csv file should contain 3 columns, PTS version, AutoPTS repo hash and project repo hash. Each row denotes a compatible set of versions. The script allows to match the compatible set for the given version/hash.
- add commands for checkouting repos and starting autoptsserver in VM via SSH, - add 'cron' setting to config.py, - add 'autopts_repo' parameter that allows to use other auto-pts repo instance than the one used by cron.
autoptsserver/PTS restarts slower on Windows VM so this parameter should be configurable.
Cron generates a file with additional info about PR comment which triggered a bot run.
A command like: #AutoPTS cancel https://github.com/auto-pts/auto-pts/pull/xxx#issuecomment-xxxxxxxx will cancel job scheduled with the given command.
…nation There is rare random dead lock in S-65000-PTS thread around PTS restart procedure. Thanks to logging the thread stacks in the print_thread_stack_trace() we found out that the thread locks in init_attributes() at intruction self._pts = None Let's hope that deleting those objects before forcing the PTS process termination will free enough resources so the test run could continue without interruption.
Under linux, replugging a board using YKUSH may cause a change
of the tty file name. Having an udev rule like:
SUBSYSTEM=="tty", ATTRS{serial}=="1234567890", SYMLINK+="ttymyNRF53"
allows to resolve the permanent alias name to the real tty address.
Add jobs for starting/closing VM. Add jobs for merging splitted TestCase.db
Logs about a ykush replugging at startup were not printed anywhere. Print exception message after build and flash error.
zephyrproject-rtos/zephyr#51831 Signed-off-by: Aytürk Düzen <ayturk.duzen@nordicsemi.no>
Result of the last test case before next rebuild was printed after the rebuild, e.g.: ... 31/32 MBT MBT/CL/BT/BV-07-C PASS 38.097 32/32 MBT MBT/CL/BT/BV-08-C -- west build: generating a build system Loading Zephyr default modules (Zephyr base). ... Applying pin reset. -- runners.nrfjprog: Board with serial number 683511993 flashed successfully. PASS 31.924
If multiple devices were plugged in, a JLink popup window would suspend the flashing process.
The option allows to set the waiting time for PTS initialization or restart.
This commit changes pull_request event to pull_request_target event. This gives an access to a read/write token as well as secrets enabling github actions bot to comment on pull request to trigger cron.
If a magic tag command does not contain a name of a board that should be used for AutoPTS testing, automatically assign tests to the correct boards.
Some logs are skipped between rebuilds if have not been flashed before check_call.
Take the login of repo owner instead of the login of the PR creator.
Address_count and addr array is added to set_lock and set_release btp commands. This will allow to perform these procedures on a specific subset of set members.
Unification of CSIP preconditions for 3 lower testers, removing unnecessary synch point
Enable EATT for GATT tests. This triggers PTS Issue (added specific test cases to mynewt.yaml) - PTS database is missing Server Supported Features Charateristic.
The time needed to enumerate a board may differ between machines. If it happens too quickly, a board lacks time to cool down and reset. Let's make the delay between ykush power on/off commands configurable with ykush_delay option.
If the result of the recover_pts has been cleared by a late LTThread, we end up with dead loop. Let's just pull and compare restart times of the PTS and break loop if restart detected.
This seems to be needed now when GITHUB_TOKEN is used.
This commit adds repeat_until_fail parameter that can be used when running autoptsclient_bot. This can be helpful when debugging and collecting logs from tests that randomly fail from time to time.
Add set pts addr func for gatt/sr test cases.
remove pairing
add test case to errata list
By using test_case_limit param when triggering cron, we can limit number of test cases to be run when passing only test case prefix (e.g. GATT, GAP)
Add missing argument to mynewt wid_hdl to avoid "TypeError: hdl_wid_() takes 0 positional arguments but 1 was given"
This patch adds progresses to mynewt email report.
Adding test cases to mynewt errata list
Adding the WID 395 to add support for testing Sending Proxy Solicitation feature (TSCP_MESH_12_11) Signed-off-by: alperen sener <alperen.sener@nordicsemi.no>
It is not working as intended.
This includes update to TCRL 2024-1.
MESH/SR/RPR/LNK/BV-12-C tries to trigger invalid behavior. Test case errata: ES-25544 Test case waiver: ES-25549 Signed-off-by: alperen sener <alperen.sener@nordicsemi.no>
This was causing script to not being able to locate required imports.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
regular autoPTS upmerge