Releases: cta-wave/dpctf-test-runner
Releases · cta-wave/dpctf-test-runner
Test Runner v2.0.0
CTA WAVE Streaming Media Test Suite - Devices: Test Runner Release v2.0.0
With this release come new features and several bug fixes:
- Test Subset: define subsets to enable quick selection in the configuration page, as well as tags that are used in filters
- Better Logging: logs are sent to the server frequently and are included in the json results
- HbbTV Support: all control pages now support HbbTV
Changelog:
Features:
- feat: add tags and subsets with filters and messages in config page (#37)
- feat: upgrade bulma to 1.0.0 and fontawesome to 6.5.2 (#54)
- feat: add dynamic test subset selection (#52)
- feat: add function to override test timeout (#50)
- feat: make control pages responsive, clean up (#45)
- feat: add logs cache for tests
- feat: add logs to reported result
- feat: add delay to next.html
- feat: add hbbtv support to all html files
Fixes:
DPCTF Test Runner v1.0.0
This release marks the first feature complete version of the DPCTF Test Runner.
Features
a98ec9c Implemented detailed test selection in configuration view
4cc7d60 Implemented host_override parameter to override the wpt configured hostname
bbddc6c Implemented api result import
5c3bf2b Added execution mode to config
7e6497c Implemented pre-test control page
Improvements
2f28369 Inverted qr colors of pre test page
3139550 Updated import-tests.sh to import test-config.json
f83ba64 Using MD5 test id in pre test QR code instead of test file path
DPCTF Test Runner v0.4.4
This release fixes compatibility with the new dpctf-tests file structure.
Fixes
- Updated import-tests.sh script according to new dpctf-tests structure
Changelog
Updated documentation
- added introduction to first page
- added descriptions for links on first page
- added indicators for DPCTF specific documentation
DPCTF Test Runner v0.4.3
This release fixes the malfunctioning listening for device events, used in the DPCTF control pages.
Fixes:
- Fixed listening on device events in wave-service.js
DPCTF Test Runner v0.4.2
Fixes:
- Fixed custom timeouts in config.json not working
- Fixed malfunctioning sending of events in wave-service.js for tests
DPCTF Test Runner v0.4.1
Fixes:
- UI, control pages and tests can't communicate over event channels
Changelog:
- Updated wave-service.js to support the new event API for sessions and devices
DPCTF Test Runner v0.4.0
New features:
- Improved reliability of http polling event system
- Added guide on sending and receiving session events
Fixes:
- Fixed sessions not resuming after server restart
Changelog:
Test Runner
- Removed webhook related code
- caching events
- Implemented wpt resource that returns the wave config
- made wave code compatible with python 3
- moved adding --report argument to wave.py
REST API
- always returning events as array
- added 'last_event' query parameter to get event diff if available
- Added DPCTF Test Runner version string to General API status
Documentation
- added documentation for configuration parameters in config.json
- renamed WAVE Test Suite to WAVE Test Runner in the documentation
- updated documentation for changed listen session events endpoint
to always return events as array and include new query parameter
last_event - Updated documentated usage guide to contain the namespace for URLs
- added 'id' to observation completed payload
- added new event 'playback'
- renamed event type 'perform observation' to 'test ready'
- added event type 'observation ready'
- Added a more elaborate description for observation events
- Added sessions-events.md in rest api guides
Tests
- implemented test to start the wave server and ping an API endpoint
DPCTF Test Runner v0.3.0
New features:
- Added REST API Guides section
- Specified session events to perform and complete observations
- Using ISO 8601 date format instead of milliseconds
- Implemented general API status endpoint
- Implemented read sessions REST API endpoint
Fixes:
- Fixed session APIs push event endpoint
Change notes:
Test Runner
- including version string in status endpoint of general api
- improved precision of internal date handling
- returning dates in ISO 8601 format in REST API
- added GeneralApiHandler
- renamed configuration parameter enable_results_import to enable_import_results
- added configuration parameter enable_read_sessions
- disabling read sessions endpoint when setting enable_read_sessions
parameter - added date_created data field to sessions
Documentation
- updated documentation of status endpoint to contain version_string
- added documentation for labels field in read session endpoint
- updated documentation to ISO 8601 date formats
- added date_created to read session documentation
- added documentation for session APIs push event endpoint
- added documentation for session events
- added documentation for the status endpoint of the general api
- removed documentation for import enabled endpoint of results api
- removed documentation for config endpoint of results api
- added documentation for read sessions REST API endpoint
- added event specification to session event types documentation
Tests
- added REST API test for server status endpoint
- updated REST API tests to new ISO 8601 format
- updated REST API tests to changes in returned payload of read session
and read session status endpoints - updated REST API tests structure of create session, read session and
read session status tests - implemented REST API tests for read sessions
wave-service.js
- parsing utc iso strings
- implemented function for server status in wave-service.js
REST API
- removed read results config endpoint
- added read sessions REST API endpoint
- added related links to read sessions endpoint
- implemented expand functionality to read sessions endpoint
- using HAL format in read sessions endpoint
- added api/status endpoint
- fixed results api read results endpoint to return 404 if no session
could be found
Guides
- added rest api guides to documentation
- added rest api guide for starting sessions on DUT using devices API
DPCTF Test Runner v0.2.0
New features:
- Implemented support for test parameters
- Implemented new DPCTF workflow
Change notes:
test runner
- adding query parameters specified in session config to served tests
- added type property to session
- serving different control pages for different session types
documentation
- added documentation for new session property 'type'
- added documentation for test parameters
testharnessreport
- formatted using prettier
- refactored parsing of query parameters
control pages
- added dpctf landing page
- added dpctf specific pause and finish control pages
- introduced screen-console.js to improve code reusability and
maintainability - introduced query-parser.js to improve code reusability and
maintainability
wave-service.js
- implemented readDevice method to read device information
- added event constants
Additional notes:
Devices get unregistered when starting a session on them. On control pages they register as a new device to allow starting new sessions, however they will have a new identifier.
DPCTF Test Runner v0.1.0
Implemented Devices API to control devices under test
test runner:
- added devices manager
- automatically removing inactive devices
- added events to reported new and deleted devices
- added token as identifier for EventListeners
- removing HttpPollingEventListener once they are used
- renamed Client to EventListener
- renamed HttpPollingClient to HttpPollingEventListener
- renamed EventDispatcher internal variables
- using proper logging in HttpHandler
- fixed resuming session after restarting server
REST API:
- added create device endpoint
- added endpoints to read all and specific devices
- added endpoints for device specific and global device events
- added endpoint to post events for specific devices or globally
- added API endpoint to push session specific events
Postman:
- implemented devices api postman tests
- added web_root and device timeout to postman environment
wave-service.js:
- implemented new API to handle device events
- added methods to send device events
documentation:
- added documentation for devices api
Added import-tests.sh script to import dpctf tests
Merged W3C Remote Test Runner
- moved wave specific code from serve.py into wave.py