Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Working Draft] Introduce Playwright test framework #368

Closed
wants to merge 50 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
50 commits
Select commit Hold shift + click to select a range
8c92bbc
initialize playwright framework with basic hello sine tests
terryzfeng May 30, 2024
7c38538
port over AW addmodule resolution test
terryzfeng May 31, 2024
d6696b5
prepare Playwright test framework
terryzfeng Jun 11, 2024
b87790a
update playwright CI to only test on chromium
terryzfeng Jun 11, 2024
dc5a278
remove realtime test start button
terryzfeng Jun 19, 2024
8f4404d
Tentative integration of audio worklet recorder
Kizjkre Jun 19, 2024
c5a7eef
Reduce file count per test
Kizjkre Jun 19, 2024
86f9e7e
compared MVP realtime audioContext to reference float32Array
terryzfeng Jun 19, 2024
82fe7f6
Fix lint errors
Kizjkre Jun 19, 2024
ba87acd
Remove unused import
Kizjkre Jun 20, 2024
d029f50
refactored test files and attempted python child process
terryzfeng Jun 20, 2024
fdb4415
fix merge
terryzfeng Jun 20, 2024
7665bbf
Merge remote-tracking branch 'origin/playwright-test' into playwright…
Kizjkre Jun 20, 2024
436bf6c
Python subproceas doesn't work
Kizjkre Jun 20, 2024
b9b13ba
Tentative integration of live test suite in web-audio-sampels
Kizjkre Jun 21, 2024
9bf7de0
refactor playwright tests for live-suite
terryzfeng Jun 21, 2024
2cb6ed3
@kizjkre partially integrate live test suite
terryzfeng Jun 21, 2024
0c41e3c
Create bufferinator and audio graph cache
Kizjkre Jun 26, 2024
4ddc7e9
Change default exports to named exports
Kizjkre Jun 26, 2024
0c9e322
bump playwright version
terryzfeng Jun 26, 2024
055cd61
implement library functions for dsp graph building and realtime and o…
terryzfeng Jun 26, 2024
6ee4009
feat: add playwright multiple chromium version support
terryzfeng Jun 27, 2024
32d2de3
style: fix ending newlines
terryzfeng Jun 27, 2024
07f9d48
regenerate reference sine from offline context AND same computer
terryzfeng Jun 27, 2024
8bfa140
regenerate reference sine from offline context AND same computer
terryzfeng Jun 27, 2024
ed1a633
Merge remote-tracking branch 'origin/playwright-test' into playwright…
Kizjkre Jun 27, 2024
c28ee78
Connect tests to live suite
Kizjkre Jun 28, 2024
21cbcac
Fix bug where DSP graph evaluation could only be run once
Kizjkre Jun 28, 2024
5811046
Integrate evaluation function into live suite
Kizjkre Jul 2, 2024
126c6f1
refactor realtime-sine test as test example
terryzfeng Jul 2, 2024
c54cd52
Small live suite fixes
terryzfeng Jul 2, 2024
36f7b81
Capture console output in live suite
Kizjkre Jul 2, 2024
55bfdcf
Add % match and tolerance to realtime sine
Kizjkre Jul 3, 2024
681466a
Add assert functionality
Kizjkre Jul 3, 2024
fa96163
playwright test suite refactor and live suite implementation
terryzfeng Jul 3, 2024
d0255be
Port gain perf test and optimize CI
terryzfeng Jul 3, 2024
fe8120d
Port gain perf test and optimize CI
terryzfeng Jul 3, 2024
5e8e33d
Increase tolerance
Kizjkre Jul 3, 2024
7380986
Merge remote-tracking branch 'origin/playwright-test' into playwright…
Kizjkre Jul 3, 2024
16b13fc
lower threshold
terryzfeng Jul 3, 2024
c4df71c
update record impl to record exact number of samples
terryzfeng Jul 6, 2024
bd0360f
update record logic and style and add documentation
terryzfeng Jul 8, 2024
eca95f1
PR review fixes
Kizjkre Jul 9, 2024
eaaef2d
Port gain perf test and optimize CI
terryzfeng Jul 3, 2024
986691c
lower threshold
terryzfeng Jul 3, 2024
11cbfdd
update record impl to record exact number of samples
terryzfeng Jul 6, 2024
676d2b0
update record logic and style and add documentation
terryzfeng Jul 8, 2024
51409a5
PR review fixes
Kizjkre Jul 9, 2024
a3bcd9e
Merge branch 'playwright-test' of https://github.com/GoogleChromeLabs…
Kizjkre Jul 10, 2024
8a51198
Small fix
Kizjkre Jul 10, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 30 additions & 0 deletions .github/workflows/playwright.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
name: Playwright Tests
on:
push:
branches: [ main, master ]
pull_request:
branches: [ main, master ]
jobs:
test:
timeout-minutes: 60
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/setup-node@v4
with:
node-version: lts/*
- name: Install dependencies
run: npm ci
- name: Install Playwright Browsers
run: npx playwright install --with-deps chromium
- name: Run Playwright tests
# Only test on Chromium
# Each version of playwright is tied to the latest version of Chromium (at the time). The version is listed here:
# https://github.com/microsoft/playwright?tab=readme-ov-file#documentation--api-reference
run: npx playwright test --project=chromium
Kizjkre marked this conversation as resolved.
Show resolved Hide resolved
- uses: actions/upload-artifact@v4
if: always()
with:
name: playwright-report
path: playwright-report/
retention-days: 30
12 changes: 11 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
@@ -1,3 +1,13 @@
.DS_Store
node_modules/
_site/
_site/

## Playwright-specific ignores
/test-results/
/playwright-report/
/blob-report/
/playwright/.cache/

## IDE and runtime ignores
/.idea
bun.lockb
Loading
Loading