Test report · Automated E2E regression
| Trigger | Merge to release/4.2 + nightly at 17:20 UTC |
|---|---|
| Test data | Seed script creates 3 tenants, 120 customers, 1,284 invoices before each run |
| Isolation | Each test logs in with its own user; tests can run in any order |
| Artifacts | HTML report, traces and videos for failures and retries, kept 30 days |
| Shards | #1: 13 min 14 s · #2: 13 min 42 s · #3: 13 min 04 s · #4: 13 min 32 s |
| Quality gate | Merge blocked on any failure; flaky tests reported but not blocking |
invoices/create › sends invoice email Email assertion races the mail queueqa-e2e#212. Not a product defect.recurring › creates next invoice at midnight Test depends on the shared staging clocknow override. Quarantined until fixed; covered manually this release.| Test | −9 | −8 | −7 | −6 | −5 | −4 | −3 | −2 | −1 | Now |
|---|---|---|---|---|---|---|---|---|---|---|
| invoices/create › sends invoice email | ✓ | ✓ | retry | ✓ | ✓ | retry | ✓ | ✓ | retry | retry |
| recurring › creates next invoice at midnight | ✓ | ✓ | ✓ | retry | ✓ | ✓ | ✓ | ✓ | retry | retry |
Last 10 runs, oldest left. 'retry' = failed on the first try, passed on retry.
| Key | Summary | Severity | Status | Component | Found by | Owner | Created |
|---|---|---|---|---|---|---|---|
ACME-512 | Expired invoices still listed and counted on dashboard | High | Fixed | Invoices | invoices/retention | Backend | 20 Oct |
ACME-517 | Portal shows 'Pay' button on an invoice already paid by card (until refresh) | Medium | Fixed | Customer portal | portal/customer-portal | Frontend | 20 Oct |
ACME-518 | XLSX export: date column formatted as text | Low | Fixed | Reports | reports/month-end | Backend | 21 Oct |
ACME-519 | Visual diff: totals block shifted 4 px on invoice editor in German Cosmetic; baseline kept, fix in 4.2.1. | Low | Deferred | Invoices UI | visual | Frontend | 21 Oct |
QA-212 | Test: email assertion races the mail queue Test defect, not a product bug. | Low | In progress | Test suite | invoices/create | QA | 22 Oct |
QA-213 | Test: scheduler test depends on shared staging clock Test defect; quarantined, covered manually. | Low | Open | Test suite | recurring | QA | 22 Oct |
| ID | Area | Observation | Impact | Suggested action |
|---|---|---|---|---|
OBS-01 | Speed | Total test time 53 min 31 s; wall clock 12 min on 4 shards. Shards are uneven because PDF tests cluster. | CI time | Rebalance shards by duration using Playwright timing data. |
OBS-02 | Coverage | Settings → Integrations has 4 tests; the API suite covers the rest. | Low | Fine for now. |
OBS-03 | Duplication | Currency and VAT combinations in invoices/create overlap with API checks. | CI time | Move combinations to API level, keep 3 in E2E. |
OBS-04 | Stability | No test needed more than 1 retry; 0 tests are skipped or marked .fixme. | Positive | Keep the 'no skipped tests' rule. |
OBS-05 | Visual | 6 visual baselines updated this release, all reviewed in the PR. | None | – |
OBS-06 | Accessibility | axe checks compare 8 key pages with a baseline of 41 known violations (see the accessibility report); any new violation fails the build. | Info | Shrink the baseline as the accessibility fixes land. |
| Project | Tests | Passed | Flaky | Test time |
|---|---|---|---|---|
| Chromium | 271 | 269 | 2 | 26 min 04 s |
| WebKit | 257 | 257 | – | 27 min 27 s |
| Spec | Area | Tests | Passed | Flaky | Duration | Result |
|---|---|---|---|---|---|---|
auth/login.spec.ts | Authentication | 24 | 24 | – | 2 min 02 s | Pass |
auth/roles.spec.ts | Roles and permissions | 60 | 60 | – | 5 min 25 s | Pass |
customers/crud.spec.ts | Customers | 36 | 36 | – | 3 min 25 s | Pass |
customers/contacts.spec.ts | Customers | 16 | 16 | – | 1 min 25 s | Pass |
products/catalog.spec.ts | Products | 28 | 28 | – | 2 min 52 s | Pass |
invoices/create.spec.ts | Invoices | 44 | 43 | 1 | 4 min 28 s | Flaky |
invoices/list-filter.spec.ts | Invoices | 34 | 34 | – | 3 min 27 s | Pass |
invoices/pdf.spec.ts | Invoices | 20 | 20 | – | 3 min 49 s | Pass |
invoices/retention.spec.ts | Invoices | 10 | 10 | – | 1 min 03 s | Pass |
payments/record.spec.ts | Payments | 26 | 26 | – | 2 min 44 s | Pass |
payments/refund.spec.ts | Payments | 12 | 12 | – | 1 min 04 s | Pass |
credit-notes.spec.ts | Credit notes | 16 | 16 | – | 1 min 45 s | Pass |
recurring.spec.ts | Recurring invoices | 22 | 21 | 1 | 2 min 08 s | Flaky |
reminders.spec.ts | Payment reminders | 16 | 16 | – | 1 min 28 s | Pass |
reports/month-end.spec.ts | Reports | 20 | 20 | – | 2 min 23 s | Pass |
portal/customer-portal.spec.ts | Customer portal | 24 | 24 | – | 2 min 41 s | Pass |
settings/company.spec.ts | Settings | 16 | 16 | – | 1 min 54 s | Pass |
settings/integrations.spec.ts | Settings | 8 | 8 | – | 0 min 51 s | Pass |
webhooks-ui.spec.ts | Webhooks | 14 | 14 | – | 1 min 19 s | Pass |
users/invite.spec.ts | Users | 20 | 20 | – | 1 min 48 s | Pass |
audit-log.spec.ts | Audit log | 10 | 10 | – | 0 min 50 s | Pass |
dashboard.spec.ts | Dashboard | 12 | 12 | – | 1 min 03 s | Pass |
search.spec.ts | Search | 10 | 10 | – | 0 min 53 s | Pass |
i18n.spec.ts | Localisation | 16 | 16 | – | 1 min 26 s | Pass |
accessibility.spec.ts | Accessibility | 8 | 8 | – | 0 min 37 s | Pass |
visual.spec.ts | Visual regression | 6 | 6 | – | 0 min 44 s | Pass |
| Feature area | E2E tests | Xray requirements | Covered | Coverage |
|---|---|---|---|---|
| Authentication | 12 | 4 | 4 | 100% |
| Roles and permissions | 30 | 9 | 9 | 100% |
| Customers | 26 | 8 | 8 | 100% |
| Products | 14 | 4 | 3 | 75% |
| Invoices | 54 | 17 | 17 | 100% |
| Payments | 19 | 6 | 6 | 100% |
| Credit notes | 8 | 3 | 3 | 100% |
| Recurring invoices | 11 | 3 | 3 | 100% |
| Payment reminders | 8 | 3 | 2 | 67% |
| Reports | 10 | 3 | 3 | 100% |
| Customer portal | 12 | 4 | 4 | 100% |
| Settings | 12 | 4 | 4 | 100% |
| Webhooks | 7 | 2 | 2 | 100% |
| Users | 10 | 3 | 2 | 67% |
| Audit log | 5 | 2 | 2 | 100% |
| Dashboard | 6 | 2 | 2 | 100% |
| Search | 5 | 2 | 2 | 100% |
| Localisation | 8 | 3 | 3 | 100% |
| Accessibility | 8 | 3 | 2 | 67% |
| Visual regression | 6 | 2 | 2 | 100% |
Requirements are Xray requirement issues linked to at least one automated test. Uncovered ones are covered by manual or API tests.
| # | Spec | Test | Duration |
|---|---|---|---|
| 1 | invoices/pdf.spec.ts | PDF layout · reverse charge note WebKit | 15.3 s |
| 2 | reports/month-end.spec.ts | revenue report · year WebKit | 15.3 s |
| 3 | invoices/create.spec.ts | notes appear on PDF Chromium | 15.0 s |
| 4 | invoices/pdf.spec.ts | PDF layout · with logo WebKit | 14.9 s |
| 5 | portal/customer-portal.spec.ts | customer downloads PDF Chromium | 14.9 s |
| 6 | payments/record.spec.ts | reconcile from bank CSV WebKit | 14.8 s |
| 7 | invoices/create.spec.ts | adds 50 lines WebKit | 14.7 s |
| 8 | invoices/pdf.spec.ts | PDF layout · 20 lines WebKit | 14.5 s |
| 9 | visual.spec.ts | screenshot matches · invoice PDF Chromium | 14.4 s |
| 10 | invoices/list-filter.spec.ts | bulk download PDFs WebKit | 14.3 s |
| 11 | products/catalog.spec.ts | rejects CSV with missing columns WebKit | 14.2 s |
| 12 | portal/customer-portal.spec.ts | customer pays 3 invoices at once WebKit | 14.2 s |
| 13 | products/catalog.spec.ts | imports products from CSV Chromium | 14.1 s |
| 14 | invoices/list-filter.spec.ts | bulk download PDFs Chromium | 13.8 s |
| 15 | recurring.spec.ts | schedules · yearly Chromium | 13.6 s |
| Run | Started | Passed | Failed | Flaky | Notes |
|---|---|---|---|---|---|
| #1860 · rc3 | 23 Oct 08:05 | 526/528 | 0 | 2 | Release candidate |
| #1858 · rc3 | 22 Oct 17:21 | 526/528 | 0 | 2 | Nightly |
| #1855 · rc2 | 22 Oct 08:02 | 527/528 | 1 | 0 | Renamed button (test updated) |
| #1853 · rc2 | 21 Oct 15:40 | 526/528 | 0 | 2 | Nightly |
| #1849 · rc2 | 21 Oct 07:58 | 525/528 | 2 | 1 | ACME-512 related (2), flaky (1) |
| #1846 · rc1 | 20 Oct 17:30 | 523/528 | 4 | 1 | ACME-512 (3), ACME-517 (1) |
| #1841 · rc1 | 20 Oct 08:02 | 522/528 | 4 | 2 | First run of 4.2 |
| #1832 · 4.1.3 | 16 Oct 08:01 | 507/509 | 0 | 2 | Before 4.2 tests were added |
Every failure in the history was triaged the same day: product defects went to Jira, test defects to the QA board.
| Change | Tests | Why |
|---|---|---|
Added invoices/retention.spec.ts | +5 | ACME-488 data retention (new in 4.2) |
| Added recurring: preview, day 31 fallback | +2 | ACME-441 follow-ups |
| Added portal: magic link, notes as text | +2 | ACME-470, security finding SEC-02 |
| Added payments: bank CSV reconciliation | +2 | ACME-452 |
| Added accessibility checks (axe) on 8 pages | +8 | Accessibility audit recommendation |
| Planned: move currency combinations to API | 0 | 4.2.1 (OBS-03) |
auth/login.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | logs in · email + password | Chromium | 1.6 s | – | Pass |
| 2 | logs in · SSO (SAML) | Chromium | 5.3 s | – | Pass |
| 3 | rejects wrong password · email + password | Chromium | 2.0 s | – | Pass |
| 4 | rejects wrong password · SSO (SAML) | Chromium | 5.7 s | – | Pass |
| 5 | locks after 5 failures · email + password | Chromium | 2.4 s | – | Pass |
| 6 | locks after 5 failures · SSO (SAML) | Chromium | 6.1 s | – | Pass |
| 7 | remembers the last tenant | Chromium | 2.8 s | – | Pass |
| 8 | logs out from all tabs | Chromium | 6.5 s | – | Pass |
| 9 | password reset email arrives | Chromium | 3.2 s | – | Pass |
| 10 | reset link expires after 1 h | Chromium | 6.9 s | – | Pass |
| 11 | MFA code required for admins | Chromium | 3.6 s | – | Pass |
| 12 | MFA backup code works | Chromium | 7.3 s | – | Pass |
| 13 | logs in · email + password | WebKit | 4.6 s | – | Pass |
| 14 | logs in · SSO (SAML) | WebKit | 8.3 s | – | Pass |
| 15 | rejects wrong password · email + password | WebKit | 5.0 s | – | Pass |
| 16 | rejects wrong password · SSO (SAML) | WebKit | 8.7 s | – | Pass |
| 17 | locks after 5 failures · email + password | WebKit | 5.4 s | – | Pass |
| 18 | locks after 5 failures · SSO (SAML) | WebKit | 9.1 s | – | Pass |
| 19 | remembers the last tenant | WebKit | 5.8 s | – | Pass |
| 20 | logs out from all tabs | WebKit | 2.5 s | – | Pass |
| 21 | password reset email arrives | WebKit | 6.2 s | – | Pass |
| 22 | reset link expires after 1 h | WebKit | 2.9 s | – | Pass |
| 23 | MFA code required for admins | WebKit | 6.6 s | – | Pass |
| 24 | MFA backup code works | WebKit | 3.3 s | – | Pass |
auth/roles.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | sees the invoices list · Admin | Chromium | 7.5 s | – | Pass |
| 2 | sees the invoices list · Finance | Chromium | 4.2 s | – | Pass |
| 3 | sees the invoices list · Accountant | Chromium | 7.9 s | – | Pass |
| 4 | sees the invoices list · Sales | Chromium | 4.6 s | – | Pass |
| 5 | sees the invoices list · Viewer | Chromium | 8.3 s | – | Pass |
| 6 | can create an invoice · Admin | Chromium | 5.0 s | – | Pass |
| 7 | can create an invoice · Finance | Chromium | 1.7 s | – | Pass |
| 8 | can create an invoice · Accountant | Chromium | 5.4 s | – | Pass |
| 9 | can create an invoice · Sales | Chromium | 2.1 s | – | Pass |
| 10 | can create an invoice · Viewer | Chromium | 5.8 s | – | Pass |
| 11 | can send an invoice · Admin | Chromium | 2.5 s | – | Pass |
| 12 | can send an invoice · Finance | Chromium | 6.2 s | – | Pass |
| 13 | can send an invoice · Accountant | Chromium | 2.9 s | – | Pass |
| 14 | can send an invoice · Sales | Chromium | 6.6 s | – | Pass |
| 15 | can send an invoice · Viewer | Chromium | 3.3 s | – | Pass |
| 16 | can record a payment · Admin | Chromium | 7.0 s | – | Pass |
| 17 | can record a payment · Finance | Chromium | 3.7 s | – | Pass |
| 18 | can record a payment · Accountant | Chromium | 7.4 s | – | Pass |
| 19 | can record a payment · Sales | Chromium | 4.1 s | – | Pass |
| 20 | can record a payment · Viewer | Chromium | 7.8 s | – | Pass |
| 21 | can open settings · Admin | Chromium | 4.5 s | – | Pass |
| 22 | can open settings · Finance | Chromium | 8.2 s | – | Pass |
| 23 | can open settings · Accountant | Chromium | 4.9 s | – | Pass |
| 24 | can open settings · Sales | Chromium | 1.6 s | – | Pass |
| 25 | can open settings · Viewer | Chromium | 5.3 s | – | Pass |
| 26 | can invite users · Admin | Chromium | 2.0 s | – | Pass |
| 27 | can invite users · Finance | Chromium | 5.7 s | – | Pass |
| 28 | can invite users · Accountant | Chromium | 2.4 s | – | Pass |
| 29 | can invite users · Sales | Chromium | 6.1 s | – | Pass |
| 30 | can invite users · Viewer | Chromium | 2.8 s | – | Pass |
| 31 | sees the invoices list · Admin | WebKit | 7.1 s | – | Pass |
| 32 | sees the invoices list · Finance | WebKit | 3.8 s | – | Pass |
| 33 | sees the invoices list · Accountant | WebKit | 7.5 s | – | Pass |
| 34 | sees the invoices list · Sales | WebKit | 4.2 s | – | Pass |
| 35 | sees the invoices list · Viewer | WebKit | 7.9 s | – | Pass |
| 36 | can create an invoice · Admin | WebKit | 4.6 s | – | Pass |
| 37 | can create an invoice · Finance | WebKit | 8.3 s | – | Pass |
| 38 | can create an invoice · Accountant | WebKit | 5.0 s | – | Pass |
| 39 | can create an invoice · Sales | WebKit | 8.7 s | – | Pass |
| 40 | can create an invoice · Viewer | WebKit | 5.4 s | – | Pass |
| 41 | can send an invoice · Admin | WebKit | 9.1 s | – | Pass |
| 42 | can send an invoice · Finance | WebKit | 5.8 s | – | Pass |
| 43 | can send an invoice · Accountant | WebKit | 2.5 s | – | Pass |
| 44 | can send an invoice · Sales | WebKit | 6.2 s | – | Pass |
| 45 | can send an invoice · Viewer | WebKit | 2.9 s | – | Pass |
| 46 | can record a payment · Admin | WebKit | 6.6 s | – | Pass |
| 47 | can record a payment · Finance | WebKit | 3.3 s | – | Pass |
| 48 | can record a payment · Accountant | WebKit | 7.0 s | – | Pass |
| 49 | can record a payment · Sales | WebKit | 3.7 s | – | Pass |
| 50 | can record a payment · Viewer | WebKit | 7.4 s | – | Pass |
| 51 | can open settings · Admin | WebKit | 4.1 s | – | Pass |
| 52 | can open settings · Finance | WebKit | 7.8 s | – | Pass |
| 53 | can open settings · Accountant | WebKit | 4.5 s | – | Pass |
| 54 | can open settings · Sales | WebKit | 8.2 s | – | Pass |
| 55 | can open settings · Viewer | WebKit | 4.9 s | – | Pass |
| 56 | can invite users · Admin | WebKit | 8.6 s | – | Pass |
| 57 | can invite users · Finance | WebKit | 5.3 s | – | Pass |
| 58 | can invite users · Accountant | WebKit | 9.0 s | – | Pass |
| 59 | can invite users · Sales | WebKit | 5.7 s | – | Pass |
| 60 | can invite users · Viewer | WebKit | 2.4 s | – | Pass |
customers/crud.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | creates a customer · company | Chromium | 6.6 s | – | Pass |
| 2 | creates a customer · individual | Chromium | 3.3 s | – | Pass |
| 3 | creates a customer · EU company with VAT | Chromium | 7.0 s | – | Pass |
| 4 | edits a customer · company | Chromium | 3.7 s | – | Pass |
| 5 | edits a customer · individual | Chromium | 7.4 s | – | Pass |
| 6 | edits a customer · EU company with VAT | Chromium | 4.1 s | – | Pass |
| 7 | archives a customer · company | Chromium | 7.8 s | – | Pass |
| 8 | archives a customer · individual | Chromium | 4.5 s | – | Pass |
| 9 | archives a customer · EU company with VAT | Chromium | 8.2 s | – | Pass |
| 10 | search by name | Chromium | 4.9 s | – | Pass |
| 11 | search by VAT number | Chromium | 1.6 s | – | Pass |
| 12 | filter by country | Chromium | 5.3 s | – | Pass |
| 13 | filter by tag | Chromium | 2.0 s | – | Pass |
| 14 | export customers to CSV | Chromium | 12.2 s | – | Pass |
| 15 | cannot delete a customer with open invoices | Chromium | 2.4 s | – | Pass |
| 16 | merges duplicates | Chromium | 6.1 s | – | Pass |
| 17 | shows invoice history | Chromium | 2.8 s | – | Pass |
| 18 | shows open balance | Chromium | 6.5 s | – | Pass |
| 19 | creates a customer · company | WebKit | 3.8 s | – | Pass |
| 20 | creates a customer · individual | WebKit | 7.5 s | – | Pass |
| 21 | creates a customer · EU company with VAT | WebKit | 4.2 s | – | Pass |
| 22 | edits a customer · company | WebKit | 7.9 s | – | Pass |
| 23 | edits a customer · individual | WebKit | 4.6 s | – | Pass |
| 24 | edits a customer · EU company with VAT | WebKit | 8.3 s | – | Pass |
| 25 | archives a customer · company | WebKit | 5.0 s | – | Pass |
| 26 | archives a customer · individual | WebKit | 8.7 s | – | Pass |
| 27 | archives a customer · EU company with VAT | WebKit | 5.4 s | – | Pass |
| 28 | search by name | WebKit | 9.1 s | – | Pass |
| 29 | search by VAT number | WebKit | 5.8 s | – | Pass |
| 30 | filter by country | WebKit | 2.5 s | – | Pass |
| 31 | filter by tag | WebKit | 6.2 s | – | Pass |
| 32 | export customers to CSV | WebKit | 9.4 s | – | Pass |
| 33 | cannot delete a customer with open invoices | WebKit | 6.6 s | – | Pass |
| 34 | merges duplicates | WebKit | 3.3 s | – | Pass |
| 35 | shows invoice history | WebKit | 7.0 s | – | Pass |
| 36 | shows open balance | WebKit | 3.7 s | – | Pass |
customers/contacts.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | adds a contact | Chromium | 7.9 s | – | Pass |
| 2 | sets primary contact | Chromium | 4.6 s | – | Pass |
| 3 | only one primary contact | Chromium | 8.3 s | – | Pass |
| 4 | removes a contact | Chromium | 5.0 s | – | Pass |
| 5 | contact email used on invoice | Chromium | 1.7 s | – | Pass |
| 6 | validates email format | Chromium | 5.4 s | – | Pass |
| 7 | phone number formatting | Chromium | 2.1 s | – | Pass |
| 8 | billing vs technical contact | Chromium | 5.8 s | – | Pass |
| 9 | adds a contact | WebKit | 3.1 s | – | Pass |
| 10 | sets primary contact | WebKit | 6.8 s | – | Pass |
| 11 | only one primary contact | WebKit | 3.5 s | – | Pass |
| 12 | removes a contact | WebKit | 7.2 s | – | Pass |
| 13 | contact email used on invoice | WebKit | 3.9 s | – | Pass |
| 14 | validates email format | WebKit | 7.6 s | – | Pass |
| 15 | phone number formatting | WebKit | 4.3 s | – | Pass |
| 16 | billing vs technical contact | WebKit | 8.0 s | – | Pass |
products/catalog.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | creates a product · 23% | Chromium | 5.2 s | – | Pass |
| 2 | creates a product · 8% | Chromium | 1.9 s | – | Pass |
| 3 | creates a product · 5% | Chromium | 5.6 s | – | Pass |
| 4 | creates a product · 0% reverse charge | Chromium | 2.3 s | – | Pass |
| 5 | changes the price · 23% | Chromium | 6.0 s | – | Pass |
| 6 | changes the price · 8% | Chromium | 2.7 s | – | Pass |
| 7 | changes the price · 5% | Chromium | 6.4 s | – | Pass |
| 8 | changes the price · 0% reverse charge | Chromium | 3.1 s | – | Pass |
| 9 | archives a product | Chromium | 6.8 s | – | Pass |
| 10 | SKU must be unique | Chromium | 3.5 s | – | Pass |
| 11 | price history visible | Chromium | 7.2 s | – | Pass |
| 12 | search by SKU | Chromium | 3.9 s | – | Pass |
| 13 | imports products from CSV | Chromium | 14.1 s | – | Pass |
| 14 | rejects CSV with missing columns | Chromium | 10.8 s | – | Pass |
| 15 | creates a product · 23% | WebKit | 8.6 s | – | Pass |
| 16 | creates a product · 8% | WebKit | 5.3 s | – | Pass |
| 17 | creates a product · 5% | WebKit | 9.0 s | – | Pass |
| 18 | creates a product · 0% reverse charge | WebKit | 5.7 s | – | Pass |
| 19 | changes the price · 23% | WebKit | 2.4 s | – | Pass |
| 20 | changes the price · 8% | WebKit | 6.1 s | – | Pass |
| 21 | changes the price · 5% | WebKit | 2.8 s | – | Pass |
| 22 | changes the price · 0% reverse charge | WebKit | 6.5 s | – | Pass |
| 23 | archives a product | WebKit | 3.2 s | – | Pass |
| 24 | SKU must be unique | WebKit | 6.9 s | – | Pass |
| 25 | price history visible | WebKit | 3.6 s | – | Pass |
| 26 | search by SKU | WebKit | 7.3 s | – | Pass |
| 27 | imports products from CSV | WebKit | 10.5 s | – | Pass |
| 28 | rejects CSV with missing columns | WebKit | 14.2 s | – | Pass |
invoices/create.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | creates an invoice · EUR | Chromium | 4.9 s | – | Pass |
| 2 | creates an invoice · USD | Chromium | 1.6 s | – | Pass |
| 3 | creates an invoice · GBP | Chromium | 5.3 s | – | Pass |
| 4 | creates an invoice · PLN | Chromium | 2.0 s | – | Pass |
| 5 | creates an invoice · CHF | Chromium | 5.7 s | – | Pass |
| 6 | applies VAT · 23% | Chromium | 2.4 s | – | Pass |
| 7 | applies VAT · 8% | Chromium | 6.1 s | – | Pass |
| 8 | applies VAT · 5% | Chromium | 2.8 s | – | Pass |
| 9 | applies VAT · 0% reverse charge | Chromium | 6.5 s | – | Pass |
| 10 | adds 50 lines | Chromium | 9.7 s | – | Pass |
| 11 | line discount | Chromium | 6.9 s | – | Pass |
| 12 | invoice discount | Chromium | 3.6 s | – | Pass |
| 13 | rounding on 3 × €0.333 | Chromium | 7.3 s | – | Pass |
| 14 | due date from payment terms | Chromium | 4.0 s | – | Pass |
| 15 | custom invoice number series | Chromium | 7.7 s | – | Pass |
| 16 | draft autosave | Chromium | 4.4 s | – | Pass |
| 17 | sends invoice email | Chromium | 8.1 s | 1 | Flaky |
| 18 | attaches extra PDF | Chromium | 11.3 s | – | Pass |
| 19 | notes appear on PDF | Chromium | 15.0 s | – | Pass |
| 20 | duplicate invoice | Chromium | 5.2 s | – | Pass |
| 21 | cannot edit a sent invoice | Chromium | 1.9 s | – | Pass |
| 22 | cancel a sent invoice | Chromium | 5.6 s | – | Pass |
| 23 | creates an invoice · EUR | WebKit | 2.9 s | – | Pass |
| 24 | creates an invoice · USD | WebKit | 6.6 s | – | Pass |
| 25 | creates an invoice · GBP | WebKit | 3.3 s | – | Pass |
| 26 | creates an invoice · PLN | WebKit | 7.0 s | – | Pass |
| 27 | creates an invoice · CHF | WebKit | 3.7 s | – | Pass |
| 28 | applies VAT · 23% | WebKit | 7.4 s | – | Pass |
| 29 | applies VAT · 8% | WebKit | 4.1 s | – | Pass |
| 30 | applies VAT · 5% | WebKit | 7.8 s | – | Pass |
| 31 | applies VAT · 0% reverse charge | WebKit | 4.5 s | – | Pass |
| 32 | adds 50 lines | WebKit | 14.7 s | – | Pass |
| 33 | line discount | WebKit | 4.9 s | – | Pass |
| 34 | invoice discount | WebKit | 8.6 s | – | Pass |
| 35 | rounding on 3 × €0.333 | WebKit | 5.3 s | – | Pass |
| 36 | due date from payment terms | WebKit | 9.0 s | – | Pass |
| 37 | custom invoice number series | WebKit | 5.7 s | – | Pass |
| 38 | draft autosave | WebKit | 2.4 s | – | Pass |
| 39 | sends invoice email | WebKit | 6.1 s | – | Pass |
| 40 | attaches extra PDF | WebKit | 9.3 s | – | Pass |
| 41 | notes appear on PDF | WebKit | 13.0 s | – | Pass |
| 42 | duplicate invoice | WebKit | 3.2 s | – | Pass |
| 43 | cannot edit a sent invoice | WebKit | 6.9 s | – | Pass |
| 44 | cancel a sent invoice | WebKit | 3.6 s | – | Pass |
invoices/list-filter.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | filters by status · draft | Chromium | 7.8 s | – | Pass |
| 2 | filters by status · sent | Chromium | 4.5 s | – | Pass |
| 3 | filters by status · paid | Chromium | 8.2 s | – | Pass |
| 4 | filters by status · overdue | Chromium | 4.9 s | – | Pass |
| 5 | filters by status · cancelled | Chromium | 1.6 s | – | Pass |
| 6 | filters by customer | Chromium | 5.3 s | – | Pass |
| 7 | filters by issue date | Chromium | 2.0 s | – | Pass |
| 8 | filters by due date | Chromium | 5.7 s | – | Pass |
| 9 | filters by currency | Chromium | 2.4 s | – | Pass |
| 10 | combines filters | Chromium | 6.1 s | – | Pass |
| 11 | sorts by amount | Chromium | 2.8 s | – | Pass |
| 12 | sorts by due date | Chromium | 6.5 s | – | Pass |
| 13 | pagination keeps filters | Chromium | 3.2 s | – | Pass |
| 14 | empty state message | Chromium | 6.9 s | – | Pass |
| 15 | bulk send 10 invoices | Chromium | 10.1 s | – | Pass |
| 16 | bulk download PDFs | Chromium | 13.8 s | – | Pass |
| 17 | saved view persists | Chromium | 4.0 s | – | Pass |
| 18 | filters by status · draft | WebKit | 8.3 s | – | Pass |
| 19 | filters by status · sent | WebKit | 5.0 s | – | Pass |
| 20 | filters by status · paid | WebKit | 8.7 s | – | Pass |
| 21 | filters by status · overdue | WebKit | 5.4 s | – | Pass |
| 22 | filters by status · cancelled | WebKit | 9.1 s | – | Pass |
| 23 | filters by customer | WebKit | 5.8 s | – | Pass |
| 24 | filters by issue date | WebKit | 2.5 s | – | Pass |
| 25 | filters by due date | WebKit | 6.2 s | – | Pass |
| 26 | filters by currency | WebKit | 2.9 s | – | Pass |
| 27 | combines filters | WebKit | 6.6 s | – | Pass |
| 28 | sorts by amount | WebKit | 3.3 s | – | Pass |
| 29 | sorts by due date | WebKit | 7.0 s | – | Pass |
| 30 | pagination keeps filters | WebKit | 3.7 s | – | Pass |
| 31 | empty state message | WebKit | 7.4 s | – | Pass |
| 32 | bulk send 10 invoices | WebKit | 10.6 s | – | Pass |
| 33 | bulk download PDFs | WebKit | 14.3 s | – | Pass |
| 34 | saved view persists | WebKit | 4.5 s | – | Pass |
invoices/pdf.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | PDF layout · 1 line | Chromium | 8.2 s | – | Pass |
| 2 | PDF layout · 20 lines | Chromium | 11.9 s | – | Pass |
| 3 | PDF layout · 50 lines (3 pages) | Chromium | 8.6 s | – | Pass |
| 4 | PDF layout · with logo | Chromium | 12.3 s | – | Pass |
| 5 | PDF layout · with notes | Chromium | 9.0 s | – | Pass |
| 6 | PDF layout · reverse charge note | Chromium | 12.7 s | – | Pass |
| 7 | PDF layout · foreign currency | Chromium | 9.4 s | – | Pass |
| 8 | PDF totals match screen | Chromium | 13.1 s | – | Pass |
| 9 | PDF language follows customer | Chromium | 9.8 s | – | Pass |
| 10 | PDF file name uses invoice number | Chromium | 13.5 s | – | Pass |
| 11 | PDF layout · 1 line | WebKit | 10.8 s | – | Pass |
| 12 | PDF layout · 20 lines | WebKit | 14.5 s | – | Pass |
| 13 | PDF layout · 50 lines (3 pages) | WebKit | 11.2 s | – | Pass |
| 14 | PDF layout · with logo | WebKit | 14.9 s | – | Pass |
| 15 | PDF layout · with notes | WebKit | 11.6 s | – | Pass |
| 16 | PDF layout · reverse charge note | WebKit | 15.3 s | – | Pass |
| 17 | PDF layout · foreign currency | WebKit | 12.0 s | – | Pass |
| 18 | PDF totals match screen | WebKit | 8.7 s | – | Pass |
| 19 | PDF language follows customer | WebKit | 12.4 s | – | Pass |
| 20 | PDF file name uses invoice number | WebKit | 9.1 s | – | Pass |
invoices/retention.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | expired invoices hidden from list | Chromium | 6.8 s | – | Pass |
| 2 | expired invoices excluded from totals | Chromium | 3.5 s | – | Pass |
| 3 | dashboard count excludes expired | Chromium | 7.2 s | – | Pass |
| 4 | retention setting per tenant | Chromium | 3.9 s | – | Pass |
| 5 | retention change applies next night | Chromium | 7.6 s | – | Pass |
| 6 | expired invoices hidden from list | WebKit | 4.9 s | – | Pass |
| 7 | expired invoices excluded from totals | WebKit | 8.6 s | – | Pass |
| 8 | dashboard count excludes expired | WebKit | 5.3 s | – | Pass |
| 9 | retention setting per tenant | WebKit | 9.0 s | – | Pass |
| 10 | retention change applies next night | WebKit | 5.7 s | – | Pass |
payments/record.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | records a payment · bank transfer | Chromium | 2.9 s | – | Pass |
| 2 | records a payment · card | Chromium | 6.6 s | – | Pass |
| 3 | records a payment · cash | Chromium | 3.3 s | – | Pass |
| 4 | records a payment · PayPal | Chromium | 7.0 s | – | Pass |
| 5 | partial payment | Chromium | 3.7 s | – | Pass |
| 6 | two partial payments close the invoice | Chromium | 7.4 s | – | Pass |
| 7 | overpayment warning | Chromium | 4.1 s | – | Pass |
| 8 | payment on cancelled invoice blocked | Chromium | 7.8 s | – | Pass |
| 9 | payment date in the past | Chromium | 4.5 s | – | Pass |
| 10 | removes a payment | Chromium | 8.2 s | – | Pass |
| 11 | payment appears in customer balance | Chromium | 4.9 s | – | Pass |
| 12 | reconcile from bank CSV | Chromium | 8.1 s | – | Pass |
| 13 | CSV with unknown reference goes to review | Chromium | 11.8 s | – | Pass |
| 14 | records a payment · bank transfer | WebKit | 2.6 s | – | Pass |
| 15 | records a payment · card | WebKit | 6.3 s | – | Pass |
| 16 | records a payment · cash | WebKit | 3.0 s | – | Pass |
| 17 | records a payment · PayPal | WebKit | 6.7 s | – | Pass |
| 18 | partial payment | WebKit | 3.4 s | – | Pass |
| 19 | two partial payments close the invoice | WebKit | 7.1 s | – | Pass |
| 20 | overpayment warning | WebKit | 3.8 s | – | Pass |
| 21 | payment on cancelled invoice blocked | WebKit | 7.5 s | – | Pass |
| 22 | payment date in the past | WebKit | 4.2 s | – | Pass |
| 23 | removes a payment | WebKit | 7.9 s | – | Pass |
| 24 | payment appears in customer balance | WebKit | 4.6 s | – | Pass |
| 25 | reconcile from bank CSV | WebKit | 14.8 s | – | Pass |
| 26 | CSV with unknown reference goes to review | WebKit | 11.5 s | – | Pass |
payments/refund.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | full refund | Chromium | 2.2 s | – | Pass |
| 2 | partial refund | Chromium | 5.9 s | – | Pass |
| 3 | refund above paid blocked | Chromium | 2.6 s | – | Pass |
| 4 | refund creates credit note | Chromium | 6.3 s | – | Pass |
| 5 | refund email to customer | Chromium | 3.0 s | – | Pass |
| 6 | refund visible in report | Chromium | 6.7 s | – | Pass |
| 7 | full refund | WebKit | 4.0 s | – | Pass |
| 8 | partial refund | WebKit | 7.7 s | – | Pass |
| 9 | refund above paid blocked | WebKit | 4.4 s | – | Pass |
| 10 | refund creates credit note | WebKit | 8.1 s | – | Pass |
| 11 | refund email to customer | WebKit | 4.8 s | – | Pass |
| 12 | refund visible in report | WebKit | 8.5 s | – | Pass |
credit-notes.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | credit one line | Chromium | 5.7 s | – | Pass |
| 2 | credit full invoice | Chromium | 2.4 s | – | Pass |
| 3 | credit above total blocked | Chromium | 6.1 s | – | Pass |
| 4 | credit note PDF | Chromium | 9.3 s | – | Pass |
| 5 | credit note email | Chromium | 6.5 s | – | Pass |
| 6 | credit note reduces balance | Chromium | 3.2 s | – | Pass |
| 7 | credit note in VAT report | Chromium | 6.9 s | – | Pass |
| 8 | credit note number series | Chromium | 3.6 s | – | Pass |
| 9 | credit one line | WebKit | 7.9 s | – | Pass |
| 10 | credit full invoice | WebKit | 4.6 s | – | Pass |
| 11 | credit above total blocked | WebKit | 8.3 s | – | Pass |
| 12 | credit note PDF | WebKit | 11.5 s | – | Pass |
| 13 | credit note email | WebKit | 8.7 s | – | Pass |
| 14 | credit note reduces balance | WebKit | 5.4 s | – | Pass |
| 15 | credit note in VAT report | WebKit | 9.1 s | – | Pass |
| 16 | credit note number series | WebKit | 5.8 s | – | Pass |
recurring.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | schedules · weekly | Chromium | 3.0 s | – | Pass |
| 2 | schedules · monthly | Chromium | 6.7 s | – | Pass |
| 3 | schedules · quarterly | Chromium | 3.4 s | – | Pass |
| 4 | schedules · yearly | Chromium | 13.6 s | – | Pass |
| 5 | day 31 falls back to last day | Chromium | 3.8 s | – | Pass |
| 6 | end date stops schedule | Chromium | 7.5 s | – | Pass |
| 7 | pause and resume | Chromium | 4.2 s | – | Pass |
| 8 | creates next invoice at midnight | Chromium | 7.9 s | 1 | Flaky |
| 9 | sends automatically when enabled | Chromium | 4.6 s | – | Pass |
| 10 | preview of next 3 dates | Chromium | 8.3 s | – | Pass |
| 11 | edit applies to future invoices only | Chromium | 5.0 s | – | Pass |
| 12 | schedules · weekly | WebKit | 2.3 s | – | Pass |
| 13 | schedules · monthly | WebKit | 6.0 s | – | Pass |
| 14 | schedules · quarterly | WebKit | 2.7 s | – | Pass |
| 15 | schedules · yearly | WebKit | 12.9 s | – | Pass |
| 16 | day 31 falls back to last day | WebKit | 3.1 s | – | Pass |
| 17 | end date stops schedule | WebKit | 6.8 s | – | Pass |
| 18 | pause and resume | WebKit | 3.5 s | – | Pass |
| 19 | creates next invoice at midnight | WebKit | 7.2 s | – | Pass |
| 20 | sends automatically when enabled | WebKit | 3.9 s | – | Pass |
| 21 | preview of next 3 dates | WebKit | 7.6 s | – | Pass |
| 22 | edit applies to future invoices only | WebKit | 4.3 s | – | Pass |
reminders.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | sends reminder · 3 days before due | Chromium | 8.5 s | – | Pass |
| 2 | sends reminder · on due date | Chromium | 5.2 s | – | Pass |
| 3 | sends reminder · 7 days overdue | Chromium | 1.9 s | – | Pass |
| 4 | sends reminder · 30 days overdue | Chromium | 5.6 s | – | Pass |
| 5 | reminder uses trading name | Chromium | 2.3 s | – | Pass |
| 6 | stops after payment | Chromium | 6.0 s | – | Pass |
| 7 | customer opt-out respected | Chromium | 2.7 s | – | Pass |
| 8 | reminder template preview | Chromium | 6.4 s | – | Pass |
| 9 | sends reminder · 3 days before due | WebKit | 3.7 s | – | Pass |
| 10 | sends reminder · on due date | WebKit | 7.4 s | – | Pass |
| 11 | sends reminder · 7 days overdue | WebKit | 4.1 s | – | Pass |
| 12 | sends reminder · 30 days overdue | WebKit | 7.8 s | – | Pass |
| 13 | reminder uses trading name | WebKit | 4.5 s | – | Pass |
| 14 | stops after payment | WebKit | 8.2 s | – | Pass |
| 15 | customer opt-out respected | WebKit | 4.9 s | – | Pass |
| 16 | reminder template preview | WebKit | 8.6 s | – | Pass |
reports/month-end.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | revenue report · month | Chromium | 5.8 s | – | Pass |
| 2 | revenue report · quarter | Chromium | 2.5 s | – | Pass |
| 3 | revenue report · year | Chromium | 12.7 s | – | Pass |
| 4 | aged receivables buckets | Chromium | 2.9 s | – | Pass |
| 5 | VAT summary per rate | Chromium | 6.6 s | – | Pass |
| 6 | export to CSV | Chromium | 9.8 s | – | Pass |
| 7 | export to XLSX | Chromium | 7.0 s | – | Pass |
| 8 | report totals equal invoice totals | Chromium | 3.7 s | – | Pass |
| 9 | report respects currency filter | Chromium | 7.4 s | – | Pass |
| 10 | year view totals | Chromium | 10.6 s | – | Pass |
| 11 | revenue report · month | WebKit | 8.4 s | – | Pass |
| 12 | revenue report · quarter | WebKit | 5.1 s | – | Pass |
| 13 | revenue report · year | WebKit | 15.3 s | – | Pass |
| 14 | aged receivables buckets | WebKit | 5.5 s | – | Pass |
| 15 | VAT summary per rate | WebKit | 2.2 s | – | Pass |
| 16 | export to CSV | WebKit | 12.4 s | – | Pass |
| 17 | export to XLSX | WebKit | 2.6 s | – | Pass |
| 18 | report totals equal invoice totals | WebKit | 6.3 s | – | Pass |
| 19 | report respects currency filter | WebKit | 3.0 s | – | Pass |
| 20 | year view totals | WebKit | 13.2 s | – | Pass |
portal/customer-portal.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | customer opens invoice · desktop | Chromium | 3.9 s | – | Pass |
| 2 | customer opens invoice · mobile Safari | Chromium | 7.6 s | – | Pass |
| 3 | customer pays · card | Chromium | 4.3 s | – | Pass |
| 4 | customer pays · PayPal | Chromium | 8.0 s | – | Pass |
| 5 | customer pays 3 invoices at once | Chromium | 11.2 s | – | Pass |
| 6 | customer downloads PDF | Chromium | 14.9 s | – | Pass |
| 7 | customer sees payment history | Chromium | 5.1 s | – | Pass |
| 8 | portal link expires after 90 days | Chromium | 1.8 s | – | Pass |
| 9 | portal in German | Chromium | 5.5 s | – | Pass |
| 10 | portal in French | Chromium | 2.2 s | – | Pass |
| 11 | portal notes rendered as text | Chromium | 5.9 s | – | Pass |
| 12 | portal without login via magic link | Chromium | 2.6 s | – | Pass |
| 13 | customer opens invoice · desktop | WebKit | 6.9 s | – | Pass |
| 14 | customer opens invoice · mobile Safari | WebKit | 3.6 s | – | Pass |
| 15 | customer pays · card | WebKit | 7.3 s | – | Pass |
| 16 | customer pays · PayPal | WebKit | 4.0 s | – | Pass |
| 17 | customer pays 3 invoices at once | WebKit | 14.2 s | – | Pass |
| 18 | customer downloads PDF | WebKit | 10.9 s | – | Pass |
| 19 | customer sees payment history | WebKit | 8.1 s | – | Pass |
| 20 | portal link expires after 90 days | WebKit | 4.8 s | – | Pass |
| 21 | portal in German | WebKit | 8.5 s | – | Pass |
| 22 | portal in French | WebKit | 5.2 s | – | Pass |
| 23 | portal notes rendered as text | WebKit | 8.9 s | – | Pass |
| 24 | portal without login via magic link | WebKit | 5.6 s | – | Pass |
settings/company.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | edit company details | Chromium | 2.8 s | – | Pass |
| 2 | upload logo | Chromium | 6.5 s | – | Pass |
| 3 | logo shown on PDF | Chromium | 9.7 s | – | Pass |
| 4 | default payment terms | Chromium | 6.9 s | – | Pass |
| 5 | default currency | Chromium | 3.6 s | – | Pass |
| 6 | invoice number format | Chromium | 7.3 s | – | Pass |
| 7 | bank account on PDF | Chromium | 10.5 s | – | Pass |
| 8 | VAT number validation | Chromium | 7.7 s | – | Pass |
| 9 | edit company details | WebKit | 5.0 s | – | Pass |
| 10 | upload logo | WebKit | 8.7 s | – | Pass |
| 11 | logo shown on PDF | WebKit | 11.9 s | – | Pass |
| 12 | default payment terms | WebKit | 9.1 s | – | Pass |
| 13 | default currency | WebKit | 5.8 s | – | Pass |
| 14 | invoice number format | WebKit | 2.5 s | – | Pass |
| 15 | bank account on PDF | WebKit | 12.7 s | – | Pass |
| 16 | VAT number validation | WebKit | 2.9 s | – | Pass |
settings/integrations.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | connect accounting export | Chromium | 7.1 s | – | Pass |
| 2 | disconnect integration | Chromium | 3.8 s | – | Pass |
| 3 | API client created | Chromium | 7.5 s | – | Pass |
| 4 | API client secret shown once | Chromium | 4.2 s | – | Pass |
| 5 | connect accounting export | WebKit | 8.5 s | – | Pass |
| 6 | disconnect integration | WebKit | 5.2 s | – | Pass |
| 7 | API client created | WebKit | 8.9 s | – | Pass |
| 8 | API client secret shown once | WebKit | 5.6 s | – | Pass |
webhooks-ui.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | create subscription | Chromium | 2.8 s | – | Pass |
| 2 | send test event | Chromium | 6.5 s | – | Pass |
| 3 | delivery log visible | Chromium | 3.2 s | – | Pass |
| 4 | disable subscription | Chromium | 6.9 s | – | Pass |
| 5 | rotate secret | Chromium | 3.6 s | – | Pass |
| 6 | rejects http URL | Chromium | 7.3 s | – | Pass |
| 7 | retry failed delivery manually | Chromium | 4.0 s | – | Pass |
| 8 | create subscription | WebKit | 8.3 s | – | Pass |
| 9 | send test event | WebKit | 5.0 s | – | Pass |
| 10 | delivery log visible | WebKit | 8.7 s | – | Pass |
| 11 | disable subscription | WebKit | 5.4 s | – | Pass |
| 12 | rotate secret | WebKit | 9.1 s | – | Pass |
| 13 | rejects http URL | WebKit | 5.8 s | – | Pass |
| 14 | retry failed delivery manually | WebKit | 2.5 s | – | Pass |
users/invite.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | invites a user as · Admin | Chromium | 6.7 s | – | Pass |
| 2 | invites a user as · Finance | Chromium | 3.4 s | – | Pass |
| 3 | invites a user as · Accountant | Chromium | 7.1 s | – | Pass |
| 4 | invites a user as · Sales | Chromium | 3.8 s | – | Pass |
| 5 | invites a user as · Viewer | Chromium | 7.5 s | – | Pass |
| 6 | invite email arrives | Chromium | 4.2 s | – | Pass |
| 7 | invite link expires | Chromium | 7.9 s | – | Pass |
| 8 | resend invite | Chromium | 4.6 s | – | Pass |
| 9 | deactivate user | Chromium | 8.3 s | – | Pass |
| 10 | last admin cannot be removed | Chromium | 5.0 s | – | Pass |
| 11 | invites a user as · Admin | WebKit | 2.3 s | – | Pass |
| 12 | invites a user as · Finance | WebKit | 6.0 s | – | Pass |
| 13 | invites a user as · Accountant | WebKit | 2.7 s | – | Pass |
| 14 | invites a user as · Sales | WebKit | 6.4 s | – | Pass |
| 15 | invites a user as · Viewer | WebKit | 3.1 s | – | Pass |
| 16 | invite email arrives | WebKit | 6.8 s | – | Pass |
| 17 | invite link expires | WebKit | 3.5 s | – | Pass |
| 18 | resend invite | WebKit | 7.2 s | – | Pass |
| 19 | deactivate user | WebKit | 3.9 s | – | Pass |
| 20 | last admin cannot be removed | WebKit | 7.6 s | – | Pass |
audit-log.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | invoice edit logged | Chromium | 4.8 s | – | Pass |
| 2 | payment logged | Chromium | 8.5 s | – | Pass |
| 3 | user invite logged | Chromium | 5.2 s | – | Pass |
| 4 | filter by user | Chromium | 1.9 s | – | Pass |
| 5 | export audit log | Chromium | 5.6 s | – | Pass |
| 6 | invoice edit logged | WebKit | 2.9 s | – | Pass |
| 7 | payment logged | WebKit | 6.6 s | – | Pass |
| 8 | user invite logged | WebKit | 3.3 s | – | Pass |
| 9 | filter by user | WebKit | 7.0 s | – | Pass |
| 10 | export audit log | WebKit | 3.7 s | – | Pass |
dashboard.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | shows open balance | Chromium | 7.9 s | – | Pass |
| 2 | shows overdue count | Chromium | 4.6 s | – | Pass |
| 3 | shows revenue chart | Chromium | 8.3 s | – | Pass |
| 4 | chart matches report | Chromium | 5.0 s | – | Pass |
| 5 | quick actions work | Chromium | 1.7 s | – | Pass |
| 6 | empty tenant onboarding | Chromium | 5.4 s | – | Pass |
| 7 | shows open balance | WebKit | 2.7 s | – | Pass |
| 8 | shows overdue count | WebKit | 6.4 s | – | Pass |
| 9 | shows revenue chart | WebKit | 3.1 s | – | Pass |
| 10 | chart matches report | WebKit | 6.8 s | – | Pass |
| 11 | quick actions work | WebKit | 3.5 s | – | Pass |
| 12 | empty tenant onboarding | WebKit | 7.2 s | – | Pass |
search.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | finds invoice by number | Chromium | 4.4 s | – | Pass |
| 2 | finds customer by name | Chromium | 8.1 s | – | Pass |
| 3 | finds by amount | Chromium | 4.8 s | – | Pass |
| 4 | keyboard shortcut opens search | Chromium | 8.5 s | – | Pass |
| 5 | no results message | Chromium | 5.2 s | – | Pass |
| 6 | finds invoice by number | WebKit | 2.5 s | – | Pass |
| 7 | finds customer by name | WebKit | 6.2 s | – | Pass |
| 8 | finds by amount | WebKit | 2.9 s | – | Pass |
| 9 | keyboard shortcut opens search | WebKit | 6.6 s | – | Pass |
| 10 | no results message | WebKit | 3.3 s | – | Pass |
i18n.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | UI language · English | Chromium | 7.5 s | – | Pass |
| 2 | UI language · German | Chromium | 4.2 s | – | Pass |
| 3 | UI language · French | Chromium | 7.9 s | – | Pass |
| 4 | UI language · Dutch | Chromium | 4.6 s | – | Pass |
| 5 | UI language · Polish | Chromium | 8.3 s | – | Pass |
| 6 | dates follow locale | Chromium | 5.0 s | – | Pass |
| 7 | numbers follow locale | Chromium | 1.7 s | – | Pass |
| 8 | currency symbol position | Chromium | 5.4 s | – | Pass |
| 9 | UI language · English | WebKit | 2.7 s | – | Pass |
| 10 | UI language · German | WebKit | 6.4 s | – | Pass |
| 11 | UI language · French | WebKit | 3.1 s | – | Pass |
| 12 | UI language · Dutch | WebKit | 6.8 s | – | Pass |
| 13 | UI language · Polish | WebKit | 3.5 s | – | Pass |
| 14 | dates follow locale | WebKit | 7.2 s | – | Pass |
| 15 | numbers follow locale | WebKit | 3.9 s | – | Pass |
| 16 | currency symbol position | WebKit | 7.6 s | – | Pass |
accessibility.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | no new axe violations vs baseline · login | Chromium | 4.8 s | – | Pass |
| 2 | no new axe violations vs baseline · dashboard | Chromium | 8.5 s | – | Pass |
| 3 | no new axe violations vs baseline · invoice list | Chromium | 5.2 s | – | Pass |
| 4 | no new axe violations vs baseline · invoice editor | Chromium | 1.9 s | – | Pass |
| 5 | no new axe violations vs baseline · customer page | Chromium | 5.6 s | – | Pass |
| 6 | no new axe violations vs baseline · reports | Chromium | 2.3 s | – | Pass |
| 7 | no new axe violations vs baseline · portal invoice | Chromium | 6.0 s | – | Pass |
| 8 | no new axe violations vs baseline · portal payment | Chromium | 2.7 s | – | Pass |
visual.spec.ts| # | Test | Project | Duration | Retries | Result |
|---|---|---|---|---|---|
| 1 | screenshot matches · dashboard | Chromium | 7.5 s | – | Pass |
| 2 | screenshot matches · invoice editor | Chromium | 4.2 s | – | Pass |
| 3 | screenshot matches · invoice PDF | Chromium | 14.4 s | – | Pass |
| 4 | screenshot matches · portal invoice | Chromium | 4.6 s | – | Pass |
| 5 | screenshot matches · settings | Chromium | 8.3 s | – | Pass |
| 6 | screenshot matches · login | Chromium | 5.0 s | – | Pass |
Sample report. Acme Ledger, its data, people and defects are fictional. Your report shows your product, your tickets and your tools.
More sample reports · Book a 15-minute call