tests: pre-release checklist + RFC test matrices - #41
Merged
Merged
Conversation
- tests/checklist.md: plain-language manual QA scenarios organised by feature area (not RFC number), seeded from this session's bug reports and the implemented RFCs. Designed as the pre-tag walk-through; checkboxes reset per release. - ## Test matrix section added to 8 implemented RFCs (0015, 0019, 0005, 0007, 0009, 0010, 0012, 0018): clause → platform → automated test file:line → manual scenario (linking to the checklist). - Known-gaps section in the checklist: eye-gaze calibration, switch access profiles, onboarding, v5 migration (GTK), voice output, game mode, multi-alphabet workflows, and 10 areas with NO RFC at all. Signed-off-by: will wade <willwade@gmail.com>
…sed gaps Critical (fabricated test references): - Windows editor-contract test doesn't exist → manual only (0019) - Windows V5MigrationService tests don't exist → manual only (0005) - Windows TargetContextReader tests don't exist → manual only (0015) Important: - Test counts corrected (26 not 55; 12 not 7) - Joystick split into GTK/Android rows (0010) - Core items marked ⭐ (~25 regression-prone items for quick releases) - Platform attributions converted from HTML comments to visible text (rendered on GitHub) Minor: - Typing-rate scenarios added (RFC 0012 was missing entirely) - Control nodes beyond Copy added (speak, pause) - Sentence-window manual scenario added (field-switch test) - Vague items tightened (startup time bound, settings specificity) Gap list revised per priorities: - Elevated: eye-gaze (Windows primary), switch access, voice output - Coverage gaps named: Windows editor automation, Android IME crash guard - Deprioritised: screen reader, data portability, undo/redo Signed-off-by: will wade <willwade@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
tests/checklist.md(the growing manual QA scenarios document) and## Test matrixsections to 8 implemented RFCs. The checklist is organised by feature area, not RFC number, and links back to the governing RFCs. Includes a known-gaps section identifying areas with no coverage. DCO signed.