canonical-certification-server lacks the ability to de-select tests in a suite
Bug #1260523 reported by
Jeff Lane
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Checkbox |
Fix Released
|
High
|
Sylvain Pineau |
Bug Description
the console UI seems to have only one mode: run everything selected.
We need an easy way for testers (read non-developers) to be able to run arbitrary subsets of tests from the whitelists.
Use Case:
Test Engineer at Cisco runs the Server-Self-test suite.
It's determined that Cisco needs to rerun memory/check, virtualization/
I can't tell them "go to such and such directory and edit this file and delete the following 100 lines"
I'd rather not have customer engineers create files at all, but would rather simply say "Re-run and at the menu, deselect everything but the following tests"
Related branches
lp://staging/~sylvain-pineau/checkbox/fixes
- Sylvain Pineau (community): Approve
- Zygmunt Krynicki (community): Approve
-
Diff: 802 lines (+425/-231)1 file modifiedcheckbox-ng/checkbox_ng/commands/cli.py (+425/-231)
tags: | added: checkbox-ng |
Changed in checkbox: | |
assignee: | nobody → Sylvain Pineau (sylvain-pineau) |
status: | New → In Progress |
Changed in checkbox: | |
status: | In Progress → Fix Committed |
milestone: | none → plainbox-0.5 |
Changed in checkbox: | |
status: | Fix Committed → Fix Released |
To post a comment you must log in.
I'm open to suggestions to handle test selection, checkbox-cli used a very old-fashion selection mode based on letters and (+- to expand/collapse IIRC). The urwid interface had a nice widget to select tests but we dropped it as it's an external dependency.
To select the suites I only used python curses bindings. But making a tree of tests in curses is a bit challenging but not impossible though).