Simplify stress tests and make them run
The current stress tests are too complicated and are not being used. The complexity is from having its own threading model and state management. Most of the benefits could be attained by running scenarios in as many threads as desired. The current tests should be replaced and put in a periodic run. More scenarios should be added.
Blueprint information
- Status:
- Complete
- Approver:
- David Kranz
- Priority:
- High
- Drafter:
- David Kranz
- Direction:
- Approved
- Assignee:
- Marc Koderer
- Definition:
- Approved
- Series goal:
- Accepted for havana
- Implementation:
-
Implemented
- Milestone target:
-
havana-2
- Started by
- David Kranz
- Completed by
- David Kranz
Related branches
Related bugs
Sprints
Whiteboard
Gerrit topic: https:/
Addressed by: https:/
Rework stress to be more UnitTest like
Gerrit topic: https:/
Addressed by: https:/
Add global statistic for stress tests
Gerrit topic: https:/
Addressed by: https:/
Fix tox job for stress tests.
Addressed by: https:/
Add an option to run_stress.py to run tests serially.
Gerrit topic: https:/
Addressed by: https:/
Add stress test to attach volumes to vm's
Addressed by: https:/
run_stress.py -h doesn't work without a connection
Addressed by: https:/
Add option to execute stress test in random order
Addressed by: https:/
Fix stress-tox-job.json action file.
Addressed by: https:/
Add exit codes if run_stress.py detects an error
Addressed by: https:/
Add argument to stop stress test on first error
Addressed by: https:/
Change logging in stress test
Gerrit topic: https:/
Addressed by: https:/
Create discovery option for stress test
Work Items
Work items:
Create sanity check for tempest/stress (dkranz): POSTPONED
Add more actions: POSTPONED
Adapt framework to allow all existing tempest test: DONE
Use oslo logger: DONE
Add parameter to stop on first error (mkoderer): DONE
Commit simple stress test: DONE
Add an entry in tox.ini to run run_stress.py: DONE
Make test action more look like a unit test: DONE
Showing the usage (-h) should not require a connection to OpenStack: DONE
Add statistics at the end of a run: DONE
Driver needs to check for failures in the actions and return process nonzero code on failure: DONE
Create a json test description for a standard test to be run in a periodic jenkins job: DONE
Create a periodic jenkins job to use this tox entry: DONE
