Update ATVM automation blacklist and status formatting guidance
Add atvm144-suse15.0 to the ATVM automation blacklist because it crashes when creating a migration session. Update maintained exclude examples to include the new blacklist entry. Tighten status reporting guidance to require one machine per line. Add a Notes section for failure reasons and operator-facing context. Record the new run learnings in atvm-automation-runs.md.
This commit is contained in:
@@ -97,27 +97,30 @@ Use `atvm-automation-examples.md` as the common options/command reference.
|
||||
When the operator asks for run status, report in this order:
|
||||
1. Heading/title using the run `build_name`.
|
||||
2. Completed machines with machine name first and status second for each machine.
|
||||
3. Skipped machines with reason.
|
||||
4. Remaining machines still to run.
|
||||
5. Summary counts for finished, passed, failed, and skipped machines.
|
||||
6. Timing details:
|
||||
3. Notes.
|
||||
4. Skipped machines with reason.
|
||||
5. Remaining machines still to run.
|
||||
6. Summary counts for finished, passed, failed, and skipped machines.
|
||||
7. Timing details:
|
||||
- start time
|
||||
- end time if complete
|
||||
- total run time if complete, or elapsed run time if still running
|
||||
- quickest completed test runtime
|
||||
- longest completed test runtime
|
||||
- average completed test runtime
|
||||
7. Estimated completion time.
|
||||
8. Estimated completion time.
|
||||
|
||||
Status details:
|
||||
- Use the live run log on the automation VM when available.
|
||||
- Use the run `build_name` as the heading/title when available.
|
||||
- Format every machine entry as `machine-name - STATUS`.
|
||||
- Put each machine on its own line; do not combine multiple machine statuses on one line.
|
||||
- Put failure reasons, oddities, and operator-facing context in a dedicated `Notes` section.
|
||||
- Show blacklisted machines under skipped machines when they are part of the requested scope.
|
||||
- Show in-progress machines under remaining machines as `RUNNING`.
|
||||
- Show not-yet-started machines as `NOT STARTED`.
|
||||
- Use completed spec results already recorded in the log to determine machine pass/fail state.
|
||||
- For failed machines, include the failure reason from the run log in the status output.
|
||||
- For failed machines, mark the machine `FAIL` in the completed list and include the failure reason in `Notes`.
|
||||
- Include start time in status output when it can be derived from the log.
|
||||
- Include end time and total runtime for completed runs, or elapsed runtime for active runs.
|
||||
- Include quickest completed test runtime, longest completed test runtime, and average completed test runtime under timing details when they can be derived from the log.
|
||||
@@ -131,6 +134,9 @@ CMC install blacklist (`BLACKLISTED: CMC INSTALL - CAN'T COMPILE`):
|
||||
- `atvm41-redhat6.0`
|
||||
- `atvm73-oracle6.0`
|
||||
|
||||
Crash blacklist (`BLACKLISTED: CRASHES WHEN CREATING MIGRATION SESSION - BUG`):
|
||||
- `atvm144-suse15.0`
|
||||
|
||||
Support-request blacklist (`BLACKLISTED: SUPPORT REQUEST - WAITING`):
|
||||
- `atvm113-debian9.0.0`
|
||||
- `atvm115-debian9.1.0`
|
||||
|
||||
Reference in New Issue
Block a user