Update ATVM blacklist and enforce sequential runner launch
Adjust the maintained ATVM blacklist so atvm156-debian9.3.0 uses the reason RE-CREATE MIGHT BE NEEDED and remove atvm157-debian13.0.0 from blacklist entries and reusable exclude examples. Also clarify the ATVM automation workflow so cmc-templates.py must finish successfully before run-sorry-cypress.py is started.
This commit is contained in:
@@ -150,10 +150,9 @@ Support-request blacklist (`BLACKLISTED: SUPPORT REQUEST - WAITING`):
|
|||||||
- `atvm113-debian9.0.0`
|
- `atvm113-debian9.0.0`
|
||||||
- `atvm115-debian9.1.0`
|
- `atvm115-debian9.1.0`
|
||||||
- `atvm116-debian9.2.0`
|
- `atvm116-debian9.2.0`
|
||||||
- `atvm156-debian9.3.0`
|
|
||||||
|
|
||||||
Re-create blacklist:
|
Re-create-might-be-needed blacklist (`BLACKLISTED: RE-CREATE MIGHT BE NEEDED`):
|
||||||
- `atvm157-debian13.0.0`
|
- `atvm156-debian9.3.0`
|
||||||
|
|
||||||
### Operator Preferences
|
### Operator Preferences
|
||||||
- Do not include Gold Disk IDs in `--build_name`.
|
- Do not include Gold Disk IDs in `--build_name`.
|
||||||
|
|||||||
@@ -68,18 +68,18 @@ python3 ./run-sorry-cypress.py --config_file cypress.atvm-config-gold.ts --build
|
|||||||
|
|
||||||
### Randomized reboot sanity
|
### Randomized reboot sanity
|
||||||
```bash
|
```bash
|
||||||
python3 cmc-templates.py --template cmc-reboot --ignore_force_shutdown --config_file_path ./cypress.atvm-config-gold.ts --test_partition --integration_type pure --use_specified_plugin fc --randomize 1 --exclude_partial_match suse15.0 atvm6-centos6.0 atvm41-redhat6.0 atvm73-oracle6.0 atvm144-suse15.0 atvm113-debian9.0.0 atvm115-debian9.1.0 atvm116-debian9.2.0 atvm156-debian9.3.0 atvm157-debian13.0.0 --wait_for_power_on 120; \
|
python3 cmc-templates.py --template cmc-reboot --ignore_force_shutdown --config_file_path ./cypress.atvm-config-gold.ts --test_partition --integration_type pure --use_specified_plugin fc --randomize 1 --exclude_partial_match suse15.0 atvm6-centos6.0 atvm41-redhat6.0 atvm73-oracle6.0 atvm144-suse15.0 atvm113-debian9.0.0 atvm115-debian9.1.0 atvm116-debian9.2.0 atvm156-debian9.3.0 --wait_for_power_on 120; \
|
||||||
python3 ./run-sorry-cypress.py --config_file cypress.atvm-config-gold.ts --build_name sanity-reboot-iscsi
|
python3 ./run-sorry-cypress.py --config_file cypress.atvm-config-gold.ts --build_name sanity-reboot-iscsi
|
||||||
```
|
```
|
||||||
|
|
||||||
### Randomized e2e sanity
|
### Randomized e2e sanity
|
||||||
```bash
|
```bash
|
||||||
python3 cmc-templates.py --template cmc-e2e --ignore_force_shutdown --config_file_path ./cypress.atvm-config-gold.ts --test_partition --integration_type pure --use_specified_plugin both --randomize 1 --exclude_partial_match suse15.0 atvm6-centos6.0 atvm41-redhat6.0 atvm73-oracle6.0 atvm144-suse15.0 atvm113-debian9.0.0 atvm115-debian9.1.0 atvm116-debian9.2.0 atvm156-debian9.3.0 atvm157-debian13.0.0; \
|
python3 cmc-templates.py --template cmc-e2e --ignore_force_shutdown --config_file_path ./cypress.atvm-config-gold.ts --test_partition --integration_type pure --use_specified_plugin both --randomize 1 --exclude_partial_match suse15.0 atvm6-centos6.0 atvm41-redhat6.0 atvm73-oracle6.0 atvm144-suse15.0 atvm113-debian9.0.0 atvm115-debian9.1.0 atvm116-debian9.2.0 atvm156-debian9.3.0; \
|
||||||
python3 ./run-sorry-cypress.py --config_file cypress.atvm-config-gold.ts --build_name sanity-e2e
|
python3 ./run-sorry-cypress.py --config_file cypress.atvm-config-gold.ts --build_name sanity-e2e
|
||||||
```
|
```
|
||||||
|
|
||||||
### Randomized systemOS sanity
|
### Randomized systemOS sanity
|
||||||
```bash
|
```bash
|
||||||
python3 cmc-templates.py --template cmc-systemOS --ignore_force_shutdown --config_file_path ./cypress.atvm-config-gold.ts --randomize 1 --exclude_partial_match suse15.0 fedora34 atvm6-centos6.0 atvm41-redhat6.0 atvm73-oracle6.0 atvm144-suse15.0 atvm113-debian9.0.0 atvm115-debian9.1.0 atvm116-debian9.2.0 atvm156-debian9.3.0 atvm157-debian13.0.0; \
|
python3 cmc-templates.py --template cmc-systemOS --ignore_force_shutdown --config_file_path ./cypress.atvm-config-gold.ts --randomize 1 --exclude_partial_match suse15.0 fedora34 atvm6-centos6.0 atvm41-redhat6.0 atvm73-oracle6.0 atvm144-suse15.0 atvm113-debian9.0.0 atvm115-debian9.1.0 atvm116-debian9.2.0 atvm156-debian9.3.0; \
|
||||||
python3 ./run-sorry-cypress.py --config_file cypress.atvm-config-gold.ts --build_name sanity-systemOS
|
python3 ./run-sorry-cypress.py --config_file cypress.atvm-config-gold.ts --build_name sanity-systemOS
|
||||||
```
|
```
|
||||||
|
|||||||
@@ -43,7 +43,8 @@ Run ATVM CMC automation tests on the designated automation VM without unintended
|
|||||||
|
|
||||||
Typical sequence:
|
Typical sequence:
|
||||||
1. Run `cmc-templates.py` with requested template/options.
|
1. Run `cmc-templates.py` with requested template/options.
|
||||||
2. Run `run-sorry-cypress.py` with matching config and build name.
|
2. Wait for `cmc-templates.py` to fully finish and confirm success.
|
||||||
|
3. Run `run-sorry-cypress.py` with matching config and build name.
|
||||||
|
|
||||||
## Config File / Gold Disk Mapping
|
## Config File / Gold Disk Mapping
|
||||||
- `cypress.atvm-config-gold.ts` -> Gold Disk 1
|
- `cypress.atvm-config-gold.ts` -> Gold Disk 1
|
||||||
@@ -100,13 +101,12 @@ Temporarily blacklisted while support requests are waiting:
|
|||||||
- `atvm113-debian9.0.0`
|
- `atvm113-debian9.0.0`
|
||||||
- `atvm115-debian9.1.0`
|
- `atvm115-debian9.1.0`
|
||||||
- `atvm116-debian9.2.0`
|
- `atvm116-debian9.2.0`
|
||||||
|
|
||||||
|
Temporarily blacklisted because re-creation might be needed:
|
||||||
- `atvm156-debian9.3.0`
|
- `atvm156-debian9.3.0`
|
||||||
|
|
||||||
Temporarily blacklisted until re-created:
|
|
||||||
- `atvm157-debian13.0.0`
|
|
||||||
|
|
||||||
Preferred exclude list:
|
Preferred exclude list:
|
||||||
- `--exclude_partial_match atvm6-centos6.0 atvm41-redhat6.0 atvm73-oracle6.0 atvm144-suse15.0 atvm113-debian9.0.0 atvm115-debian9.1.0 atvm116-debian9.2.0 atvm156-debian9.3.0 atvm157-debian13.0.0`
|
- `--exclude_partial_match atvm6-centos6.0 atvm41-redhat6.0 atvm73-oracle6.0 atvm144-suse15.0 atvm113-debian9.0.0 atvm115-debian9.1.0 atvm116-debian9.2.0 atvm156-debian9.3.0`
|
||||||
|
|
||||||
## Running-Automation Check (Mandatory)
|
## Running-Automation Check (Mandatory)
|
||||||
Before any new automation request:
|
Before any new automation request:
|
||||||
@@ -124,8 +124,10 @@ Before any new automation request:
|
|||||||
2. Present them verbatim as planned commands.
|
2. Present them verbatim as planned commands.
|
||||||
3. Wait for explicit approval.
|
3. Wait for explicit approval.
|
||||||
4. Run only approved command(s), no extra options.
|
4. Run only approved command(s), no extra options.
|
||||||
5. If monitoring was not requested, report immediate success/failure for each command.
|
5. When both template generation and the Cypress runner are requested, run them sequentially, not in parallel.
|
||||||
6. If monitoring was requested, keep monitoring until completion and report final outcome.
|
6. Do not launch `run-sorry-cypress.py` until `cmc-templates.py` has exited successfully and finished updating the intended config/spec files.
|
||||||
|
7. If monitoring was not requested, report immediate success/failure for each command.
|
||||||
|
8. If monitoring was requested, keep monitoring until completion and report final outcome.
|
||||||
|
|
||||||
## Requested Test Style
|
## Requested Test Style
|
||||||
When asked for one VM or a VM set:
|
When asked for one VM or a VM set:
|
||||||
@@ -190,6 +192,7 @@ Status-report expectations:
|
|||||||
- For skipped machines, include the reason category:
|
- For skipped machines, include the reason category:
|
||||||
- `BLACKLISTED: CMC INSTALL - CAN'T COMPILE`
|
- `BLACKLISTED: CMC INSTALL - CAN'T COMPILE`
|
||||||
- `BLACKLISTED: SUPPORT REQUEST - WAITING`
|
- `BLACKLISTED: SUPPORT REQUEST - WAITING`
|
||||||
|
- `BLACKLISTED: RE-CREATE MIGHT BE NEEDED`
|
||||||
- `BLACKLISTED: RE-CREATE NEEDED`
|
- `BLACKLISTED: RE-CREATE NEEDED`
|
||||||
- If a machine is currently in progress, show it under remaining machines as `RUNNING`.
|
- If a machine is currently in progress, show it under remaining machines as `RUNNING`.
|
||||||
- If a machine has not started yet, show it under remaining machines as `NOT STARTED`.
|
- If a machine has not started yet, show it under remaining machines as `NOT STARTED`.
|
||||||
|
|||||||
@@ -35,9 +35,8 @@ This file stores run-specific examples only when a run produced a new learning r
|
|||||||
- `atvm113-debian9.0.0`
|
- `atvm113-debian9.0.0`
|
||||||
- `atvm115-debian9.1.0`
|
- `atvm115-debian9.1.0`
|
||||||
- `atvm116-debian9.2.0`
|
- `atvm116-debian9.2.0`
|
||||||
|
- `BLACKLISTED: RE-CREATE MIGHT BE NEEDED`:
|
||||||
- `atvm156-debian9.3.0`
|
- `atvm156-debian9.3.0`
|
||||||
- Needs re-creation:
|
|
||||||
- `atvm157-debian13.0.0`
|
|
||||||
- Action for future runs:
|
- Action for future runs:
|
||||||
- Add these machine names to `--exclude_partial_match` when building broad-scope automation commands.
|
- Add these machine names to `--exclude_partial_match` when building broad-scope automation commands.
|
||||||
- When reporting run status, include skipped blacklisted machines separately with their reason, in addition to completed and remaining machines.
|
- When reporting run status, include skipped blacklisted machines separately with their reason, in addition to completed and remaining machines.
|
||||||
|
|||||||
Reference in New Issue
Block a user