This is a test checklist.
* A battery of tests will be redone with the newer SIMP\-6.2.0 RC1 ISO.
* More tests may be added
* Link to ISOs: https://download.simp-project.com/simp/ISO/pre-release/
The table below lists the proposed set of ISO pre-release tests to be executed and whether they will be done for Beta2. This work will be split into multiple tickets.
...
OS | Test Title | Test? | JIRA | Status |
---|---|---|---|---|
N/A | Verify Puppetfile and dependencies.yaml |
...
...
N/A |
...
Verify Changelog.rst |
...
...
N/A |
...
Component interoperability - pupmod-simp-simp acceptance tests using Beta2 Puppetfile |
...
...
N/A |
...
Component interoperability + R10k install - simp-core default suite using Beta2 Puppetfile |
...
...
CentOS 7 |
...
SIMP ISO UEFI boot, SIMP, FIPS enabled, STIG partitioning |
...
...
CentOS 7 |
...
SIMP ISO UEFI boot, SIMP, FIPS enabled, STIG partitioning, disk encrypted |
...
...
CentOS 7 |
...
SIMP ISO UEFI boot, SIMP, FIPS enabled, user-specified disk partitioning |
...
CentOS 7 | SIMP ISO UEFI boot, SIMP, FIPS disabled, STIG partitioning | |||
CentOS 7 | SIMP ISO UEFI boot, SIMP, FIPS disabled, STIG partitioning, disk encrypted | |||
CentOS 7 | SIMP ISO UEFI boot, SIMP, FIPS disabled, user-specified disk partitioning | |||
CentOS 7 | SIMP ISO UEFI boot, SIMP, FIPS disabled, STIG partitioning |
...
...
CentOS 7 |
...
SIMP ISO UEFI boot, SIMP, FIPS disabled, STIG partitioning, disk encrypted |
...
...
CentOS 7 |
...
SIMP ISO UEFI boot, SIMP, FIPS disabled, user-specified disk partitioning |
...
...
CentOS 7 |
...
SIMP ISO UEFI boot, Minimal Linux image, FIPS enabled, STIG partitioning |
...
...
CentOS 7 |
...
SIMP ISO UEFI boot, Minimal Linux image, FIPS enabled, STIG partitioning, disk encryption |
...
...
CentOS 7 |
...
SIMP ISO UEFI boot, Minimal Linux image, FIPS disabled, STIG partitioning |
...
...
CentOS 7 |
...
SIMP ISO UEFI boot, Minimal Linux image, FIPS disabled, STIG partitioning, disk encryption |
...
...
CentOS 7 |
...
SIMP ISO BIOS boot using default boot option |
...
...
CentOS 7 |
...
SIMP ISO BIOS boot using default + disk encryption boot option |
...
...
CentOS 7 |
...
SIMP ISO BIOS boot using FIPS disabled boot option |
...
...
CentOS 7 |
...
SIMP ISO BIOS boot using disk encryption and FIPS disabled boot options |
...
...
CentOS 7 |
...
SIMP ISO BIOS boot using simp-prompt option |
...
...
CentOS 7 |
...
SIMP ISO BIOS boot using simp-prompt and disk encryption boot options |
...
...
CentOS 7 |
...
SIMP ISO boot using simp-prompt and FIPS disabled boot options |
...
...
CentOS 7 |
...
SIMP ISO boot using simp-prompt, disk encryption, and FIPS disabled boot options |
...
...
CentOS 7 |
...
SIMP ISO boot using linux-min and disk encryption boot options |
...
...
CentOS 7 |
...
SIMP ISO boot using linux-min and FIPS disabled boot options |
...
...
CentOS 7 |
...
SIMP ISO boot using linux-min, disk encryption, and FIPS disabled boot options |
...
...
CentOS 7 |
...
SIMP server install from RPM |
...
...
CentOS 7 |
...
SIMP |
...
-6.1.0 server RPM upgrade |
...
...
CentOS 7 |
...
Eat your own dogfood (deploy to a dev environment) |
...
...
CentOS 7 |
...
A SIMP client can be PXE booted using the new ks files from the SIMP ISO and BIOS boot |
...
...
CentOS 7 |
...
A SIMP client can be PXE booted using the new ks files from the SIMP ISO and UEFI boot |
...
...
CentOS 7 |
...
A SIMP client can use the SIMP server for DNS |
...
...
CentOS 7 |
...
A SIMP server can be bootstrapped for the 'simp-lite' scenario, FIPS, STIG partitioning |
...
...
CentOS 7 |
...
A 'simp-lite' client operates with a SIMP server |
...
...
CentOS 7 |
...
A SIMP server can be bootstrapped for the 'poss' scenario, FIPS, STIG partitioning |
...
...
CentOS 7 |
...
A 'simp-poss' client operates with a SIMP server |
...
...
CentOS 7 |
...
The SIMP server can be converted from FIPS enabled to FIPS disabled mode |
...
...
CentOS 7 |
...
The SIMP server can be converted from Selinux enforcing to Selinux permissive mode |
...
...
CentOS 7 |
...
The SIMP server can be converted from Selinux permissive to Selinux enforcing mode |
...
...
CentOS 7 |
...
A local user with sudo privileges can be created and login to the SIMP server & client |
...
...
CentOS 7 |
...
A LDAP user in administrators group can be created and login to the SIMP server & client |
...
...
CentOS 7 |
...
Local and LDAP users can change their passwords on both the SIMP server and client |
...
...
CentOS 7 |
...
Rsyslog messages are written to the correct local and remote log files |
...
...
CentOS 7 |
...
Otherwise untested simp-utils work (gen-ldap-update and updaterepos) |
...
...
CentOS 7 |
...
The compliance map reports for both SIMP server and client are accurate |
...
...
CentOS 7 |
...
Generate a policy evaluation report |
...
...
CentOS 7 |
...
'Upgrading SIMP' has an entry for the latest version and is correct |
...
...
CentOS 7 |
...
SIMP Getting Started docs are still correct |
...
...
CentOS 7 |
...
SIMP User Guide docs are still correct |
...
...
CentOS 7 |
...
SIMP HOWTO Guides are still correct |
...
...
CentOS 7 |
...
SIMP FAQs are still correct |
...
...
CentOS 6 |
...
SIMP ISO UEFI boot, SIMP, FIPS enabled, STIG partitioning |
...
...
CentOS 6 |
...
SIMP ISO UEFI boot, SIMP, FIPS enabled, STIG partitioning, disk encrypted |
...
...
CentOS 6 |
...
SIMP ISO UEFI boot, SIMP, FIPS enabled, user-specified disk partitioning |
...
...
CentOS 6 |
...
SIMP ISO UEFI boot, SIMP, FIPS disabled, STIG partitioning |
...
...
CentOS 6 |
...
SIMP ISO UEFI boot, SIMP, FIPS disabled, STIG partitioning, disk encrypted |
...
...
CentOS 6 |
...
SIMP ISO UEFI boot, SIMP, FIPS disabled, user-specified disk partitioning |
...
...
CentOS 6 |
...
SIMP ISO UEFI boot, Minimal Linux image, FIPS enabled, STIG partitioning |
...
...
CentOS 6 |
...
SIMP ISO UEFI boot, Minimal Linux image, FIPS enabled, STIG partitioning, disk encryption |
...
...
CentOS 6 |
...
SIMP ISO UEFI boot, Minimal Linux image, FIPS disabled, STIG partitioning |
...
...
CentOS 6 |
...
SIMP ISO UEFI boot, Minimal Linux image, FIPS disabled, STIG partitioning, disk encryption |
...
...
CentOS 6 |
...
SIMP ISO BIOS boot using default boot option |
...
...
CentOS 6 |
...
SIMP ISO BIOS boot using default + disk encryption boot option |
...
...
CentOS 6 |
...
SIMP ISO BIOS boot using FIPS disabled boot option |
...
...
CentOS 6 |
...
SIMP ISO BIOS boot using disk encryption and FIPS disabled boot options |
...
...
CentOS 6 |
...
SIMP ISO BIOS boot using simp-prompt option |
...
...
CentOS 6 |
...
SIMP ISO BIOS boot using simp-prompt and disk encryption boot options |
...
...
CentOS 6 |
...
SIMP ISO boot using simp-prompt and FIPS disabled boot options |
...
...
CentOS 6 |
...
SIMP ISO boot using simp-prompt, disk encryption, and FIPS disabled boot options |
...
...
CentOS 6 |
...
SIMP ISO boot using linux-min and disk encryption boot options |
...
...
CentOS 6 |
...
SIMP ISO boot using linux-min and FIPS disabled boot options |
...
...
CentOS 6 |
...
SIMP ISO boot using linux-min, disk encryption, and FIPS disabled boot options |
...
...
CentOS 6 |
...
SIMP server install from RPM |
...
...
CentOS 6 |
...
SIMP |
...
-6.1.0 server RPM upgrade |
...
...
CentOS 6 |
...
Eat your own dogfood (deploy to a dev environment) |
...
...
CentOS 6 |
...
A SIMP client can be PXE booted using the new ksfiles from the SIMP ISO and BIOS boot |
...
...
CentOS 6 |
...
A SIMP client can use the SIMP server for DNS |
...
...
CentOS 6 |
...
A SIMP server can be bootstrapped for the 'simp-lite' scenario, FIPS, STIG partitioning |
...
...
CentOS 6 |
...
A' simp-lite' client operates with a SIMP server |
...
...
CentOS 6 |
...
A SIMP server can be bootstrapped for the 'poss' scenario, FIPS, STIG partitioning |
...
...
CentOS 6 |
...
A 'simp-poss' client operates with a SIMP server |
...
...
CentOS 6 |
...
The SIMP server can be converted from FIPS enabled to FIPS disabled mode |
...
...
CentOS 6 |
...
The SIMP server can be converted from Selinux enforcing to Selinux permissive mode |
...
...
CentOS 6 |
...
The SIMP server can be converted from Selinux permissive to Selinux enforcing mode |
...
...
CentOS 6 |
...
A local user with sudo privileges can be created and login to the SIMP server & client |
...
...
CentOS 6 |
...
A LDAP user in administrators group can be created and login to the SIMP server & client |
...
...
CentOS 6 |
...
Local and LDAP users can change their passwords on both the SIMP server and client |
...
...
CentOS 6 |
...
Rsyslog messages are written to the correct local and remote log files |
...
...
CentOS 6 |
...
The compliance map reports for both SIMP server and client are accurate |
...
...
CentOS 6 |
...
Generate a policy evaluation report |
...
...
CentOS 6 |
...
Otherwise untested simp-utils work (gen-ldap-update and updaterepos) |
...
...
CentOS 7 |
...
'Upgrading SIMP' has an entry for the latest version and is correct |
...
...
CentOS 7 |
...
SIMP Getting Started docs are still correct |
...
...
CentOS 7 |
...
SIMP User Guide docs are still correct |
...
...
CentOS 7 |
...
SIMP HOWTO Guides are still correct |
...
...
CentOS 7 |
...
SIMP FAQs are still correct |
...