[HEALTH] 4.23/main Health Check, please don't merge this!

[sureshanaparti]

Description

This is a dummy PR to kick smoketests on 4.23/main branch.

Types of changes

• Breaking change (fix or feature that would cause existing functionality to change)
• New feature (non-breaking change which adds functionality)
• Bug fix (non-breaking change which fixes an issue)
• Enhancement (improves an existing feature and functionality)
• Cleanup (Code refactoring and cleanup, that may add test cases)
• Build/CI
• Test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

• Major
• Minor

Bug Severity

• BLOCKER
• Critical
• Major
• Minor
• Trivial

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

[sureshanaparti]

@blueorangutan package

[blueorangutan]

@sureshanaparti a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 17.90%. Comparing base (408e8c0) to head (5eafe8d).

Additional details and impacted files

@@            Coverage Diff            @@
##               main   #12198   +/-   ##
=========================================
  Coverage     17.90%   17.90%           
- Complexity    16093    16094    +1     
=========================================
  Files          5937     5937           
  Lines        532841   532841           
  Branches      65190    65190           
=========================================
+ Hits          95397    95398    +1     
+ Misses       426766   426765    -1     
  Partials      10678    10678           

Flag	Coverage Δ
uitests	3.67% <ø> (ø)
unittests	19.00% <ø> (+<0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15929

[DaanHoogland]

@blueorangutan test matrix

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian test result (tid-14947)
Environment: kvm-ubuntu22 (x2), zone: Advanced Networking with Mgmt server u22
Total time taken: 59536 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14947-kvm-ubuntu22.zip
Smoke tests completed. 147 look OK, 3 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_deployVMInSharedNetwork	Error	280.43	test_network.py
test_01_primary_storage_nfs	Error	0.17	test_primary_storage.py
ContextSuite context=TestStorageTags>:setup	Error	0.28	test_primary_storage.py
test_01_primary_storage_scope_change	Error	0.13	test_primary_storage_scope.py

[blueorangutan]

[SF] Trillian test result (tid-14942)
Environment: kvm-ol9 (x2), zone: Advanced Networking with Mgmt server ol9
Total time taken: 72211 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14942-kvm-ol9.zip
Smoke tests completed. 146 look OK, 4 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_uservm_host_control_state	Failure	18.27	test_host_control_state.py
ContextSuite context=TestHostControlState>:teardown	Error	31.83	test_host_control_state.py
test_01_vpn_usage	Error	1.09	test_usage.py
test_01_secure_vm_migration	Error	369.21	test_vm_life_cycle.py
test_02_unsecure_vm_migration	Error	0.02	test_vm_life_cycle.py
test_03_secured_to_nonsecured_vm_migration	Error	0.01	test_vm_life_cycle.py
test_04_nonsecured_to_secured_vm_migration	Error	0.01	test_vm_life_cycle.py
test_hostha_enable_ha_when_host_disabled	Error	1.84	test_hostha_kvm.py
test_hostha_enable_ha_when_host_in_maintenance	Error	304.11	test_hostha_kvm.py

[blueorangutan]

[SF] Trillian test result (tid-14939)
Environment: xcpng82 (x2), zone: Advanced Networking with Mgmt server ol9
Total time taken: 73773 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14939-xcpng82.zip
Smoke tests completed. 137 look OK, 13 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_events_resource	Error	141.31	test_events_resource.py
ContextSuite context=TestIpv4Routing>:setup	Error	0.00	test_ipv4_routing.py
test_03_deploy_and_scale_kubernetes_cluster	Failure	71.73	test_kubernetes_clusters.py
test_08_upgrade_kubernetes_ha_cluster	Failure	205.72	test_kubernetes_clusters.py
test_12_test_deploy_cluster_different_offerings_per_node_type	Failure	144.27	test_kubernetes_clusters.py
test_04_list_domains_level_filter	Failure	0.06	test_list_domains.py
test_05_list_domains_no_filter	Failure	0.03	test_list_domains.py
test_01_non_strict_host_anti_affinity	Failure	262.56	test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity	Error	56.14	test_nonstrict_affinity_group.py
test_01_add_primary_storage_disabled_host	Error	15.56	test_primary_storage.py
test_01_primary_storage_iscsi	Error	3.98	test_primary_storage.py
test_01_primary_storage_nfs	Error	0.19	test_primary_storage.py
ContextSuite context=TestStorageTags>:setup	Error	0.36	test_primary_storage.py
test_01_scale_vm	Error	383.26	test_scale_vm.py
test_04_scale_vm_with_user_account	Error	385.21	test_scale_vm.py
test_05_scale_vm_dont_allow_disk_offering_change	Error	393.10	test_scale_vm.py
test_01_sys_vm_start	Failure	0.07	test_secondary_storage.py
test_02_list_snapshots_with_removed_data_store	Error	11.58	test_snapshots.py
test_02_list_snapshots_with_removed_data_store	Error	11.58	test_snapshots.py
test_01_ssl_offloading_isolated_network	Failure	821.77	test_ssl_offloading.py
test_01_deploy_vm_on_specific_host	Error	0.10	test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster	Error	0.11	test_vm_deployment_planner.py
test_08_migrate_vm	Error	0.06	test_vm_life_cycle.py
test_11_destroy_vm_and_volumes	Error	17.70	test_vm_life_cycle.py
test_01_migrate_vm_strict_tags_success	Error	0.19	test_vm_strict_host_tags.py
test_02_migrate_vm_strict_tags_failure	Error	0.41	test_vm_strict_host_tags.py
test_01_restore_vm_strict_tags_success	Error	0.22	test_vm_strict_host_tags.py
test_02_restore_vm_strict_tags_failure	Error	0.20	test_vm_strict_host_tags.py
test_01_scale_vm_strict_tags_success	Error	0.24	test_vm_strict_host_tags.py
test_02_scale_vm_strict_tags_failure	Error	0.27	test_vm_strict_host_tags.py
test_01_deploy_vm_on_specific_host_without_strict_tags	Error	0.20	test_vm_strict_host_tags.py
test_02_deploy_vm_on_any_host_without_strict_tags	Error	2.46	test_vm_strict_host_tags.py
test_03_deploy_vm_on_specific_host_with_strict_tags_success	Error	0.22	test_vm_strict_host_tags.py
test_04_deploy_vm_on_any_host_with_strict_tags_success	Error	2.54	test_vm_strict_host_tags.py
test_05_deploy_vm_on_specific_host_with_strict_tags_failure	Failure	0.20	test_vm_strict_host_tags.py

[blueorangutan]

[SF] Trillian test result (tid-14940)
Environment: vmware-80u3 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 84128 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14940-vmware-80u3.zip
Smoke tests completed. 146 look OK, 4 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_08_arping_in_ssvm	Failure	5.20	test_diagnostics.py
ContextSuite context=TestClusterDRS>:setup	Error	0.00	test_cluster_drs.py
test_08_upgrade_kubernetes_ha_cluster	Failure	3693.65	test_kubernetes_clusters.py
test_13_test_add_external_nodes_to_cluster	Error	1799.98	test_kubernetes_clusters.py
ContextSuite context=TestKubernetesCluster>:teardown	Error	1935.64	test_kubernetes_clusters.py
ContextSuite context=TestISOUsage>:setup	Error	0.00	test_usage.py
test_01_snapshot_usage	Error	19.56	test_usage.py
test_01_vpn_usage	Error	1.12	test_usage.py

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15977

[DaanHoogland]

@blueorangutan test matrix

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian Build Failed (tid-14961)

[blueorangutan]

[SF] Trillian test result (tid-14959)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 56036 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14959-kvm-ol8.zip
Smoke tests completed. 149 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_02_unsecure_vm_migration	Error	408.90	test_vm_life_cycle.py
test_02_unsecure_vm_migration	Error	408.91	test_vm_life_cycle.py
test_03_secured_to_nonsecured_vm_migration	Error	0.01	test_vm_life_cycle.py
test_04_nonsecured_to_secured_vm_migration	Error	0.01	test_vm_life_cycle.py

[blueorangutan]

[SF] Trillian test result (tid-14960)
Environment: kvm-ubuntu22 (x2), zone: Advanced Networking with Mgmt server u22
Total time taken: 60242 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14960-kvm-ubuntu22.zip
Smoke tests completed. 149 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_hostha_enable_ha_when_host_disabled	Error	0.88	test_hostha_kvm.py
test_hostha_enable_ha_when_host_in_maintenance	Error	305.28	test_hostha_kvm.py

[blueorangutan]

[SF] Trillian test result (tid-14962)
Environment: xcpng82 (x2), zone: Advanced Networking with Mgmt server ol9
Total time taken: 68110 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14962-xcpng82.zip
Smoke tests completed. 144 look OK, 6 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_events_resource	Error	200.41	test_events_resource.py
test_01_non_strict_host_anti_affinity	Error	141.37	test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity	Error	45.55	test_nonstrict_affinity_group.py
test_02_list_snapshots_with_removed_data_store	Error	37.98	test_snapshots.py
test_02_list_snapshots_with_removed_data_store	Error	37.98	test_snapshots.py
test_01_vpn_usage	Error	1.08	test_usage.py
test_11_destroy_vm_and_volumes	Error	19.70	test_vm_life_cycle.py
test_01_migrate_vm_strict_tags_success	Error	47.44	test_vm_strict_host_tags.py

[blueorangutan]

[SF] Trillian test result (tid-14964)
Environment: vmware-70u3 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 53575 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14964-vmware-70u3.zip
Smoke tests completed. 149 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_vpn_usage	Error	1.09	test_usage.py

[blueorangutan]

[SF] Trillian test result (tid-14938)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 340546 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14938-kvm-ol8.zip
Component tests completed. 87 look OK, 87 have errors
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_verify_ipv6_network	Failure	296.59	test_network_ipv6.py
test_02_verify_ipv6_network_redundant	Failure	163.12	test_network_ipv6.py
test_03_verify_upgraded_ipv6_network	Failure	320.47	test_network_ipv6.py
test_04_verify_upgraded_ipv6_network_redundant	Failure	335.88	test_network_ipv6.py
ContextSuite context=TestDeployVMs>:setup	Error	0.00	test_dhcp_dns_offload.py
test_01_acquire_public_ip_in_isolated_network	Failure	60.07	test_acquire_specified_public_ip.py
test_02_acquire_public_ip_in_vpc	Failure	41.91	test_acquire_specified_public_ip.py
test_17_add_nic_different_zone	Error	115.32	test_add_remove_network.py
ContextSuite context=TestFailureScenariosAddNetworkToVM>:teardown	Error	10.61	test_add_remove_network.py
ContextSuite context=TestFailureScenariosUpdateVirtualMachineNIC>:teardown	Error	6.51	test_add_remove_network.py
ContextSuite context=TestUpdateVirtualMachineNIC>:teardown	Error	158.09	test_add_remove_network.py
test_03_1_egress_fr3	Failure	728.47	test_egress_fw_rules.py
test_07_1_egress_fr7	Failure	729.91	test_egress_fw_rules.py
test_07_egress_fr7	Failure	789.46	test_egress_fw_rules.py
test_04_reoccuring_snapshot_rules	Error	4329.76	test_base_image_updation.py
ContextSuite context=TestDataPersistency>:teardown	Error	368.36	test_blocker_bugs.py
test_01_create_template	Error	283.13	test_blocker_bugs.py
test_10_create_policy_enable_disable_vpn	Failure	154.51	test_haproxy.py
test_01_Browser_volume_Life_cycle_tpath	Failure	7961.78	test_browse_volumes.py
test_04_Browser_Upload_Volume_Negative_Scenarios_TPath	Failure	11474.76	test_browse_volumes.py
test_05_Browser_Upload_Volume_MultiSSVM_Scenarios_TPath	Failure	0.02	test_browse_volumes.py
test_09_Browser_Upload_Volume_PostURL_with_Deleted_Uploadvolume_Details	Error	3660.14	test_browse_volumes.py
test_11_migrate_upload_volume	Failure	7451.73	test_browse_volumes.py
test_13_Browser_Upload_Volume_volume_resource_limits	Failure	3661.03	test_browse_volumes.py
test_14_Browser_Upload_Volume_secondary_storage_resource_limits	Failure	3725.18	test_browse_volumes.py
test_15_Browser_Upload_Volume_primary_storage_resource_limits	Failure	3660.96	test_browse_volumes.py
test_browser_upload_volume_incomplete	Failure	3753.44	test_browse_volumes.py
ContextSuite context=TestConfigDrive>:setup	Error	0.00	test_configdrive.py
runTest	Error	0.00	test_edgezone_supportedoperations.py
runTest	Error	0.00	test_edgezone_supportedoperations.py
test_05_create_delete_lbrule_forvpc	Error	55.99	test_escalations_ipaddresses.py
test_07_assign_remove_lbrule_toinstance	Failure	62.20	test_escalations_ipaddresses.py
test_07_assign_remove_lbrule_toinstance	Error	62.22	test_escalations_ipaddresses.py
test_10_create_delete_portforwarding_forvpc	Error	43.47	test_escalations_ipaddresses.py
test_15_enable_disable_staticnat_forvpc	Error	53.92	test_escalations_ipaddresses.py
ContextSuite context=TestIpAddresses>:teardown	Error	4.20	test_escalations_ipaddresses.py
test_04_create_vpc_with_networkdomain	Failure	0.03	test_escalations_networks.py
test_14_list_public_ipaddress_by_associated_networkid	Failure	0.02	test_escalations_networks.py
test_15_list_privategateway_byvpcid	Failure	44.08	test_escalations_networks.py
test_17_restart_vpc	Failure	0.02	test_escalations_networks.py
test_18_create_list_vpn_gateway	Failure	0.02	test_escalations_networks.py
test_21_listNetworkacls_by_privategateway_aclid	Error	40.90	test_escalations_networks.py
ContextSuite context=TestNetworks_2>:teardown	Error	41.97	test_escalations_networks.py
test_03_data_volume_resize	Error	88.53	test_escalations_volumes.py
test_04_custom_volume_resize	Error	89.31	test_escalations_volumes.py
test_06_volume_snapshot_policy_hourly	Error	82.26	test_escalations_volumes.py
test_07_volume_snapshot_policy_daily	Error	93.33	test_escalations_volumes.py
test_08_volume_snapshot_policy_weekly	Error	83.96	test_escalations_volumes.py
test_09_volume_snapshot_policy_monthly	Error	88.30	test_escalations_volumes.py
test_10_volume_snapshots_pagination	Error	92.72	test_escalations_volumes.py
test_11_volume_extract	Error	77.32	test_escalations_volumes.py
test_12_volume_upload	Error	60.02	test_escalations_volumes.py
test_13_volume_custom_disk_size	Failure	92.51	test_escalations_volumes.py
test_03_delete_vm	Failure	861.58	test_mm_domain_limits.py
test_add_PF_rule_2_SHARED	Failure	71.21	test_multiple_ips_per_nic.py
test_add_PF_rule_3_VPC	Error	669.63	test_multiple_ips_per_nic.py
test_add_PF_rule_3_VPC	Error	669.67	test_multiple_ips_per_nic.py
test_add_static_nat_rule_1_ISOLATED	Error	451.62	test_multiple_ips_per_nic.py
test_add_static_nat_rule_2_SHARED	Failure	360.15	test_multiple_ips_per_nic.py
test_add_static_nat_rule_2_SHARED	Error	360.17	test_multiple_ips_per_nic.py
test_add_static_nat_rule_3_VPC	Error	91.69	test_multiple_ips_per_nic.py
test_delete_PF_nat_rule_2_SHARED	Error	77.89	test_multiple_ips_per_nic.py
test_disable_static_nat_1_ISOLATED	Error	388.46	test_multiple_ips_per_nic.py
test_disable_static_nat_2_SHARED	Error	609.38	test_multiple_ips_per_nic.py
test_disable_static_nat_2_SHARED	Error	609.43	test_multiple_ips_per_nic.py
test_disable_static_nat_3_VPC	Error	74.00	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_1_ISOLATED	Error	62.62	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_2_SHARED	Error	360.57	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_2_SHARED	Error	360.60	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_3_VPC	Error	375.19	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_3_VPC	Error	375.21	test_multiple_ips_per_nic.py
ContextSuite context=TestNetworkRules>:teardown	Error	376.30	test_multiple_ips_per_nic.py
test_delete_vm_1_ISOLATED	Error	88.62	test_multiple_ips_per_nic.py
test_delete_vm_2_SHARED	Error	68.44	test_multiple_ips_per_nic.py
test_delete_vm_3_VPC	Error	308.96	test_multiple_ips_per_nic.py
test_network_restart_cleanup_false_1_ISOLATED	Error	87.03	test_multiple_ips_per_nic.py
test_network_restart_cleanup_false_2_SHARED	Error	82.10	test_multiple_ips_per_nic.py
test_network_restart_cleanup_false_3_VPC	Error	308.13	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_1_ISOLATED	Error	147.73	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_2_SHARED	Error	69.92	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_3_VPC	Error	91.44	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_3_VPC	Error	91.45	test_multiple_ips_per_nic.py
test_reboot_router_VM_1_ISOLATED	Error	666.47	test_multiple_ips_per_nic.py
test_reboot_router_VM_1_ISOLATED	Error	666.52	test_multiple_ips_per_nic.py
test_reboot_router_VM_2_SHARED	Error	667.63	test_multiple_ips_per_nic.py
test_reboot_router_VM_3_VPC	Error	129.54	test_multiple_ips_per_nic.py
test_recover_vm_1_ISOLATED	Error	119.28	test_multiple_ips_per_nic.py
test_recover_vm_2_SHARED	Error	69.40	test_multiple_ips_per_nic.py
test_recover_vm_3_VPC	Error	308.58	test_multiple_ips_per_nic.py
test_02_created_shared_guest_network	Error	4.76	test_multiple_physical_network_creation.py
test_02_created_shared_guest_network	Error	4.76	test_multiple_physical_network_creation.py
test_01_acquire_public_ips_in_isolated_network_with_single_vr	Error	5.77	test_multiple_subnets_in_isolated_network.py
test_03_acquire_public_ips_in_vpc_with_single_vr	Error	314.70	test_multiple_subnets_in_vpc.py
test_04_acquire_public_ips_in_vpc_with_redundant_vrs	Failure	596.70	test_multiple_subnets_in_vpc_rvr.py
test_01_create_isolated_network_with_mtu	Failure	437.38	test_network_mtu.py
test_02_update_isolated_network_with_mtu	Failure	375.90	test_network_mtu.py
test_01_verify_vpc_dns	Error	58.09	test_network_vpc_custom_dns.py
test_01_createVM_snapshotTemplate	Error	1.58	test_snapshots.py
ContextSuite context=TestSnapshotEvents>:setup	Error	13.01	test_snapshots.py
test_02_snapshot_data_disk	Error	5.08	test_snapshots.py
test_03_snapshot_detachedDisk	Error	4.78	test_snapshots.py
test_04_delete_snapshot	Error	5.17	test_snapshots.py
test_12_disableZone_admin_deployVM	Error	1.22	test_organization_states.py
test_13_disableZone_admin_stop_startVM	Error	32.71	test_organization_states.py
test_15_disableZone_user_stop_startVM	Error	125.52	test_organization_states.py
test_22_disablePod_admin_deployVM	Error	1.18	test_organization_states.py
test_23_disablePod_admin_stop_startVM	Error	3.18	test_organization_states.py
test_25_disablePod_user_stop_startVM	Error	7.32	test_organization_states.py
test_43_disableHost_admin_deployVM	Failure	1.16	test_organization_states.py
test_44_disableHost_admin_stop_startVM	Failure	128.41	test_organization_states.py
test_02_Overcommit_factor	Failure	459.78	test_overcommit.py
test_03_cluste_capacity_check	Failure	610.30	test_overcommit.py
test_04_zone_capacity_check	Failure	610.30	test_overcommit.py
test_assign_vm_different_account_VR_1_VR	Error	8.42	test_persistent_networks.py
test_change_persistent_network_to_non_persistent	Error	4.18	test_persistent_networks.py
test_network_state_after_destroying_vms	Error	0.02	test_persistent_networks.py
test_newly_added_host_for_persistent_network_resources	Error	1.12	test_persistent_networks.py
test_persistent_network_with_RVR	Error	4.25	test_persistent_networks.py
test_pf_nat_rule_persistent_network_1_LB_VR	Error	4.02	test_persistent_networks.py
test_upgrade_network_VR_to_PersistentRVR	Error	4.16	test_persistent_networks.py
test_upgrade_to_persistent_services_VR_1_LB_VR	Error	4.03	test_persistent_networks.py
test_vm_deployment_persistent_and_non_persistent_networks	Error	4.03	test_persistent_networks.py
test_vm_deployment_two_persistent_networks	Error	4.30	test_persistent_networks.py
test_volume_delete_event_errorState	Error	2.96	test_persistent_networks.py
test_account_operations_1_locked	Error	3.88	test_persistent_networks.py
test_account_operations_2_disabled	Error	4.21	test_persistent_networks.py
test_project_operations	Error	6.05	test_persistent_networks.py
test_cleanup_persistent_network_1_true	Error	4.11	test_persistent_networks.py
test_cleanup_persistent_network_2_false	Error	3.96	test_persistent_networks.py
test_vpc_force_delete_domain	Failure	11.11	test_persistent_networks.py
test_vpc_network_life_cycle_1_delete	Error	5.50	test_persistent_networks.py
test_vpc_network_life_cycle_2_restart	Error	6.12	test_persistent_networks.py
ContextSuite context=TestAssociatePublicIp>:setup	Error	0.00	test_portable_ip.py
test_create_portable_ip_range	Failure	0.01	test_portable_ip.py
test_delete_account_services_disabled	Failure	3.77	test_portable_ip.py
test_delete_account_services_enabled	Failure	3.33	test_portable_ip.py
test_delete_portable_ip_range	Error	0.01	test_portable_ip.py
test_delete_portable_ip_range_in_use	Error	0.01	test_portable_ip.py
test_delete_portable_ip_range_non_root_admin	Error	0.01	test_portable_ip.py
ContextSuite context=TestDisassociatePublicIp>:setup	Error	4.06	test_portable_ip.py
test_list_portable_ip_range	Error	0.01	test_portable_ip.py
test_list_portable_ip_range_non_root_admin	Error	0.01	test_portable_ip.py
ContextSuite context=TestPortableIpTransferAcrossNetworks>:setup	Error	4.00	test_portable_ip.py
test_03_vm_per_project	Error	1.29	test_project_limits.py
test_04_publicip_per_project	Error	1.25	test_project_limits.py
test_05_snapshots_per_project	Error	1.21	test_project_limits.py
test_06_volumes_per_project	Error	7.51	test_project_limits.py
test_07_templates_per_project	Error	62.47	test_project_limits.py
ContextSuite context=TestResourceLimitsProject>:teardown	Error	68.73	test_project_limits.py
test_03_network_create	Error	8.02	test_project_resources.py
test_01_service_offerings	Error	7.54	test_project_resources.py
ContextSuite context=TestPublicIpAddress>:setup	Error	10.87	test_project_resources.py
test_06_create_snapshots_in_project	Error	1.30	test_project_resources.py
test_04_public_private_template_use_in_project	Failure	1.30	test_project_resources.py
test_05_use_private_template_in_project	Failure	1.22	test_project_resources.py
ContextSuite context=TestISOUsage>:setup	Error	0.00	test_project_usage.py
ContextSuite context=TestLBRuleUsage>:setup	Error	0.00	test_project_usage.py
ContextSuite context=TestNatRuleUsage>:setup	Error	0.00	test_project_usage.py
ContextSuite context=TestPublicIPUsage>:setup	Error	0.00	test_project_usage.py
ContextSuite context=TestSnapshotUsage>:setup	Error	0.00	test_project_usage.py
test_01_vm_usage	Error	1.26	test_project_usage.py
ContextSuite context=TestVolumeUsage>:setup	Error	14.04	test_project_usage.py
ContextSuite context=TestVpnUsage>:setup	Error	20.01	test_project_usage.py
test_01_multiple_domains_primary_storage_limits	Error	23.20	test_ps_domain_limits.py
test_02_multiple_domains_primary_storage_limits	Failure	22.07	test_ps_domain_limits.py
test_05_assign_virtual_machine_different_domain	Failure	22.13	test_ps_domain_limits.py
test_06_destroy_recover_vm	Failure	22.70	test_ps_domain_limits.py
test_deploy_multiple_vm_1_root_domain_admin	Error	20.24	test_ps_limits.py
test_deploy_multiple_vm_2_child_domain_admin	Error	21.13	test_ps_limits.py
test_stop_start_vm_1_root_domain_admin	Failure	17.95	test_ps_limits.py
test_stop_start_vm_2_child_domain_admin	Failure	20.43	test_ps_limits.py
test_01_deploy_vm_domain_limit_reached	Error	15.94	test_ps_max_limits.py
test_02_deploy_vm_account_limit_reached	Error	13.54	test_ps_max_limits.py
test_03_deploy_vm_project_limit_reached	Error	13.10	test_ps_max_limits.py
test_01_increase_volume_size_within_account_limit	Failure	12.56	test_ps_resize_volume.py
test_02_increase_volume_size_above_account_limit	Failure	11.61	test_ps_resize_volume.py
test_03_increase_volume_size_above_domain_limit	Failure	11.37	test_ps_resize_volume.py
ContextSuite context=TestPublicIp>:setup	Error	0.00	test_public_ip.py
ContextSuite context=TestRecurringSnapshots>:setup	Error	0.00	test_recurring_snapshots.py
test_network_gc	Error	12.30	test_redundant_router_cleanups.py
test_restart_ntwk_no_cleanup	Error	11.44	test_redundant_router_cleanups.py
test_restart_ntwk_with_cleanup	Error	12.58	test_redundant_router_cleanups.py
test_enableVPNOverRvR	Error	11.93	test_redundant_router_services.py
test_downgradeRvR_to_VR	Error	12.80	test_redundant_router_upgrades.py
test_upgradeVR_to_redundantVR	Error	11.27	test_redundant_router_upgrades.py
test_01_concurrent_snapshots_live_migrate	Failure	10.49	test_snapshots_improvement.py
test_02_stop_vm_concurrent_snapshots	Failure	9.52	test_snapshots_improvement.py
test_03_concurrent_snapshots_create_template	Failure	10.57	test_snapshots_improvement.py
test_04_concurrent_snapshots_create_volume	Failure	9.48	test_snapshots_improvement.py
test_01_snapshot_on_rootVolume	Error	1.28	test_snapshots_improvement.py
ContextSuite context=TestResetSSHKeyUserRights>:setup	Error	0.00	test_reset_ssh_keypair.py
ContextSuite context=TestSnapshotLimit>:setup	Error	0.00	test_snapshot_limits.py
ContextSuite context=TestResourceCountRunningVMs>:setup	Error	0.00	test_resource_count_running_vms.py
test_01_check_list_capacity	Failure	6.45	test_resource_limit_tags.py
test_06_verify_domain_tagged_vm_limit	Error	13.83	test_resource_limit_tags.py
test_07_verify_account_tagged_vm_limit	Error	11.16	test_resource_limit_tags.py
test_08_verify_domain_tagged_volume_limit	Error	11.66	test_resource_limit_tags.py
test_09_verify_account_tagged_volume_limit	Error	12.88	test_resource_limit_tags.py
test_10_verify_assign_vm_limit	Error	18.35	test_resource_limit_tags.py
test_11_verify_scale_vm_limit	Error	11.51	test_resource_limit_tags.py
test_12_verify_scale_volume_limit	Error	11.59	test_resource_limit_tags.py
test_13_verify_restore_vm_limit	Error	20.43	test_resource_limit_tags.py
test_13_verify_restore_vm_limit	Error	20.43	test_resource_limit_tags.py
test_01_vm_per_account	Error	121.47	test_resource_limits.py
test_02_publicip_per_account	Error	121.35	test_resource_limits.py
test_03_snapshots_per_account	Error	121.37	test_resource_limits.py
test_04_volumes_per_account	Error	121.36	test_resource_limits.py
test_05_templates_per_account	Failure	121.67	test_resource_limits.py
test_01_publicip_per_domain	Error	121.48	test_resource_limits.py
test_01_vm_per_domain	Error	121.40	test_resource_limits.py
test_03_snapshots_per_domain	Error	121.38	test_resource_limits.py
test_04_volumes_per_domain	Error	121.34	test_resource_limits.py
test_05_templates_per_domain	Failure	121.59	test_resource_limits.py
test_01_create__snapshot_new_resized_rootvolume_size	Error	1.31	test_rootvolume_resize.py
test_02_create__template_new_resized_rootvolume_size	Error	6.45	test_rootvolume_resize.py
test_02_create__template_new_resized_rootvolume_size	Error	6.45	test_rootvolume_resize.py
test_04_vmreset_after_migrate_vm__rootvolume_resized	Error	1.24	test_rootvolume_resize.py
test_05_vmdeployment_with_size	Error	1.23	test_rootvolume_resize.py
test_06_resized_rootvolume_with_lessvalue	Error	1.24	test_rootvolume_resize.py
test_08_increase_volume_size_within_account_limit	Failure	5.20	test_rootvolume_resize.py
test_08_increase_volume_size_within_account_limit	Error	5.20	test_rootvolume_resize.py
ContextSuite context=TestRouterServices>:setup	Error	0.00	test_routers.py
ContextSuite context=TestRouterStopCreateFW>:setup	Error	0.00	test_routers.py
ContextSuite context=TestRouterStopCreateLB>:setup	Error	0.00	test_routers.py
ContextSuite context=TestRouterStopCreatePF>:setup	Error	0.00	test_routers.py
test_01_deployVM_InDefaultSecurityGroup	Error	1.31	test_security_groups.py
test_03_accessInDefaultSecurityGroup	Error	1.25	test_security_groups.py
test_01_snapshot_data_disk	Error	5.26	test_separate_backup_from_snapshot.py
test_createSharedNetwork_All	Error	70.02	test_shared_networks.py
test_createSharedNetwork_accountSpecific	Error	71.09	test_shared_networks.py
test_createSharedNetwork_domainSpecific	Error	78.43	test_shared_networks.py
test_createSharedNetwork_projectSpecific	Error	70.23	test_shared_networks.py
test_createSharedNetwork_usedVlan2	Error	65.85	test_shared_networks.py
test_deployVM_isolatedAndShared	Error	65.53	test_shared_networks.py
test_deployVM_multipleSharedNetwork	Error	65.69	test_shared_networks.py
test_escalation_ES1621	Error	65.83	test_shared_networks.py
test_reboot_router	Error	64.67	test_shared_networks.py
test_restart_network_1_True	Error	64.91	test_shared_networks.py
test_restart_network_2_False	Error	65.27	test_shared_networks.py
test_stop_start_router	Error	64.72	test_shared_networks.py
ContextSuite context=TestSnapshotCopy>:setup	Error	0.00	test_snapshot_copy.py
test_04_create_template_delete_account	Error	88.99	test_ss_domain_limits.py
test_01_multiple_domains_secondary_storage_limits	Error	87.33	test_ss_domain_limits.py
ContextSuite context=TestAccountSnapshotClean>:setup	Error	0.00	test_snapshot_gc.py
ContextSuite context=TestSecondaryVolumeUsage>:setup	Error	0.00	test_ss_volume_usage.py
test_02_deploy_ha_vm_from_iso	Error	15.48	test_stopped_vm.py
test_deployVmOnGivenHost	Failure	5.66	test_stopped_vm.py
test_01_deploy_vm_no_startvm	Error	12.56	test_stopped_vm.py
test_02_deploy_vm_startvm_true	Error	11.70	test_stopped_vm.py
test_05_deploy_startvm_false_change_so	Error	12.27	test_stopped_vm.py
test_09_stop_vm_migrate_vol	Error	5.52	test_stopped_vm.py
test_deploy_vm_password_enabled	Error	48.96	test_stopped_vm.py
test_01_deploy_vm_no_startvm	Error	18.52	test_stopped_vm.py
ContextSuite context=TestStorageMotion>:setup	Error	0.00	test_storage_motion.py
ContextSuite context=TestResourceTags>:setup	Error	0.00	test_tags.py
test_01_check_cross_domain_template_access	Error	0.02	test_template_access_across_domains.py
test_02_create_template	Error	0.01	test_template_access_across_domains.py
test_03_check_subdomain_template_access	Error	0.02	test_template_access_across_domains.py
test_04_check_non_public_template_access	Error	0.02	test_template_access_across_domains.py
test_05_check_non_public_template_subdomain_access	Error	0.01	test_template_access_across_domains.py
test_06_check_sub_public_template_sub_domain_access	Error	0.02	test_template_access_across_domains.py
test_07_check_default_public_template_sub_domain_access	Error	0.01	test_template_access_across_domains.py
test_08_check_non_public_template_sub_domain_access	Error	0.01	test_template_access_across_domains.py
test_01_create_template_snampshot	Error	98.80	test_template_from_snapshot_with_template_details.py
test_01_create_template_snampshot	Error	98.81	test_template_from_snapshot_with_template_details.py
test_01_create_template	Error	97.92	test_templates.py
test_01_create_template	Error	97.92	test_templates.py
test_01_updateResourceCount	Error	10.73	test_updateResourceCount.py
test_update_vm_details_admin	Error	11.61	test_update_vm.py
test_update_vm_name	Error	9.45	test_update_vm.py
test_02_create_private_gateway_with_associated_network	Error	5.01	test_user_private_gateway.py
ContextSuite context=TestUserPrivateGateways>:teardown	Error	10.39	test_user_private_gateway.py
test_03_create_domain_shared_network_with_associated_network	Failure	0.80	test_user_shared_network.py
test_04_create_account_shared_network_with_associated_network	Failure	0.93	test_user_shared_network.py
ContextSuite context=TestUserSharedNetworks>:teardown	Error	5.31	test_user_shared_network.py
ContextSuite context=TestVMPasswordEnabled>:setup	Error	0.00	test_vm_passwdenabled.py
ContextSuite context=TestVolumeDestroyRecover>:setup	Error	0.00	test_volume_destroy_recover.py
ContextSuite context=TestAttachDetachVolume>:setup	Error	0.00	test_volumes.py
ContextSuite context=TestAttachVolume>:setup	Error	0.00	test_volumes.py
ContextSuite context=TestAttachVolumeISO>:setup	Error	0.00	test_volumes.py
ContextSuite context=TestMigrateVolume>:setup	Error	8.48	test_volumes.py
test_01_verify_ipv6_vpc	Error	3.32	test_vpc_ipv6.py
test_02_verify_ipv6_vpc_redundant	Error	3.32	test_vpc_ipv6.py
test_03_verify_upgraded_ipv6_vpc	Error	3.32	test_vpc_ipv6.py
test_04_verify_upgraded_ipv6_vpc_redundant	Error	3.31	test_vpc_ipv6.py
ContextSuite context=TestRouterOperations>:setup	Error	0.00	test_vpc_network.py
test_01_create_network_1_network_offering	Error	5.96	test_vpc_network.py
test_02_create_network_fail_1_network_offering	Error	5.71	test_vpc_network.py
test_07_create_network_unsupported_services	Error	8.07	test_vpc_network.py
test_08_create_network_without_sourceNAT	Error	7.97	test_vpc_network.py
test_09_create_network_shared_nwoff_1_network_off_shared	Error	5.94	test_vpc_network.py
ContextSuite context=TestVPCNetworkGc>:setup	Error	10.82	test_vpc_network.py
test_01_create_network_outside_range_1_network_offering	Error	5.62	test_vpc_network.py
test_02_create_network_outside_range	Error	7.59	test_vpc_network.py
test_03_create_network_inside_range_1_network_offering	Error	5.27	test_vpc_network.py
test_04_create_network_overlapping_range_1_network_offering	Error	5.59	test_vpc_network.py
test_05_create_network_diff_account_1_network_offering	Error	5.39	test_vpc_network.py
test_01_network_services_upgrade	Error	5.76	test_vpc_network.py
test_02_network_vpcvr2vr_upgrade	Error	7.65	test_vpc_network.py
test_01_internallb_rules	Error	5.44	test_vpc_network_internal_lbrules.py
test_01_VPC_LBRulesListing	Error	6.33	test_vpc_network_lbrules.py
test_02_VPC_CreateLBRuleInMultipleNetworks	Error	6.22	test_vpc_network_lbrules.py
test_03_VPC_CreateLBRuleInMultipleNetworksVRStoppedState	Error	6.11	test_vpc_network_lbrules.py
test_04_VPC_CreateLBRuleInMultipleNetworksVRStoppedState	Error	5.80	test_vpc_network_lbrules.py
test_05_VPC_CreateAndDeleteLBRule	Error	5.84	test_vpc_network_lbrules.py
test_06_VPC_CreateAndDeleteLBRuleVRStopppedState	Error	4.74	test_vpc_network_lbrules.py
test_07_VPC_CreateAndDeleteAllLBRule	Error	5.70	test_vpc_network_lbrules.py
test_08_VPC_CreateAndDeleteAllLBRuleVRStoppedState	Error	5.58	test_vpc_network_lbrules.py
test_09_VPC_LBRuleCreateFailMultipleVPC	Error	4.50	test_vpc_network_lbrules.py
test_10_VPC_FailedToCreateLBRuleNonVPCNetwork	Error	5.75	test_vpc_network_lbrules.py
test_11_VPC_LBRuleCreateNotAllowed	Error	4.81	test_vpc_network_lbrules.py
test_12_VPC_LBRuleCreateFailForRouterIP	Error	5.72	test_vpc_network_lbrules.py
test_13_VPC_LBRuleCreateFailForPFSourceNATIP	Error	5.79	test_vpc_network_lbrules.py
test_14_VPC_LBRuleCreateFailForStaticNatRule	Error	5.44	test_vpc_network_lbrules.py
test_15_VPC_ReleaseIPForLBRuleCreated	Error	5.65	test_vpc_network_lbrules.py
test_01_network_services_VPC_StopCreatePF	Error	6.53	test_vpc_network_pfrules.py
test_02_network_services_VPC_CreatePF	Error	6.06	test_vpc_network_pfrules.py
test_03_network_services_VPC_StopCreateMultiplePF	Error	6.27	test_vpc_network_pfrules.py
test_04_network_services_VPC_CreateMultiplePF	Error	6.49	test_vpc_network_pfrules.py
test_01_VPC_StaticNatRuleCreateStoppedState	Error	6.40	test_vpc_network_staticnatrule.py
test_02_VPC_CreateStaticNatRule	Error	6.26	test_vpc_network_staticnatrule.py
test_03_VPC_StopCreateMultipleStaticNatRuleStopppedState	Error	6.56	test_vpc_network_staticnatrule.py
test_04_VPC_CreateMultipleStaticNatRule	Error	6.82	test_vpc_network_staticnatrule.py
test_03_vpc_off_without_lb	Error	9.40	test_vpc_offerings.py
test_04_vpc_off_without_static_nat	Error	8.01	test_vpc_offerings.py
test_05_vpc_off_without_pf	Error	7.30	test_vpc_offerings.py
test_07_update_vpc_off	Error	9.38	test_vpc_offerings.py
test_09_create_redundant_vpc_offering	Error	7.97	test_vpc_offerings.py
ContextSuite context=TestVPCRouterOneNetwork>:setup	Error	0.00	test_vpc_routers.py
ContextSuite context=TestVPCRoutersBasic>:setup	Error	0.00	test_vpc_routers.py
ContextSuite context=TestVMLifeCycleBothIsolated>:setup	Error	0.00	test_vpc_vm_life_cycle.py
ContextSuite context=TestVMLifeCycleStoppedVPCVR>:setup	Error	0.00	test_vpc_vm_life_cycle.py
ContextSuite context=TestVMLifeCycleVPC>:setup	Error	0.00	test_vpc_vm_life_cycle.py
test_01_deploy_vms_in_network	Error	7.54	test_vpc_vms_deployment.py
test_02_deploy_vms_delete_network	Error	7.58	test_vpc_vms_deployment.py
test_03_deploy_vms_delete_add_network	Error	7.66	test_vpc_vms_deployment.py
test_04_deploy_vms_delete_add_network_noLb	Error	7.91	test_vpc_vms_deployment.py
test_05_create_network_max_limit	Error	8.00	test_vpc_vms_deployment.py
test_06_delete_network_vm_running	Error	7.71	test_vpc_vms_deployment.py
test_08_ip_reallocation_CS5986	Error	6.52	test_vpc_vms_deployment.py
test_01_VPN_user_limit	Error	4.92	test_vpn_users.py
test_02_use_vpn_port	Error	4.95	test_vpn_users.py
test_03_enable_vpn_use_port	Error	4.63	test_vpn_users.py
test_04_add_new_users	Error	4.79	test_vpn_users.py
test_05_add_duplicate_user	Error	5.00	test_vpn_users.py
test_06_add_VPN_user_global_admin	Error	4.72	test_vpn_users.py
test_07_add_VPN_user_domain_admin	Error	4.90	test_vpn_users.py
test_08_add_TCP_PF_Rule_In_VPN	Error	4.97	test_vpn_users.py
test_CLOUDSTACK_6181_stoppedvm_root_resize	Error	11.73	test_bugs.py
test_CLOUDSTACK_6181_vm_root_resize	Error	1.25	test_bugs.py
test_01_dedicate_guest_vlan_range_root_domain	Error	12.20	test_dedicate_guest_vlan_ranges.py
test_02_dedicate_guest_vlan_range_user_domain	Error	13.26	test_dedicate_guest_vlan_ranges.py
test_03_multiple_guest_netwoks	Error	8.12	test_dedicate_guest_vlan_ranges.py
test_02_delete_dedicated_vlan_range_vlan_in_use	Error	6.90	test_dedicate_guest_vlan_ranges.py
test_03_delete_account	Error	6.71	test_dedicate_guest_vlan_ranges.py
test_05_release_range_vlan_in_use	Error	6.82	test_dedicate_guest_vlan_ranges.py
test_05_acquire_ip_single_guest_network	Error	4.49	test_dedicate_public_ip_range.py
test_06_acquire_ip_multiple_guest_network	Error	4.71	test_dedicate_public_ip_range.py
test_08_acquire_ip_in_vpc	Error	7.05	test_dedicate_public_ip_range.py
test_14_release_ip_from_dedicated_range	Error	4.28	test_dedicate_public_ip_range.py
test_15_release_dedicated_range	Failure	4.34	test_dedicate_public_ip_range.py
test_16_delete_ip_range_no_network_rules	Error	4.75	test_dedicate_public_ip_range.py
test_17_delete_ip_range_network_rules	Error	4.24	test_dedicate_public_ip_range.py
test_18_delete_network	Error	4.09	test_dedicate_public_ip_range.py
test_19_delete_account	Error	4.65	test_dedicate_public_ip_range.py
test_21_release_dedicated_range_ip_address_in_use	Error	4.62	test_dedicate_public_ip_range.py
test_01_deploy_vm_with_explicit_dedication	Error	1.10	test_explicit_dedication.py
test_01_host_maintenance_mode	Failure	5.09	test_high_availability.py
test_02_host_maintenance_mode_with_activities	Failure	4.81	test_high_availability.py
test_01_ip_resource_count_vpc_network	Error	7.10	test_ip_resource_count_for_vpc.py
ContextSuite context=TestNFSMountOptsKVM>:setup	Error	0.00	test_primary_storage_nfsmountopts_kvm.py
test_createRvRNetwork	Error	10.77	test_redundant_router.py
test_createRvRNetwork	Error	11.28	test_redundant_router.py
test_01_stopPrimaryRvR	Error	4.89	test_redundant_router.py
test_02_stopBackupRvR	Error	4.94	test_redundant_router.py
test_03_rebootPrimaryRvR	Error	5.17	test_redundant_router.py
test_04_rebootBackupRvR	Error	4.60	test_redundant_router.py
test_05_stopBackupRvR_startInstance	Error	4.98	test_redundant_router.py
ContextSuite context=TestRvRRedundancy>:teardown	Error	5.05	test_redundant_router.py
test_applyNetworkRules_PrimaryDown_deleteNetworkRules	Error	12.96	test_redundant_router_network_rules.py
test_applyRules_restartRvRNetwork	Error	10.99	test_redundant_router_network_rules.py
test_apply_and__delete_NetworkRulesOnRvR	Error	12.91	test_redundant_router_network_rules.py
test_networkRules_afterRebootRouters	Error	10.97	test_redundant_router_network_rules.py

[DaanHoogland]

@blueorangutan test securityGroups

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

[github-actions]

This pull request has merge conflicts. Dear author, please fix the conflicts and sync your branch with the base branch.

[blueorangutan]

[SF] Trillian test result (tid-15310)
Environment: kvm-ol8 (x2), zone: Advanced_with_Security_Groups Networking with Mgmt server ol8
Total time taken: 150174 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t15310-kvm-ol8.zip
Smoke tests completed. 77 look OK, 73 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_deploy_vm_from_direct_download_template_nfs_storage	Error	4.29	test_direct_download.py
ContextSuite context=TestDirectDownloadTemplates>:teardown	Error	1.07	test_direct_download.py
test_DeleteDomain	Failure	39.42	test_accounts.py
test_forceDeleteDomain	Failure	40.51	test_accounts.py
test_01_events_resource	Error	5.62	test_events_resource.py
ContextSuite context=TestExtensions>:setup	Error	0.00	test_extension_custom.py
test_vm_backup_create_vm_from_backup	Failure	811.75	test_backup_recovery_nas.py
test_vm_backup_lifecycle	Error	1.08	test_backup_recovery_nas.py
test_replace_acl_of_network	Error	1.49	test_global_acls.py
test_01_condensed_drs_algorithm	Error	1.16	test_cluster_drs.py
test_02_balanced_drs_algorithm	Error	0.06	test_cluster_drs.py
ContextSuite context=TestClusterDRS>:teardown	Error	0.11	test_cluster_drs.py
test_dedicateGuestVlanRange	Error	0.00	test_guest_vlan_range.py
ContextSuite context=TestDedicateGuestVlanRange>:teardown	Error	0.01	test_guest_vlan_range.py
test_04_verify_guest_lspci	Error	810.71	test_deploy_virtio_scsi_vm.py
test_06_verify_guest_lspci_again	Error	810.62	test_deploy_virtio_scsi_vm.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80	Failure	3.61	test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80	Failure	3.60	test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces	Failure	2.47	test_internal_lb.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces	Failure	3.55	test_internal_lb.py
test_02_create_network_routed_mode_with_specified_cidr	Error	0.04	test_ipv4_routing.py
test_04_create_isolated_network_routed_mode_with_cidrsize	Error	0.04	test_ipv4_routing.py
test_06_isolated_network_with_routed_mode	Error	0.05	test_ipv4_routing.py
test_07_vpc_and_tier_with_routed_mode	Error	2.25	test_ipv4_routing.py
test_11_isolated_network_with_dynamic_routed_mode	Error	2.18	test_ipv4_routing.py
test_12_vpc_and_tier_with_dynamic_routed_mode	Error	7.68	test_ipv4_routing.py
test_01_ping_in_vr_success	Failure	0.01	test_diagnostics.py
test_02_ping_in_vr_failure	Failure	0.01	test_diagnostics.py
test_07_arping_in_vr	Failure	0.01	test_diagnostics.py
test_10_traceroute_in_vr	Failure	0.01	test_diagnostics.py
test_13_retrieve_vr_default_files	Failure	0.01	test_diagnostics.py
test_14_retrieve_vr_one_file	Failure	0.01	test_diagnostics.py
test_01_create_ipv6_public_ip_range	Error	0.02	test_ipv6_infra.py
test_03_create_network_domain_network_offering	Error	8.42	test_domain_network_offerings.py
test_03_create_vpc_domain_vpc_offering	Error	9.08	test_domain_vpc_offerings.py
test_05_register_unregister_extension	Error	0.04	test_extension_lifecycle.py
test_06_register_extension_already_fail	Error	0.03	test_extension_lifecycle.py
test_07_delete_extension_registered_resource_fail	Error	0.03	test_extension_lifecycle.py
test_08_extension_sync	Failure	270.88	test_extension_lifecycle.py
test_09_extension_deploy_vm	Error	0.07	test_extension_lifecycle.py
test_01_invalid_upgrade_kubernetes_cluster	Failure	3635.84	test_kubernetes_clusters.py
test_02_upgrade_kubernetes_cluster	Failure	3635.23	test_kubernetes_clusters.py
test_03_deploy_and_scale_kubernetes_cluster	Failure	3628.04	test_kubernetes_clusters.py
test_04_autoscale_kubernetes_cluster	Failure	3631.81	test_kubernetes_clusters.py
test_05_basic_lifecycle_kubernetes_cluster	Failure	3633.11	test_kubernetes_clusters.py
test_06_delete_kubernetes_cluster	Failure	3629.91	test_kubernetes_clusters.py
test_10_vpc_tier_kubernetes_cluster	Error	3.49	test_kubernetes_clusters.py
test_12_test_deploy_cluster_different_offerings_per_node_type	Failure	3635.62	test_kubernetes_clusters.py
test_08_listsystemvms	Failure	0.02	test_list_volumes.py
ContextSuite context=TestIsolatedNetworksPasswdServer>:setup	Error	0.00	test_password_server.py
ContextSuite context=TestLoadBalance>:setup	Error	0.00	test_loadbalance.py
test_01_native_to_native_network_migration	Error	4.27	test_migration.py
test_02_native_to_native_vpc_migration	Error	6.51	test_migration.py
test_network_acl	Error	2.25	test_network_acl.py
ContextSuite context=TestIpv6Network>:setup	Error	0.00	test_network_ipv6.py
ContextSuite context=TestNetworkPermissions>:setup	Error	0.00	test_network_permissions.py
test_delete_account	Error	74.41	test_network.py
test_delete_network_while_vm_on_it	Error	8.49	test_network.py
test_delete_network_while_vm_on_it	Error	8.50	test_network.py
test_deploy_vm_l2network	Error	8.43	test_network.py
test_deploy_vm_l2network	Error	8.43	test_network.py
test_l2network_restart	Error	8.61	test_network.py
test_l2network_restart	Error	8.61	test_network.py
ContextSuite context=TestL2Networks>:teardown	Error	9.70	test_network.py
test_01_port_fwd_on_src_nat	Failure	0.02	test_network.py
test_02_port_fwd_on_non_src_nat	Error	0.02	test_network.py
ContextSuite context=TestPublicIP>:setup	Error	6.72	test_network.py
test_reboot_router	Error	132.98	test_network.py
test_releaseIP	Error	13.75	test_network.py
test_releaseIP_using_IP	Error	13.42	test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule	Error	0.02	test_network.py
test_network_rules_acquired_public_ip_2_nat_rule	Error	0.02	test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule	Error	0.02	test_network.py
ContextSuite context=TestSharedNetworkWithConfigDrive>:setup	Error	50.14	test_network.py
test_01_nic	Error	44.89	test_nic.py
test_extendPhysicalNetworkVlan	Error	0.04	test_non_contigiousvlan.py
ContextSuite context=TestNonStrictAffinityGroups>:setup	Error	0.00	test_nonstrict_affinity_group.py
test_01_isolated_persistent_network	Error	0.04	test_persistent_network.py
ContextSuite context=TestPortablePublicIPAcquire>:setup	Error	0.00	test_portable_publicip.py
test_01_create_delete_portforwarding_fornonvpc	Error	3.69	test_portforwardingrules.py
test_01_vpc_privategw_acl	Failure	5.36	test_privategw_acl.py
test_02_vpc_privategw_static_routes	Failure	5.59	test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup	Failure	5.50	test_privategw_acl.py
test_04_rvpc_privategw_static_routes	Failure	5.77	test_privategw_acl.py
test_dedicatePublicIpRange	Error	0.02	test_public_ip_range.py
test_dedicate_public_ip_range_for_system_vms	Error	0.02	test_public_ip_range.py
test_dedicate_public_ip_range_for_system_vms_01_ssvm	Error	0.05	test_public_ip_range.py
test_dedicate_public_ip_range_for_system_vms_02_cpvm	Error	0.05	test_public_ip_range.py
ContextSuite context=TestPurgeExpungedVms>:setup	Error	0.00	test_purge_expunged_vms.py
test_create_pvlan_network	Error	0.04	test_pvlan.py
test_another_user_can_allocate_ip_after_quarantined_has_ended_network	Error	4.07	test_quarantined_ips.py
test_another_user_can_allocate_ip_after_quarantined_has_ended_vpc	Error	0.25	test_quarantined_ips.py
test_only_owner_can_allocate_ip_in_quarantine_network	Error	0.26	test_quarantined_ips.py
test_only_owner_can_allocate_ip_in_quarantine_vpc	Error	0.26	test_quarantined_ips.py
test_CRUD_operations_userdata	Error	1518.89	test_register_userdata.py
test_deploy_vm_with_registered_userdata	Error	3.13	test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_override_policy_allow	Error	3.03	test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_override_policy_append	Error	3.08	test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_override_policy_deny	Error	3.00	test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_params	Error	3.08	test_register_userdata.py
test_link_and_unlink_userdata_to_template	Error	2.97	test_register_userdata.py
test_user_userdata_crud	Error	3.07	test_register_userdata.py
ContextSuite context=TestResetVmOnReboot>:setup	Error	0.00	test_reset_vm_on_reboot.py
ContextSuite context=TestVMWareStoragePolicies>:setup	Error	0.00	test_storage_policy.py
ContextSuite context=TestRAMCPUResourceAccounting>:setup	Error	0.00	test_resource_accounting.py
ContextSuite context=TestResourceNames>:setup	Error	0.00	test_resource_names.py
ContextSuite context=TestRestoreVM>:setup	Error	0.00	test_restore_vm.py
test_02_create_template_with_checksum_sha1	Error	65.44	test_templates.py
test_03_create_template_with_checksum_sha256	Error	65.48	test_templates.py
test_04_create_template_with_checksum_md5	Error	65.42	test_templates.py
test_05_create_template_with_no_checksum	Error	65.42	test_templates.py
test_02_deploy_vm_from_direct_download_template	Error	1.29	test_templates.py
ContextSuite context=TestCreateTemplateWithDirectDownload>:teardown	Error	14.78	test_templates.py
ContextSuite context=TestTemplates>:setup	Error	22.95	test_templates.py
ContextSuite context=TestRouterDHCPHosts>:setup	Error	0.00	test_router_dhcphosts.py
ContextSuite context=TestRouterDHCPOpts>:setup	Error	0.00	test_router_dhcphosts.py
ContextSuite context=TestRouterDns>:setup	Error	0.00	test_router_dns.py
ContextSuite context=TestRouterDnsService>:setup	Error	0.00	test_router_dnsservice.py
test_01_list_sec_storage_vm	Failure	0.03	test_ssvm.py
test_02_list_cpvm_vm	Failure	0.02	test_ssvm.py
test_03_ssvm_internals	Failure	0.02	test_ssvm.py
test_04_cpvm_internals	Failure	0.02	test_ssvm.py
test_05_stop_ssvm	Failure	0.03	test_ssvm.py
test_06_stop_cpvm	Failure	0.03	test_ssvm.py
test_07_reboot_ssvm	Failure	0.03	test_ssvm.py
test_08_reboot_cpvm	Failure	0.03	test_ssvm.py
test_09_reboot_ssvm_forced	Failure	0.03	test_ssvm.py
test_10_reboot_cpvm_forced	Failure	0.03	test_ssvm.py
test_11_destroy_ssvm	Failure	0.03	test_ssvm.py
test_12_destroy_cpvm	Failure	0.03	test_ssvm.py
ContextSuite context=TestRouterIpTablesPolicies>:setup	Error	0.00	test_routers_iptables_default_policy.py
ContextSuite context=TestVPCIpTablesPolicies>:setup	Error	0.00	test_routers_iptables_default_policy.py
ContextSuite context=TestIsolatedNetworks>:setup	Error	0.00	test_routers_network_ops.py
ContextSuite context=TestRedundantIsolateNetworks>:setup	Error	0.00	test_routers_network_ops.py
ContextSuite context=TestRouterServices>:setup	Error	0.00	test_routers.py
test_01_sys_vm_start	Failure	0.11	test_secondary_storage.py
ContextSuite context=TestCpuCapServiceOfferings>:setup	Error	0.00	test_service_offerings.py
ContextSuite context=TestServiceOfferings>:setup	Error	0.19	test_service_offerings.py
ContextSuite context=TestSetSourceNatIp>:setup	Error	0.00	test_set_sourcenat.py
test_1_userdata_on_ssvm	Failure	0.09	test_systemvm_userdata.py
test_2_userdata_on_cpvm	Failure	0.09	test_systemvm_userdata.py
test_3_userdata_on_vr	Error	0.16	test_systemvm_userdata.py
ContextSuite context=TestSharedFSLifecycle>:setup	Error	0.00	test_sharedfs_lifecycle.py
ContextSuite context=TestISOUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestLBRuleUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestNatRuleUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestPublicIPUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestSnapshotUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestVmUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestVolumeUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestVpnUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestSnapshotRootDisk>:setup	Error	0.00	test_snapshots.py
ContextSuite context=TestSnapshotStandaloneBackup>:setup	Error	0.00	test_snapshots.py
ContextSuite context=TestSslOffloading>:setup	Error	0.00	test_ssl_offloading.py
ContextSuite context=TestVmAutoScaling>:setup	Error	0.00	test_vm_autoscaling.py
test_01_deploy_vm_on_specific_host	Error	1.30	test_vm_deployment_planner.py
test_02_deploy_vm_on_specific_cluster	Error	1.26	test_vm_deployment_planner.py
test_03_deploy_vm_on_specific_pod	Error	1.26	test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster	Error	1.33	test_vm_deployment_planner.py
test_05_deploy_vm_on_cluster_override_pod	Error	1.23	test_vm_deployment_planner.py
ContextSuite context=TestDeployVM>:setup	Error	0.00	test_vm_life_cycle.py
test_01_migrate_VM_and_root_volume	Error	1.31	test_vm_life_cycle.py
test_02_migrate_VM_with_two_data_disks	Error	1.28	test_vm_life_cycle.py
test_01_secure_vm_migration	Error	77.13	test_vm_life_cycle.py
test_02_unsecure_vm_migration	Error	221.60	test_vm_life_cycle.py
test_03_secured_to_nonsecured_vm_migration	Error	149.99	test_vm_life_cycle.py
test_04_nonsecured_to_secured_vm_migration	Error	149.95	test_vm_life_cycle.py
ContextSuite context=TestVMLifeCycle>:setup	Error	4.29	test_vm_life_cycle.py
test_01_unmanage_vm_cycle_persistent_domain	Error	0.17	test_vm_lifecycle_unmanage_kvm_import.py
test_02_unmanage_stopped_vm_cycle_persistent_domain	Error	0.14	test_vm_lifecycle_unmanage_kvm_import.py
ContextSuite context=TestUnmanageKvmVM>:teardown	Error	0.19	test_vm_lifecycle_unmanage_kvm_import.py
ContextSuite context=TestVMSchedule>:setup	Error	0.00	test_vm_schedule.py
ContextSuite context=TestVmSnapshot>:setup	Error	2.98	test_vm_snapshots.py
ContextSuite context=TestMigrateVMStrictTags>:setup	Error	0.00	test_vm_strict_host_tags.py
ContextSuite context=TestRestoreVMStrictTags>:setup	Error	0.00	test_vm_strict_host_tags.py
ContextSuite context=TestScaleVMStrictTags>:setup	Error	0.00	test_vm_strict_host_tags.py
ContextSuite context=TestVMDeploymentPlannerStrictTags>:setup	Error	0.00	test_vm_strict_host_tags.py
test_01_register_vnf_template	Error	0.04	test_vnf_templates.py
test_02_list_vnf_template	Error	0.04	test_vnf_templates.py
test_03_edit_vnf_template	Error	0.04	test_vnf_templates.py
test_04_deploy_vnf_appliance	Error	0.04	test_vnf_templates.py
test_05_delete_vnf_template	Error	0.04	test_vnf_templates.py
ContextSuite context=TestCreateVolume>:setup	Error	0.00	test_volumes.py
test_01_root_volume_encryption	Error	0.05	test_volumes.py
test_02_data_volume_encryption	Error	0.04	test_volumes.py
test_03_root_and_data_volume_encryption	Error	0.05	test_volumes.py
ContextSuite context=TestVolumes>:setup	Error	4.27	test_volumes.py
ContextSuite context=TestIpv6Vpc>:setup	Error	0.00	test_vpc_ipv6.py
ContextSuite context=TestVPCRedundancy>:setup	Error	0.00	test_vpc_redundant.py
ContextSuite context=TestVPCNics>:setup	Error	0.00	test_vpc_router_nics.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup	Error	0.00	test_vpc_vpn.py
ContextSuite context=TestVPCSite2SiteVPNMultipleOptions>:setup	Error	0.00	test_vpc_vpn.py
ContextSuite context=TestVpcRemoteAccessVpn>:setup	Error	0.00	test_vpc_vpn.py
ContextSuite context=TestVpcSite2SiteVpn>:setup	Error	0.00	test_vpc_vpn.py
test_02_cancel_host_maintenace_with_migration_jobs	Error	1.43	test_host_maintenance.py
test_03_cancel_host_maintenace_with_migration_jobs_failure	Error	1.56	test_host_maintenance.py
test_01_cancel_host_maintenance_ssh_enabled_agent_connected	Failure	18.45	test_host_maintenance.py
test_03_cancel_host_maintenance_ssh_disabled_agent_connected	Failure	21.53	test_host_maintenance.py
test_04_cancel_host_maintenance_ssh_disabled_agent_disconnected	Failure	30.60	test_host_maintenance.py
ContextSuite context=TestHostMaintenanceAgents>:teardown	Error	31.70	test_host_maintenance.py
test_disable_oobm_ha_state_ineligible	Error	1513.17	test_hostha_kvm.py

[sureshanaparti]

@blueorangutan package

[blueorangutan]

@sureshanaparti a [SL] Jenkins job has been kicked to build packages. It will be bundled with no SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 16632

[sureshanaparti]

@blueorangutan package

[blueorangutan]

@sureshanaparti a [SL] Jenkins job has been kicked to build packages. It will be bundled with no SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 16658

[shwstppr]

@blueorangutan package

[blueorangutan]

@shwstppr a [SL] Jenkins job has been kicked to build packages. It will be bundled with no SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 16669

[sureshanaparti]

@blueorangutan package

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

[sureshanaparti]

@blueorangutan package

[blueorangutan]

@sureshanaparti a [SL] Jenkins job has been kicked to build packages. It will be bundled with no SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 16723