KEYMGR Simulation Results

Monday August 26 2024 23:33:20 UTC

GitHub Revision: 4674f625b3

Branch: os_regression_2024_08_26

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 27137705585251537962012108482438895412147493342955425380690984800523869492310

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke keymgr_smoke 45.030s 6.910ms 50 50 100.00
V1 random keymgr_random 35.240s 7.347ms 50 50 100.00
V1 csr_hw_reset keymgr_csr_hw_reset 1.410s 190.312us 5 5 100.00
V1 csr_rw keymgr_csr_rw 41.974s 19 20 95.00
V1 csr_bit_bash keymgr_csr_bit_bash 15.310s 2.401ms 5 5 100.00
V1 csr_aliasing keymgr_csr_aliasing 48.355s 4 5 80.00
V1 csr_mem_rw_with_rand_reset keymgr_csr_mem_rw_with_rand_reset 48.888s 18 20 90.00
V1 regwen_csr_and_corresponding_lockable_csr keymgr_csr_rw 41.974s 19 20 95.00
keymgr_csr_aliasing 48.355s 4 5 80.00
V1 TOTAL 151 155 97.42
V2 cfgen_during_op keymgr_cfg_regwen 50.210s 1.072ms 50 50 100.00
V2 sideload keymgr_sideload 41.630s 49 50 98.00
keymgr_sideload_kmac 32.470s 2.954ms 50 50 100.00
keymgr_sideload_aes 41.460s 1.805ms 50 50 100.00
keymgr_sideload_otbn 49.110s 6.257ms 50 50 100.00
V2 direct_to_disabled_state keymgr_direct_to_disabled 34.340s 3.743ms 50 50 100.00
V2 lc_disable keymgr_lc_disable 13.160s 1.974ms 50 50 100.00
V2 kmac_error_response keymgr_kmac_rsp_err 18.310s 4.802ms 50 50 100.00
V2 invalid_sw_input keymgr_sw_invalid_input 55.680s 2.142ms 49 50 98.00
V2 invalid_hw_input keymgr_hwsw_invalid_input 43.780s 3.499ms 50 50 100.00
V2 sync_async_fault_cross keymgr_sync_async_fault_cross 17.700s 1.229ms 49 50 98.00
V2 stress_all keymgr_stress_all 5.298m 51.438ms 46 50 92.00
V2 intr_test keymgr_intr_test 43.002s 49 50 98.00
V2 alert_test keymgr_alert_test 41.680s 49 50 98.00
V2 tl_d_oob_addr_access keymgr_tl_errors 42.987s 18 20 90.00
V2 tl_d_illegal_access keymgr_tl_errors 42.987s 18 20 90.00
V2 tl_d_outstanding_access keymgr_csr_hw_reset 1.410s 190.312us 5 5 100.00
keymgr_csr_rw 41.974s 19 20 95.00
keymgr_csr_aliasing 48.355s 4 5 80.00
keymgr_same_csr_outstanding 42.938s 18 20 90.00
V2 tl_d_partial_access keymgr_csr_hw_reset 1.410s 190.312us 5 5 100.00
keymgr_csr_rw 41.974s 19 20 95.00
keymgr_csr_aliasing 48.355s 4 5 80.00
keymgr_same_csr_outstanding 42.938s 18 20 90.00
V2 TOTAL 727 740 98.24
V2S sec_cm_additional_check keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
V2S tl_intg_err keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
keymgr_tl_intg_err 8.280s 1.048ms 20 20 100.00
V2S shadow_reg_update_error keymgr_shadow_reg_errors 42.054s 18 20 90.00
V2S shadow_reg_read_clear_staged_value keymgr_shadow_reg_errors 42.054s 18 20 90.00
V2S shadow_reg_storage_error keymgr_shadow_reg_errors 42.054s 18 20 90.00
V2S shadowed_reset_glitch keymgr_shadow_reg_errors 42.054s 18 20 90.00
V2S shadow_reg_update_error_with_csr_rw keymgr_shadow_reg_errors_with_csr_rw 1.027m 18 20 90.00
V2S prim_count_check keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
V2S prim_fsm_check keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
V2S sec_cm_bus_integrity keymgr_tl_intg_err 8.280s 1.048ms 20 20 100.00
V2S sec_cm_config_shadow keymgr_shadow_reg_errors 42.054s 18 20 90.00
V2S sec_cm_op_config_regwen keymgr_cfg_regwen 50.210s 1.072ms 50 50 100.00
V2S sec_cm_reseed_config_regwen keymgr_random 35.240s 7.347ms 50 50 100.00
keymgr_csr_rw 41.974s 19 20 95.00
V2S sec_cm_sw_binding_config_regwen keymgr_random 35.240s 7.347ms 50 50 100.00
keymgr_csr_rw 41.974s 19 20 95.00
V2S sec_cm_max_key_ver_config_regwen keymgr_random 35.240s 7.347ms 50 50 100.00
keymgr_csr_rw 41.974s 19 20 95.00
V2S sec_cm_lc_ctrl_intersig_mubi keymgr_lc_disable 13.160s 1.974ms 50 50 100.00
V2S sec_cm_constants_consistency keymgr_hwsw_invalid_input 43.780s 3.499ms 50 50 100.00
V2S sec_cm_intersig_consistency keymgr_hwsw_invalid_input 43.780s 3.499ms 50 50 100.00
V2S sec_cm_hw_key_sw_noaccess keymgr_random 35.240s 7.347ms 50 50 100.00
V2S sec_cm_output_keys_ctrl_redun keymgr_sideload_protect 27.850s 2.952ms 49 50 98.00
V2S sec_cm_ctrl_fsm_sparse keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
V2S sec_cm_data_fsm_sparse keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
V2S sec_cm_ctrl_fsm_local_esc keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
V2S sec_cm_ctrl_fsm_consistency keymgr_custom_cm 35.870s 1.508ms 50 50 100.00
V2S sec_cm_ctrl_fsm_global_esc keymgr_lc_disable 13.160s 1.974ms 50 50 100.00
V2S sec_cm_ctrl_ctr_redun keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
V2S sec_cm_kmac_if_fsm_sparse keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
V2S sec_cm_kmac_if_ctr_redun keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
V2S sec_cm_kmac_if_cmd_ctrl_consistency keymgr_custom_cm 35.870s 1.508ms 50 50 100.00
V2S sec_cm_kmac_if_done_ctrl_consistency keymgr_custom_cm 35.870s 1.508ms 50 50 100.00
V2S sec_cm_reseed_ctr_redun keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
V2S sec_cm_side_load_sel_ctrl_consistency keymgr_custom_cm 35.870s 1.508ms 50 50 100.00
V2S sec_cm_sideload_ctrl_fsm_sparse keymgr_sec_cm 1.039m 3.018ms 5 5 100.00
V2S sec_cm_ctrl_key_integrity keymgr_custom_cm 35.870s 1.508ms 50 50 100.00
V2S TOTAL 160 165 96.97
V3 stress_all_with_rand_reset keymgr_stress_all_with_rand_reset 23.360s 2.333ms 33 50 66.00
V3 TOTAL 33 50 66.00
TOTAL 1071 1110 96.49

Testplan Progress

Items Total Written Passing Progress
V1 7 7 4 57.14
V2 16 16 8 50.00
V2S 6 6 3 50.00
V3 1 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
97.72 99.04 98.11 98.17 100.00 99.02 98.63 91.09

Failure Buckets

Past Results