KMAC/MASKED Simulation Results

Sunday May 19 2024 19:02:23 UTC

GitHub Revision: eb776817a5

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 56458776725427632834749451790671712939002859133119076946547796163671543192855

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke kmac_smoke 1.535m 18.664ms 50 50 100.00
V1 csr_hw_reset kmac_csr_hw_reset 1.160s 60.780us 5 5 100.00
V1 csr_rw kmac_csr_rw 1.230s 105.207us 20 20 100.00
V1 csr_bit_bash kmac_csr_bit_bash 18.270s 982.953us 5 5 100.00
V1 csr_aliasing kmac_csr_aliasing 9.760s 508.639us 5 5 100.00
V1 csr_mem_rw_with_rand_reset kmac_csr_mem_rw_with_rand_reset 2.800s 89.773us 20 20 100.00
V1 regwen_csr_and_corresponding_lockable_csr kmac_csr_rw 1.230s 105.207us 20 20 100.00
kmac_csr_aliasing 9.760s 508.639us 5 5 100.00
V1 mem_walk kmac_mem_walk 0.830s 22.803us 5 5 100.00
V1 mem_partial_access kmac_mem_partial_access 1.560s 89.478us 5 5 100.00
V1 TOTAL 115 115 100.00
V2 long_msg_and_output kmac_long_msg_and_output 57.826m 186.160ms 50 50 100.00
V2 burst_write kmac_burst_write 28.026m 14.009ms 48 50 96.00
V2 test_vectors kmac_test_vectors_sha3_224 49.461m 1.703s 50 50 100.00
kmac_test_vectors_sha3_256 43.513m 653.561ms 50 50 100.00
kmac_test_vectors_sha3_384 32.008m 74.411ms 49 50 98.00
kmac_test_vectors_sha3_512 25.862m 304.921ms 48 50 96.00
kmac_test_vectors_shake_128 1.831h 2.182s 50 50 100.00
kmac_test_vectors_shake_256 1.692h 2.212s 49 50 98.00
kmac_test_vectors_kmac 8.220s 4.484ms 50 50 100.00
kmac_test_vectors_kmac_xof 7.370s 269.234us 50 50 100.00
V2 sideload kmac_sideload 9.373m 47.040ms 50 50 100.00
V2 app kmac_app 6.603m 11.142ms 48 50 96.00
V2 app_with_partial_data kmac_app_with_partial_data 6.658m 31.845ms 10 10 100.00
V2 entropy_refresh kmac_entropy_refresh 7.535m 38.342ms 50 50 100.00
V2 error kmac_error 8.268m 5.506ms 49 50 98.00
V2 key_error kmac_key_error 15.480s 2.056ms 50 50 100.00
V2 edn_timeout_error kmac_edn_timeout_error 52.450s 8.607ms 20 20 100.00
V2 entropy_mode_error kmac_entropy_mode_error 33.040s 1.946ms 20 20 100.00
V2 entropy_ready_error kmac_entropy_ready_error 1.359m 28.099ms 10 10 100.00
V2 lc_escalation kmac_lc_escalation 47.540s 3.936ms 50 50 100.00
V2 stress_all kmac_stress_all 53.137m 1.735s 46 50 92.00
V2 intr_test kmac_intr_test 0.900s 16.605us 50 50 100.00
V2 alert_test kmac_alert_test 0.900s 73.143us 50 50 100.00
V2 tl_d_oob_addr_access kmac_tl_errors 3.290s 164.980us 20 20 100.00
V2 tl_d_illegal_access kmac_tl_errors 3.290s 164.980us 20 20 100.00
V2 tl_d_outstanding_access kmac_csr_hw_reset 1.160s 60.780us 5 5 100.00
kmac_csr_rw 1.230s 105.207us 20 20 100.00
kmac_csr_aliasing 9.760s 508.639us 5 5 100.00
kmac_same_csr_outstanding 2.750s 230.069us 20 20 100.00
V2 tl_d_partial_access kmac_csr_hw_reset 1.160s 60.780us 5 5 100.00
kmac_csr_rw 1.230s 105.207us 20 20 100.00
kmac_csr_aliasing 9.760s 508.639us 5 5 100.00
kmac_same_csr_outstanding 2.750s 230.069us 20 20 100.00
V2 TOTAL 1037 1050 98.76
V2S shadow_reg_update_error kmac_shadow_reg_errors 1.390s 44.552us 17 20 85.00
V2S shadow_reg_read_clear_staged_value kmac_shadow_reg_errors 1.390s 44.552us 17 20 85.00
V2S shadow_reg_storage_error kmac_shadow_reg_errors 1.390s 44.552us 17 20 85.00
V2S shadowed_reset_glitch kmac_shadow_reg_errors 1.390s 44.552us 17 20 85.00
V2S shadow_reg_update_error_with_csr_rw kmac_shadow_reg_errors_with_csr_rw 3.060s 236.766us 18 20 90.00
V2S tl_intg_err kmac_sec_cm 2.221m 77.280ms 5 5 100.00
kmac_tl_intg_err 5.000s 775.557us 20 20 100.00
V2S sec_cm_bus_integrity kmac_tl_intg_err 5.000s 775.557us 20 20 100.00
V2S sec_cm_lc_escalate_en_intersig_mubi kmac_lc_escalation 47.540s 3.936ms 50 50 100.00
V2S sec_cm_sw_key_key_masking kmac_smoke 1.535m 18.664ms 50 50 100.00
V2S sec_cm_key_sideload kmac_sideload 9.373m 47.040ms 50 50 100.00
V2S sec_cm_cfg_shadowed_config_shadow kmac_shadow_reg_errors 1.390s 44.552us 17 20 85.00
V2S sec_cm_fsm_sparse kmac_sec_cm 2.221m 77.280ms 5 5 100.00
V2S sec_cm_ctr_redun kmac_sec_cm 2.221m 77.280ms 5 5 100.00
V2S sec_cm_packer_ctr_redun kmac_sec_cm 2.221m 77.280ms 5 5 100.00
V2S sec_cm_cfg_shadowed_config_regwen kmac_smoke 1.535m 18.664ms 50 50 100.00
V2S sec_cm_fsm_global_esc kmac_lc_escalation 47.540s 3.936ms 50 50 100.00
V2S sec_cm_fsm_local_esc kmac_sec_cm 2.221m 77.280ms 5 5 100.00
V2S sec_cm_absorbed_ctrl_mubi kmac_mubi 5.935m 46.426ms 10 10 100.00
V2S sec_cm_sw_cmd_ctrl_sparse kmac_smoke 1.535m 18.664ms 50 50 100.00
V2S TOTAL 70 75 93.33
V3 throughput kmac_throughput 0 0 --
V3 stress_all_with_rand_reset kmac_stress_all_with_rand_reset 57.544m 69.951ms 10 50 20.00
V3 TOTAL 10 50 20.00
TOTAL 1232 1290 95.50

Testplan Progress

Items Total Written Passing Progress
V1 8 8 8 100.00
V2 25 25 18 72.00
V2S 5 5 3 60.00
V3 2 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
94.30 97.89 92.58 99.89 77.46 95.53 98.88 97.88

Failure Buckets

Past Results