KMAC/MASKED Simulation Results

Thursday May 23 2024 19:02:32 UTC

GitHub Revision: 1579f6a912

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 107680075914347604077716278187232582575581754843183664337576824686885697334979

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke kmac_smoke 1.448m 18.844ms 49 50 98.00
V1 csr_hw_reset kmac_csr_hw_reset 1.160s 38.526us 5 5 100.00
V1 csr_rw kmac_csr_rw 1.350s 260.982us 20 20 100.00
V1 csr_bit_bash kmac_csr_bit_bash 10.830s 753.742us 5 5 100.00
V1 csr_aliasing kmac_csr_aliasing 9.300s 1.506ms 5 5 100.00
V1 csr_mem_rw_with_rand_reset kmac_csr_mem_rw_with_rand_reset 2.510s 43.814us 20 20 100.00
V1 regwen_csr_and_corresponding_lockable_csr kmac_csr_rw 1.350s 260.982us 20 20 100.00
kmac_csr_aliasing 9.300s 1.506ms 5 5 100.00
V1 mem_walk kmac_mem_walk 0.840s 12.829us 5 5 100.00
V1 mem_partial_access kmac_mem_partial_access 1.510s 40.847us 5 5 100.00
V1 TOTAL 114 115 99.13
V2 long_msg_and_output kmac_long_msg_and_output 56.943m 305.445ms 50 50 100.00
V2 burst_write kmac_burst_write 22.955m 85.663ms 47 50 94.00
V2 test_vectors kmac_test_vectors_sha3_224 42.090m 924.378ms 50 50 100.00
kmac_test_vectors_sha3_256 40.015m 234.758ms 48 50 96.00
kmac_test_vectors_sha3_384 33.822m 296.952ms 50 50 100.00
kmac_test_vectors_sha3_512 24.875m 206.926ms 50 50 100.00
kmac_test_vectors_shake_128 1.762h 530.391ms 50 50 100.00
kmac_test_vectors_shake_256 1.613h 2.488s 49 50 98.00
kmac_test_vectors_kmac 8.050s 2.685ms 50 50 100.00
kmac_test_vectors_kmac_xof 7.150s 794.518us 50 50 100.00
V2 sideload kmac_sideload 9.396m 24.067ms 50 50 100.00
V2 app kmac_app 7.289m 34.612ms 50 50 100.00
V2 app_with_partial_data kmac_app_with_partial_data 5.589m 12.328ms 10 10 100.00
V2 entropy_refresh kmac_entropy_refresh 5.918m 87.330ms 50 50 100.00
V2 error kmac_error 8.514m 58.521ms 47 50 94.00
V2 key_error kmac_key_error 16.210s 7.632ms 50 50 100.00
V2 edn_timeout_error kmac_edn_timeout_error 46.620s 18.484ms 20 20 100.00
V2 entropy_mode_error kmac_entropy_mode_error 1.103m 43.236ms 20 20 100.00
V2 entropy_ready_error kmac_entropy_ready_error 1.102m 24.336ms 10 10 100.00
V2 lc_escalation kmac_lc_escalation 42.370s 3.651ms 50 50 100.00
V2 stress_all kmac_stress_all 55.259m 200.127ms 46 50 92.00
V2 intr_test kmac_intr_test 0.880s 134.071us 50 50 100.00
V2 alert_test kmac_alert_test 0.940s 22.122us 50 50 100.00
V2 tl_d_oob_addr_access kmac_tl_errors 3.630s 227.790us 20 20 100.00
V2 tl_d_illegal_access kmac_tl_errors 3.630s 227.790us 20 20 100.00
V2 tl_d_outstanding_access kmac_csr_hw_reset 1.160s 38.526us 5 5 100.00
kmac_csr_rw 1.350s 260.982us 20 20 100.00
kmac_csr_aliasing 9.300s 1.506ms 5 5 100.00
kmac_same_csr_outstanding 2.780s 119.626us 20 20 100.00
V2 tl_d_partial_access kmac_csr_hw_reset 1.160s 38.526us 5 5 100.00
kmac_csr_rw 1.350s 260.982us 20 20 100.00
kmac_csr_aliasing 9.300s 1.506ms 5 5 100.00
kmac_same_csr_outstanding 2.780s 119.626us 20 20 100.00
V2 TOTAL 1037 1050 98.76
V2S shadow_reg_update_error kmac_shadow_reg_errors 1.520s 118.895us 17 20 85.00
V2S shadow_reg_read_clear_staged_value kmac_shadow_reg_errors 1.520s 118.895us 17 20 85.00
V2S shadow_reg_storage_error kmac_shadow_reg_errors 1.520s 118.895us 17 20 85.00
V2S shadowed_reset_glitch kmac_shadow_reg_errors 1.520s 118.895us 17 20 85.00
V2S shadow_reg_update_error_with_csr_rw kmac_shadow_reg_errors_with_csr_rw 3.000s 831.854us 17 20 85.00
V2S tl_intg_err kmac_sec_cm 1.806m 7.652ms 5 5 100.00
kmac_tl_intg_err 5.070s 467.232us 20 20 100.00
V2S sec_cm_bus_integrity kmac_tl_intg_err 5.070s 467.232us 20 20 100.00
V2S sec_cm_lc_escalate_en_intersig_mubi kmac_lc_escalation 42.370s 3.651ms 50 50 100.00
V2S sec_cm_sw_key_key_masking kmac_smoke 1.448m 18.844ms 49 50 98.00
V2S sec_cm_key_sideload kmac_sideload 9.396m 24.067ms 50 50 100.00
V2S sec_cm_cfg_shadowed_config_shadow kmac_shadow_reg_errors 1.520s 118.895us 17 20 85.00
V2S sec_cm_fsm_sparse kmac_sec_cm 1.806m 7.652ms 5 5 100.00
V2S sec_cm_ctr_redun kmac_sec_cm 1.806m 7.652ms 5 5 100.00
V2S sec_cm_packer_ctr_redun kmac_sec_cm 1.806m 7.652ms 5 5 100.00
V2S sec_cm_cfg_shadowed_config_regwen kmac_smoke 1.448m 18.844ms 49 50 98.00
V2S sec_cm_fsm_global_esc kmac_lc_escalation 42.370s 3.651ms 50 50 100.00
V2S sec_cm_fsm_local_esc kmac_sec_cm 1.806m 7.652ms 5 5 100.00
V2S sec_cm_absorbed_ctrl_mubi kmac_mubi 5.649m 99.711ms 10 10 100.00
V2S sec_cm_sw_cmd_ctrl_sparse kmac_smoke 1.448m 18.844ms 49 50 98.00
V2S TOTAL 69 75 92.00
V3 throughput kmac_throughput 0 0 --
V3 stress_all_with_rand_reset kmac_stress_all_with_rand_reset 54.129m 108.951ms 12 50 24.00
V3 TOTAL 12 50 24.00
TOTAL 1232 1290 95.50

Testplan Progress

Items Total Written Passing Progress
V1 8 8 7 87.50
V2 25 25 20 80.00
V2S 5 5 3 60.00
V3 2 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
94.20 97.89 92.58 99.89 76.76 95.53 98.88 97.88

Failure Buckets

Past Results