KMAC/MASKED Simulation Results

Wednesday January 03 2024 20:02:50 UTC

GitHub Revision: 748235cbb6

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 25438953283828179064589190240910206115356752103516363191807863392753441298838

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke kmac_smoke 1.561m 8.305ms 50 50 100.00
V1 csr_hw_reset kmac_csr_hw_reset 1.140s 57.710us 5 5 100.00
V1 csr_rw kmac_csr_rw 1.250s 35.345us 20 20 100.00
V1 csr_bit_bash kmac_csr_bit_bash 21.530s 3.981ms 5 5 100.00
V1 csr_aliasing kmac_csr_aliasing 10.750s 684.234us 5 5 100.00
V1 csr_mem_rw_with_rand_reset kmac_csr_mem_rw_with_rand_reset 2.100s 55.778us 19 20 95.00
V1 regwen_csr_and_corresponding_lockable_csr kmac_csr_rw 1.250s 35.345us 20 20 100.00
kmac_csr_aliasing 10.750s 684.234us 5 5 100.00
V1 mem_walk kmac_mem_walk 0.770s 31.211us 5 5 100.00
V1 mem_partial_access kmac_mem_partial_access 1.460s 75.953us 5 5 100.00
V1 TOTAL 114 115 99.13
V2 long_msg_and_output kmac_long_msg_and_output 56.675m 1.099s 50 50 100.00
V2 burst_write kmac_burst_write 29.798m 187.883ms 49 50 98.00
V2 test_vectors kmac_test_vectors_sha3_224 46.080m 1.350s 50 50 100.00
kmac_test_vectors_sha3_256 41.976m 887.183ms 50 50 100.00
kmac_test_vectors_sha3_384 35.081m 1.169s 50 50 100.00
kmac_test_vectors_sha3_512 24.451m 61.589ms 50 50 100.00
kmac_test_vectors_shake_128 1.969h 5.000s 49 50 98.00
kmac_test_vectors_shake_256 1.516h 2.140s 49 50 98.00
kmac_test_vectors_kmac 8.980s 902.686us 49 50 98.00
kmac_test_vectors_kmac_xof 7.220s 3.185ms 49 50 98.00
V2 sideload kmac_sideload 8.787m 123.947ms 50 50 100.00
V2 app kmac_app 7.085m 36.234ms 50 50 100.00
V2 app_with_partial_data kmac_app_with_partial_data 6.719m 18.891ms 10 10 100.00
V2 entropy_refresh kmac_entropy_refresh 6.896m 16.148ms 49 50 98.00
V2 error kmac_error 8.573m 76.129ms 50 50 100.00
V2 key_error kmac_key_error 10.940s 10.569ms 50 50 100.00
V2 edn_timeout_error kmac_edn_timeout_error 56.080s 2.601ms 20 20 100.00
V2 entropy_mode_error kmac_entropy_mode_error 48.670s 4.483ms 20 20 100.00
V2 entropy_ready_error kmac_entropy_ready_error 1.366m 8.094ms 10 10 100.00
V2 lc_escalation kmac_lc_escalation 38.930s 1.697ms 50 50 100.00
V2 stress_all kmac_stress_all 1.037h 540.645ms 49 50 98.00
V2 intr_test kmac_intr_test 0.840s 19.721us 44 50 88.00
V2 alert_test kmac_alert_test 0.990s 198.676us 50 50 100.00
V2 tl_d_oob_addr_access kmac_tl_errors 3.580s 503.411us 20 20 100.00
V2 tl_d_illegal_access kmac_tl_errors 3.580s 503.411us 20 20 100.00
V2 tl_d_outstanding_access kmac_csr_hw_reset 1.140s 57.710us 5 5 100.00
kmac_csr_rw 1.250s 35.345us 20 20 100.00
kmac_csr_aliasing 10.750s 684.234us 5 5 100.00
kmac_same_csr_outstanding 2.790s 487.937us 19 20 95.00
V2 tl_d_partial_access kmac_csr_hw_reset 1.140s 57.710us 5 5 100.00
kmac_csr_rw 1.250s 35.345us 20 20 100.00
kmac_csr_aliasing 10.750s 684.234us 5 5 100.00
kmac_same_csr_outstanding 2.790s 487.937us 19 20 95.00
V2 TOTAL 1036 1050 98.67
V2S shadow_reg_update_error kmac_shadow_reg_errors 1.490s 139.073us 20 20 100.00
V2S shadow_reg_read_clear_staged_value kmac_shadow_reg_errors 1.490s 139.073us 20 20 100.00
V2S shadow_reg_storage_error kmac_shadow_reg_errors 1.490s 139.073us 20 20 100.00
V2S shadowed_reset_glitch kmac_shadow_reg_errors 1.490s 139.073us 20 20 100.00
V2S shadow_reg_update_error_with_csr_rw kmac_shadow_reg_errors_with_csr_rw 3.120s 475.166us 19 20 95.00
V2S tl_intg_err kmac_sec_cm 1.978m 29.583ms 5 5 100.00
kmac_tl_intg_err 5.740s 279.554us 19 20 95.00
V2S sec_cm_bus_integrity kmac_tl_intg_err 5.740s 279.554us 19 20 95.00
V2S sec_cm_lc_escalate_en_intersig_mubi kmac_lc_escalation 38.930s 1.697ms 50 50 100.00
V2S sec_cm_sw_key_key_masking kmac_smoke 1.561m 8.305ms 50 50 100.00
V2S sec_cm_key_sideload kmac_sideload 8.787m 123.947ms 50 50 100.00
V2S sec_cm_cfg_shadowed_config_shadow kmac_shadow_reg_errors 1.490s 139.073us 20 20 100.00
V2S sec_cm_fsm_sparse kmac_sec_cm 1.978m 29.583ms 5 5 100.00
V2S sec_cm_ctr_redun kmac_sec_cm 1.978m 29.583ms 5 5 100.00
V2S sec_cm_packer_ctr_redun kmac_sec_cm 1.978m 29.583ms 5 5 100.00
V2S sec_cm_cfg_shadowed_config_regwen kmac_smoke 1.561m 8.305ms 50 50 100.00
V2S sec_cm_fsm_global_esc kmac_lc_escalation 38.930s 1.697ms 50 50 100.00
V2S sec_cm_fsm_local_esc kmac_sec_cm 1.978m 29.583ms 5 5 100.00
V2S sec_cm_absorbed_ctrl_mubi kmac_mubi 5.369m 143.793ms 10 10 100.00
V2S sec_cm_sw_cmd_ctrl_sparse kmac_smoke 1.561m 8.305ms 50 50 100.00
V2S TOTAL 73 75 97.33
V3 throughput kmac_throughput 0 0 --
V3 stress_all_with_rand_reset kmac_stress_all_with_rand_reset 1.007h 224.360ms 35 50 70.00
V3 TOTAL 35 50 70.00
TOTAL 1258 1290 97.52

Testplan Progress

Items Total Written Passing Progress
V1 8 8 7 87.50
V2 25 25 16 64.00
V2S 5 5 3 60.00
V3 2 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
96.77 98.38 93.15 99.93 92.73 96.04 98.89 98.31

Failure Buckets

Past Results