KMAC/MASKED Simulation Results

Tuesday May 28 2024 19:30:06 UTC

GitHub Revision: 0e5093d709

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 51604449886868634540233838791789448907774502353938218657919214072353062987195

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke kmac_smoke 1.603m 34.352ms 49 50 98.00
V1 csr_hw_reset kmac_csr_hw_reset 1.160s 119.028us 5 5 100.00
V1 csr_rw kmac_csr_rw 1.280s 50.210us 20 20 100.00
V1 csr_bit_bash kmac_csr_bit_bash 21.770s 1.511ms 5 5 100.00
V1 csr_aliasing kmac_csr_aliasing 8.720s 2.602ms 5 5 100.00
V1 csr_mem_rw_with_rand_reset kmac_csr_mem_rw_with_rand_reset 2.650s 722.802us 20 20 100.00
V1 regwen_csr_and_corresponding_lockable_csr kmac_csr_rw 1.280s 50.210us 20 20 100.00
kmac_csr_aliasing 8.720s 2.602ms 5 5 100.00
V1 mem_walk kmac_mem_walk 0.770s 21.769us 5 5 100.00
V1 mem_partial_access kmac_mem_partial_access 1.470s 36.573us 5 5 100.00
V1 TOTAL 114 115 99.13
V2 long_msg_and_output kmac_long_msg_and_output 57.052m 353.541ms 49 50 98.00
V2 burst_write kmac_burst_write 24.513m 25.245ms 47 50 94.00
V2 test_vectors kmac_test_vectors_sha3_224 49.513m 1.911s 50 50 100.00
kmac_test_vectors_sha3_256 41.950m 894.362ms 49 50 98.00
kmac_test_vectors_sha3_384 33.655m 698.769ms 49 50 98.00
kmac_test_vectors_sha3_512 24.043m 675.627ms 50 50 100.00
kmac_test_vectors_shake_128 1.864h 925.734ms 49 50 98.00
kmac_test_vectors_shake_256 1.653h 919.130ms 49 50 98.00
kmac_test_vectors_kmac 7.500s 935.816us 49 50 98.00
kmac_test_vectors_kmac_xof 7.670s 827.027us 49 50 98.00
V2 sideload kmac_sideload 9.676m 124.537ms 50 50 100.00
V2 app kmac_app 7.096m 77.523ms 49 50 98.00
V2 app_with_partial_data kmac_app_with_partial_data 5.599m 21.779ms 10 10 100.00
V2 entropy_refresh kmac_entropy_refresh 7.052m 42.392ms 47 50 94.00
V2 error kmac_error 8.460m 58.166ms 48 50 96.00
V2 key_error kmac_key_error 19.340s 28.985ms 50 50 100.00
V2 edn_timeout_error kmac_edn_timeout_error 49.210s 7.506ms 20 20 100.00
V2 entropy_mode_error kmac_entropy_mode_error 45.900s 8.556ms 20 20 100.00
V2 entropy_ready_error kmac_entropy_ready_error 1.199m 24.475ms 10 10 100.00
V2 lc_escalation kmac_lc_escalation 56.820s 3.051ms 50 50 100.00
V2 stress_all kmac_stress_all 50.078m 171.094ms 44 50 88.00
V2 intr_test kmac_intr_test 0.890s 38.530us 50 50 100.00
V2 alert_test kmac_alert_test 0.920s 65.888us 50 50 100.00
V2 tl_d_oob_addr_access kmac_tl_errors 3.370s 403.910us 20 20 100.00
V2 tl_d_illegal_access kmac_tl_errors 3.370s 403.910us 20 20 100.00
V2 tl_d_outstanding_access kmac_csr_hw_reset 1.160s 119.028us 5 5 100.00
kmac_csr_rw 1.280s 50.210us 20 20 100.00
kmac_csr_aliasing 8.720s 2.602ms 5 5 100.00
kmac_same_csr_outstanding 2.790s 132.116us 20 20 100.00
V2 tl_d_partial_access kmac_csr_hw_reset 1.160s 119.028us 5 5 100.00
kmac_csr_rw 1.280s 50.210us 20 20 100.00
kmac_csr_aliasing 8.720s 2.602ms 5 5 100.00
kmac_same_csr_outstanding 2.790s 132.116us 20 20 100.00
V2 TOTAL 1028 1050 97.90
V2S shadow_reg_update_error kmac_shadow_reg_errors 1.330s 66.981us 17 20 85.00
V2S shadow_reg_read_clear_staged_value kmac_shadow_reg_errors 1.330s 66.981us 17 20 85.00
V2S shadow_reg_storage_error kmac_shadow_reg_errors 1.330s 66.981us 17 20 85.00
V2S shadowed_reset_glitch kmac_shadow_reg_errors 1.330s 66.981us 17 20 85.00
V2S shadow_reg_update_error_with_csr_rw kmac_shadow_reg_errors_with_csr_rw 3.090s 135.725us 16 20 80.00
V2S tl_intg_err kmac_sec_cm 1.743m 6.931ms 5 5 100.00
kmac_tl_intg_err 5.170s 272.168us 20 20 100.00
V2S sec_cm_bus_integrity kmac_tl_intg_err 5.170s 272.168us 20 20 100.00
V2S sec_cm_lc_escalate_en_intersig_mubi kmac_lc_escalation 56.820s 3.051ms 50 50 100.00
V2S sec_cm_sw_key_key_masking kmac_smoke 1.603m 34.352ms 49 50 98.00
V2S sec_cm_key_sideload kmac_sideload 9.676m 124.537ms 50 50 100.00
V2S sec_cm_cfg_shadowed_config_shadow kmac_shadow_reg_errors 1.330s 66.981us 17 20 85.00
V2S sec_cm_fsm_sparse kmac_sec_cm 1.743m 6.931ms 5 5 100.00
V2S sec_cm_ctr_redun kmac_sec_cm 1.743m 6.931ms 5 5 100.00
V2S sec_cm_packer_ctr_redun kmac_sec_cm 1.743m 6.931ms 5 5 100.00
V2S sec_cm_cfg_shadowed_config_regwen kmac_smoke 1.603m 34.352ms 49 50 98.00
V2S sec_cm_fsm_global_esc kmac_lc_escalation 56.820s 3.051ms 50 50 100.00
V2S sec_cm_fsm_local_esc kmac_sec_cm 1.743m 6.931ms 5 5 100.00
V2S sec_cm_absorbed_ctrl_mubi kmac_mubi 6.522m 182.791ms 10 10 100.00
V2S sec_cm_sw_cmd_ctrl_sparse kmac_smoke 1.603m 34.352ms 49 50 98.00
V2S TOTAL 68 75 90.67
V3 throughput kmac_throughput 0 0 --
V3 stress_all_with_rand_reset kmac_stress_all_with_rand_reset 40.820m 32.326ms 13 50 26.00
V3 TOTAL 13 50 26.00
TOTAL 1223 1290 94.81

Testplan Progress

Items Total Written Passing Progress
V1 8 8 7 87.50
V2 25 25 13 52.00
V2S 5 5 3 60.00
V3 2 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
94.34 97.91 92.62 99.89 77.46 95.59 99.05 97.88

Failure Buckets

Past Results