KMAC/MASKED Simulation Results

Sunday March 03 2024 20:02:47 UTC

GitHub Revision: 0cdf265eaa

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 82530437672810453765703374940713112405319051694331588453064008042331386550559

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke kmac_smoke 1.660m 10.947ms 49 50 98.00
V1 csr_hw_reset kmac_csr_hw_reset 1.250s 379.823us 5 5 100.00
V1 csr_rw kmac_csr_rw 1.240s 29.230us 20 20 100.00
V1 csr_bit_bash kmac_csr_bit_bash 22.830s 8.925ms 5 5 100.00
V1 csr_aliasing kmac_csr_aliasing 7.540s 171.726us 5 5 100.00
V1 csr_mem_rw_with_rand_reset kmac_csr_mem_rw_with_rand_reset 2.720s 43.177us 20 20 100.00
V1 regwen_csr_and_corresponding_lockable_csr kmac_csr_rw 1.240s 29.230us 20 20 100.00
kmac_csr_aliasing 7.540s 171.726us 5 5 100.00
V1 mem_walk kmac_mem_walk 0.780s 10.515us 5 5 100.00
V1 mem_partial_access kmac_mem_partial_access 1.540s 181.372us 5 5 100.00
V1 TOTAL 114 115 99.13
V2 long_msg_and_output kmac_long_msg_and_output 58.329m 509.987ms 49 50 98.00
V2 burst_write kmac_burst_write 26.257m 15.461ms 48 50 96.00
V2 test_vectors kmac_test_vectors_sha3_224 41.183m 103.821ms 48 50 96.00
kmac_test_vectors_sha3_256 40.824m 460.329ms 49 50 98.00
kmac_test_vectors_sha3_384 32.400m 77.491ms 48 50 96.00
kmac_test_vectors_sha3_512 24.324m 352.905ms 48 50 96.00
kmac_test_vectors_shake_128 1.928h 2.970s 48 50 96.00
kmac_test_vectors_shake_256 1.591h 1.427s 48 50 96.00
kmac_test_vectors_kmac 7.300s 4.054ms 49 50 98.00
kmac_test_vectors_kmac_xof 8.280s 2.039ms 48 50 96.00
V2 sideload kmac_sideload 8.605m 24.270ms 50 50 100.00
V2 app kmac_app 6.372m 27.912ms 47 50 94.00
V2 app_with_partial_data kmac_app_with_partial_data 7.581m 62.092ms 10 10 100.00
V2 entropy_refresh kmac_entropy_refresh 7.670m 39.844ms 48 50 96.00
V2 error kmac_error 8.675m 82.861ms 48 50 96.00
V2 key_error kmac_key_error 8.780s 2.967ms 50 50 100.00
V2 edn_timeout_error kmac_edn_timeout_error 50.850s 1.699ms 20 20 100.00
V2 entropy_mode_error kmac_entropy_mode_error 37.590s 7.309ms 20 20 100.00
V2 entropy_ready_error kmac_entropy_ready_error 1.060m 6.114ms 10 10 100.00
V2 lc_escalation kmac_lc_escalation 51.260s 1.412ms 50 50 100.00
V2 stress_all kmac_stress_all 44.396m 36.614ms 43 50 86.00
V2 intr_test kmac_intr_test 0.860s 15.489us 50 50 100.00
V2 alert_test kmac_alert_test 0.910s 256.184us 50 50 100.00
V2 tl_d_oob_addr_access kmac_tl_errors 3.190s 254.784us 20 20 100.00
V2 tl_d_illegal_access kmac_tl_errors 3.190s 254.784us 20 20 100.00
V2 tl_d_outstanding_access kmac_csr_hw_reset 1.250s 379.823us 5 5 100.00
kmac_csr_rw 1.240s 29.230us 20 20 100.00
kmac_csr_aliasing 7.540s 171.726us 5 5 100.00
kmac_same_csr_outstanding 2.830s 383.072us 20 20 100.00
V2 tl_d_partial_access kmac_csr_hw_reset 1.250s 379.823us 5 5 100.00
kmac_csr_rw 1.240s 29.230us 20 20 100.00
kmac_csr_aliasing 7.540s 171.726us 5 5 100.00
kmac_same_csr_outstanding 2.830s 383.072us 20 20 100.00
V2 TOTAL 1019 1050 97.05
V2S shadow_reg_update_error kmac_shadow_reg_errors 1.460s 605.264us 20 20 100.00
V2S shadow_reg_read_clear_staged_value kmac_shadow_reg_errors 1.460s 605.264us 20 20 100.00
V2S shadow_reg_storage_error kmac_shadow_reg_errors 1.460s 605.264us 20 20 100.00
V2S shadowed_reset_glitch kmac_shadow_reg_errors 1.460s 605.264us 20 20 100.00
V2S shadow_reg_update_error_with_csr_rw kmac_shadow_reg_errors_with_csr_rw 3.390s 130.283us 20 20 100.00
V2S tl_intg_err kmac_sec_cm 2.199m 18.122ms 5 5 100.00
kmac_tl_intg_err 5.680s 315.382us 20 20 100.00
V2S sec_cm_bus_integrity kmac_tl_intg_err 5.680s 315.382us 20 20 100.00
V2S sec_cm_lc_escalate_en_intersig_mubi kmac_lc_escalation 51.260s 1.412ms 50 50 100.00
V2S sec_cm_sw_key_key_masking kmac_smoke 1.660m 10.947ms 49 50 98.00
V2S sec_cm_key_sideload kmac_sideload 8.605m 24.270ms 50 50 100.00
V2S sec_cm_cfg_shadowed_config_shadow kmac_shadow_reg_errors 1.460s 605.264us 20 20 100.00
V2S sec_cm_fsm_sparse kmac_sec_cm 2.199m 18.122ms 5 5 100.00
V2S sec_cm_ctr_redun kmac_sec_cm 2.199m 18.122ms 5 5 100.00
V2S sec_cm_packer_ctr_redun kmac_sec_cm 2.199m 18.122ms 5 5 100.00
V2S sec_cm_cfg_shadowed_config_regwen kmac_smoke 1.660m 10.947ms 49 50 98.00
V2S sec_cm_fsm_global_esc kmac_lc_escalation 51.260s 1.412ms 50 50 100.00
V2S sec_cm_fsm_local_esc kmac_sec_cm 2.199m 18.122ms 5 5 100.00
V2S sec_cm_absorbed_ctrl_mubi kmac_mubi 8.071m 14.643ms 10 10 100.00
V2S sec_cm_sw_cmd_ctrl_sparse kmac_smoke 1.660m 10.947ms 49 50 98.00
V2S TOTAL 75 75 100.00
V3 throughput kmac_throughput 0 0 --
V3 stress_all_with_rand_reset kmac_stress_all_with_rand_reset 1.056h 157.869ms 10 50 20.00
V3 TOTAL 10 50 20.00
TOTAL 1218 1290 94.42

Testplan Progress

Items Total Written Passing Progress
V1 8 8 7 87.50
V2 25 25 11 44.00
V2S 5 5 5 100.00
V3 2 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
97.10 98.10 92.66 99.89 96.36 95.91 98.89 97.89

Failure Buckets

Past Results