KMAC/MASKED Simulation Results

Sunday June 30 2024 23:02:20 UTC

GitHub Revision: b33f0bcb4a

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 105302396297609026156504164956156290718642058150905320202190590799028860124396

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke kmac_smoke 1.784m 19.336ms 49 50 98.00
V1 csr_hw_reset kmac_csr_hw_reset 1.120s 33.553us 5 5 100.00
V1 csr_rw kmac_csr_rw 1.210s 95.567us 20 20 100.00
V1 csr_bit_bash kmac_csr_bit_bash 22.660s 6.017ms 5 5 100.00
V1 csr_aliasing kmac_csr_aliasing 11.550s 5.352ms 5 5 100.00
V1 csr_mem_rw_with_rand_reset kmac_csr_mem_rw_with_rand_reset 2.750s 347.992us 20 20 100.00
V1 regwen_csr_and_corresponding_lockable_csr kmac_csr_rw 1.210s 95.567us 20 20 100.00
kmac_csr_aliasing 11.550s 5.352ms 5 5 100.00
V1 mem_walk kmac_mem_walk 0.780s 89.697us 5 5 100.00
V1 mem_partial_access kmac_mem_partial_access 1.490s 65.812us 5 5 100.00
V1 TOTAL 114 115 99.13
V2 long_msg_and_output kmac_long_msg_and_output 59.494m 1.053s 48 50 96.00
V2 burst_write kmac_burst_write 25.944m 32.104ms 47 50 94.00
V2 test_vectors kmac_test_vectors_sha3_224 47.670m 1.333s 50 50 100.00
kmac_test_vectors_sha3_256 40.867m 730.519ms 50 50 100.00
kmac_test_vectors_sha3_384 33.561m 391.857ms 48 50 96.00
kmac_test_vectors_sha3_512 27.058m 705.534ms 48 50 96.00
kmac_test_vectors_shake_128 1.873h 1.721s 50 50 100.00
kmac_test_vectors_shake_256 1.693h 1.474s 49 50 98.00
kmac_test_vectors_kmac 7.530s 279.972us 50 50 100.00
kmac_test_vectors_kmac_xof 7.250s 705.917us 50 50 100.00
V2 sideload kmac_sideload 8.616m 60.460ms 50 50 100.00
V2 app kmac_app 7.728m 90.422ms 49 50 98.00
V2 app_with_partial_data kmac_app_with_partial_data 6.323m 37.980ms 10 10 100.00
V2 entropy_refresh kmac_entropy_refresh 8.024m 185.468ms 48 50 96.00
V2 error kmac_error 9.106m 22.174ms 48 50 96.00
V2 key_error kmac_key_error 14.090s 16.987ms 50 50 100.00
V2 edn_timeout_error kmac_edn_timeout_error 45.230s 36.488ms 20 20 100.00
V2 entropy_mode_error kmac_entropy_mode_error 34.410s 2.865ms 20 20 100.00
V2 entropy_ready_error kmac_entropy_ready_error 1.044m 6.131ms 10 10 100.00
V2 lc_escalation kmac_lc_escalation 43.190s 613.439us 50 50 100.00
V2 stress_all kmac_stress_all 53.788m 32.875ms 48 50 96.00
V2 intr_test kmac_intr_test 0.880s 14.964us 50 50 100.00
V2 alert_test kmac_alert_test 0.930s 210.074us 50 50 100.00
V2 tl_d_oob_addr_access kmac_tl_errors 3.150s 122.166us 20 20 100.00
V2 tl_d_illegal_access kmac_tl_errors 3.150s 122.166us 20 20 100.00
V2 tl_d_outstanding_access kmac_csr_hw_reset 1.120s 33.553us 5 5 100.00
kmac_csr_rw 1.210s 95.567us 20 20 100.00
kmac_csr_aliasing 11.550s 5.352ms 5 5 100.00
kmac_same_csr_outstanding 2.880s 562.652us 20 20 100.00
V2 tl_d_partial_access kmac_csr_hw_reset 1.120s 33.553us 5 5 100.00
kmac_csr_rw 1.210s 95.567us 20 20 100.00
kmac_csr_aliasing 11.550s 5.352ms 5 5 100.00
kmac_same_csr_outstanding 2.880s 562.652us 20 20 100.00
V2 TOTAL 1033 1050 98.38
V2S shadow_reg_update_error kmac_shadow_reg_errors 1.630s 55.677us 18 20 90.00
V2S shadow_reg_read_clear_staged_value kmac_shadow_reg_errors 1.630s 55.677us 18 20 90.00
V2S shadow_reg_storage_error kmac_shadow_reg_errors 1.630s 55.677us 18 20 90.00
V2S shadowed_reset_glitch kmac_shadow_reg_errors 1.630s 55.677us 18 20 90.00
V2S shadow_reg_update_error_with_csr_rw kmac_shadow_reg_errors_with_csr_rw 3.660s 2.361ms 18 20 90.00
V2S tl_intg_err kmac_sec_cm 2.086m 33.025ms 5 5 100.00
kmac_tl_intg_err 5.320s 970.448us 20 20 100.00
V2S sec_cm_bus_integrity kmac_tl_intg_err 5.320s 970.448us 20 20 100.00
V2S sec_cm_lc_escalate_en_intersig_mubi kmac_lc_escalation 43.190s 613.439us 50 50 100.00
V2S sec_cm_sw_key_key_masking kmac_smoke 1.784m 19.336ms 49 50 98.00
V2S sec_cm_key_sideload kmac_sideload 8.616m 60.460ms 50 50 100.00
V2S sec_cm_cfg_shadowed_config_shadow kmac_shadow_reg_errors 1.630s 55.677us 18 20 90.00
V2S sec_cm_fsm_sparse kmac_sec_cm 2.086m 33.025ms 5 5 100.00
V2S sec_cm_ctr_redun kmac_sec_cm 2.086m 33.025ms 5 5 100.00
V2S sec_cm_packer_ctr_redun kmac_sec_cm 2.086m 33.025ms 5 5 100.00
V2S sec_cm_cfg_shadowed_config_regwen kmac_smoke 1.784m 19.336ms 49 50 98.00
V2S sec_cm_fsm_global_esc kmac_lc_escalation 43.190s 613.439us 50 50 100.00
V2S sec_cm_fsm_local_esc kmac_sec_cm 2.086m 33.025ms 5 5 100.00
V2S sec_cm_absorbed_ctrl_mubi kmac_mubi 6.300m 114.169ms 10 10 100.00
V2S sec_cm_sw_cmd_ctrl_sparse kmac_smoke 1.784m 19.336ms 49 50 98.00
V2S TOTAL 71 75 94.67
V3 throughput kmac_throughput 0 0 --
V3 stress_all_with_rand_reset kmac_stress_all_with_rand_reset 1.105h 466.862ms 2 10 20.00
V3 TOTAL 2 10 20.00
TOTAL 1220 1250 97.60

Testplan Progress

Items Total Written Passing Progress
V1 8 8 7 87.50
V2 25 25 16 64.00
V2S 5 5 3 60.00
V3 2 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
94.14 97.91 92.62 99.89 76.06 95.59 99.05 97.88

Failure Buckets

Past Results