KMAC/MASKED Simulation Results

Friday June 28 2024 23:02:02 UTC

GitHub Revision: 3d5220a43f

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 73442097946972310753089853920865571566707682704390544987111276126114608747389

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke kmac_smoke 1.481m 17.062ms 50 50 100.00
V1 csr_hw_reset kmac_csr_hw_reset 1.220s 56.587us 5 5 100.00
V1 csr_rw kmac_csr_rw 1.240s 116.141us 20 20 100.00
V1 csr_bit_bash kmac_csr_bit_bash 18.380s 1.029ms 5 5 100.00
V1 csr_aliasing kmac_csr_aliasing 11.080s 3.219ms 5 5 100.00
V1 csr_mem_rw_with_rand_reset kmac_csr_mem_rw_with_rand_reset 2.660s 123.630us 20 20 100.00
V1 regwen_csr_and_corresponding_lockable_csr kmac_csr_rw 1.240s 116.141us 20 20 100.00
kmac_csr_aliasing 11.080s 3.219ms 5 5 100.00
V1 mem_walk kmac_mem_walk 0.790s 13.747us 5 5 100.00
V1 mem_partial_access kmac_mem_partial_access 1.630s 39.700us 5 5 100.00
V1 TOTAL 115 115 100.00
V2 long_msg_and_output kmac_long_msg_and_output 56.999m 92.015ms 48 50 96.00
V2 burst_write kmac_burst_write 27.411m 30.607ms 50 50 100.00
V2 test_vectors kmac_test_vectors_sha3_224 43.609m 1.423s 49 50 98.00
kmac_test_vectors_sha3_256 40.235m 1.010s 48 50 96.00
kmac_test_vectors_sha3_384 30.740m 232.378ms 49 50 98.00
kmac_test_vectors_sha3_512 21.513m 148.370ms 49 50 98.00
kmac_test_vectors_shake_128 1.836h 1.224s 50 50 100.00
kmac_test_vectors_shake_256 1.591h 1.443s 50 50 100.00
kmac_test_vectors_kmac 7.270s 1.505ms 49 50 98.00
kmac_test_vectors_kmac_xof 7.490s 439.165us 50 50 100.00
V2 sideload kmac_sideload 9.131m 22.964ms 50 50 100.00
V2 app kmac_app 7.395m 50.095ms 48 50 96.00
V2 app_with_partial_data kmac_app_with_partial_data 7.841m 83.017ms 9 10 90.00
V2 entropy_refresh kmac_entropy_refresh 7.951m 86.722ms 49 50 98.00
V2 error kmac_error 9.166m 103.908ms 47 50 94.00
V2 key_error kmac_key_error 13.170s 5.761ms 50 50 100.00
V2 edn_timeout_error kmac_edn_timeout_error 56.960s 6.361ms 20 20 100.00
V2 entropy_mode_error kmac_entropy_mode_error 41.900s 4.226ms 20 20 100.00
V2 entropy_ready_error kmac_entropy_ready_error 1.137m 25.166ms 10 10 100.00
V2 lc_escalation kmac_lc_escalation 51.590s 2.886ms 50 50 100.00
V2 stress_all kmac_stress_all 54.668m 211.603ms 47 50 94.00
V2 intr_test kmac_intr_test 0.920s 16.425us 50 50 100.00
V2 alert_test kmac_alert_test 0.920s 67.904us 50 50 100.00
V2 tl_d_oob_addr_access kmac_tl_errors 3.600s 399.063us 20 20 100.00
V2 tl_d_illegal_access kmac_tl_errors 3.600s 399.063us 20 20 100.00
V2 tl_d_outstanding_access kmac_csr_hw_reset 1.220s 56.587us 5 5 100.00
kmac_csr_rw 1.240s 116.141us 20 20 100.00
kmac_csr_aliasing 11.080s 3.219ms 5 5 100.00
kmac_same_csr_outstanding 2.940s 647.811us 20 20 100.00
V2 tl_d_partial_access kmac_csr_hw_reset 1.220s 56.587us 5 5 100.00
kmac_csr_rw 1.240s 116.141us 20 20 100.00
kmac_csr_aliasing 11.080s 3.219ms 5 5 100.00
kmac_same_csr_outstanding 2.940s 647.811us 20 20 100.00
V2 TOTAL 1032 1050 98.29
V2S shadow_reg_update_error kmac_shadow_reg_errors 1.500s 493.636us 19 20 95.00
V2S shadow_reg_read_clear_staged_value kmac_shadow_reg_errors 1.500s 493.636us 19 20 95.00
V2S shadow_reg_storage_error kmac_shadow_reg_errors 1.500s 493.636us 19 20 95.00
V2S shadowed_reset_glitch kmac_shadow_reg_errors 1.500s 493.636us 19 20 95.00
V2S shadow_reg_update_error_with_csr_rw kmac_shadow_reg_errors_with_csr_rw 2.750s 395.678us 18 20 90.00
V2S tl_intg_err kmac_sec_cm 2.219m 133.636ms 5 5 100.00
kmac_tl_intg_err 5.330s 756.475us 20 20 100.00
V2S sec_cm_bus_integrity kmac_tl_intg_err 5.330s 756.475us 20 20 100.00
V2S sec_cm_lc_escalate_en_intersig_mubi kmac_lc_escalation 51.590s 2.886ms 50 50 100.00
V2S sec_cm_sw_key_key_masking kmac_smoke 1.481m 17.062ms 50 50 100.00
V2S sec_cm_key_sideload kmac_sideload 9.131m 22.964ms 50 50 100.00
V2S sec_cm_cfg_shadowed_config_shadow kmac_shadow_reg_errors 1.500s 493.636us 19 20 95.00
V2S sec_cm_fsm_sparse kmac_sec_cm 2.219m 133.636ms 5 5 100.00
V2S sec_cm_ctr_redun kmac_sec_cm 2.219m 133.636ms 5 5 100.00
V2S sec_cm_packer_ctr_redun kmac_sec_cm 2.219m 133.636ms 5 5 100.00
V2S sec_cm_cfg_shadowed_config_regwen kmac_smoke 1.481m 17.062ms 50 50 100.00
V2S sec_cm_fsm_global_esc kmac_lc_escalation 51.590s 2.886ms 50 50 100.00
V2S sec_cm_fsm_local_esc kmac_sec_cm 2.219m 133.636ms 5 5 100.00
V2S sec_cm_absorbed_ctrl_mubi kmac_mubi 5.682m 11.906ms 9 10 90.00
V2S sec_cm_sw_cmd_ctrl_sparse kmac_smoke 1.481m 17.062ms 50 50 100.00
V2S TOTAL 71 75 94.67
V3 throughput kmac_throughput 0 0 --
V3 stress_all_with_rand_reset kmac_stress_all_with_rand_reset 47.136m 95.052ms 3 10 30.00
V3 TOTAL 3 10 30.00
TOTAL 1221 1250 97.68

Testplan Progress

Items Total Written Passing Progress
V1 8 8 8 100.00
V2 25 25 14 56.00
V2S 5 5 2 40.00
V3 2 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
94.11 97.89 92.62 99.89 76.06 95.53 98.89 97.88

Failure Buckets

Past Results