KMAC/MASKED Simulation Results

Sunday June 02 2024 19:02:53 UTC

GitHub Revision: 01a208901a

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 50418669159766293903157726892781832882154091083197082086235277423705989875584

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke kmac_smoke 1.432m 10.408ms 50 50 100.00
V1 csr_hw_reset kmac_csr_hw_reset 1.060s 292.565us 5 5 100.00
V1 csr_rw kmac_csr_rw 1.300s 113.309us 20 20 100.00
V1 csr_bit_bash kmac_csr_bit_bash 22.200s 1.453ms 5 5 100.00
V1 csr_aliasing kmac_csr_aliasing 10.160s 550.020us 5 5 100.00
V1 csr_mem_rw_with_rand_reset kmac_csr_mem_rw_with_rand_reset 2.720s 133.680us 20 20 100.00
V1 regwen_csr_and_corresponding_lockable_csr kmac_csr_rw 1.300s 113.309us 20 20 100.00
kmac_csr_aliasing 10.160s 550.020us 5 5 100.00
V1 mem_walk kmac_mem_walk 0.780s 22.410us 5 5 100.00
V1 mem_partial_access kmac_mem_partial_access 1.370s 39.202us 5 5 100.00
V1 TOTAL 115 115 100.00
V2 long_msg_and_output kmac_long_msg_and_output 58.538m 133.823ms 49 50 98.00
V2 burst_write kmac_burst_write 31.490m 32.964ms 46 50 92.00
V2 test_vectors kmac_test_vectors_sha3_224 41.782m 103.185ms 48 50 96.00
kmac_test_vectors_sha3_256 44.606m 1.565s 50 50 100.00
kmac_test_vectors_sha3_384 33.045m 572.542ms 50 50 100.00
kmac_test_vectors_sha3_512 23.981m 212.547ms 50 50 100.00
kmac_test_vectors_shake_128 1.730h 382.484ms 49 50 98.00
kmac_test_vectors_shake_256 1.492h 912.005ms 50 50 100.00
kmac_test_vectors_kmac 7.220s 4.306ms 49 50 98.00
kmac_test_vectors_kmac_xof 7.300s 2.837ms 50 50 100.00
V2 sideload kmac_sideload 9.056m 42.590ms 50 50 100.00
V2 app kmac_app 6.990m 25.507ms 49 50 98.00
V2 app_with_partial_data kmac_app_with_partial_data 6.423m 180.544ms 10 10 100.00
V2 entropy_refresh kmac_entropy_refresh 6.853m 17.166ms 48 50 96.00
V2 error kmac_error 8.676m 6.303ms 50 50 100.00
V2 key_error kmac_key_error 15.910s 4.322ms 50 50 100.00
V2 edn_timeout_error kmac_edn_timeout_error 48.950s 1.469ms 19 20 95.00
V2 entropy_mode_error kmac_entropy_mode_error 45.560s 1.470ms 20 20 100.00
V2 entropy_ready_error kmac_entropy_ready_error 1.348m 7.413ms 10 10 100.00
V2 lc_escalation kmac_lc_escalation 31.310s 2.995ms 50 50 100.00
V2 stress_all kmac_stress_all 46.280m 214.765ms 48 50 96.00
V2 intr_test kmac_intr_test 0.950s 42.782us 50 50 100.00
V2 alert_test kmac_alert_test 0.950s 20.120us 50 50 100.00
V2 tl_d_oob_addr_access kmac_tl_errors 3.310s 132.555us 20 20 100.00
V2 tl_d_illegal_access kmac_tl_errors 3.310s 132.555us 20 20 100.00
V2 tl_d_outstanding_access kmac_csr_hw_reset 1.060s 292.565us 5 5 100.00
kmac_csr_rw 1.300s 113.309us 20 20 100.00
kmac_csr_aliasing 10.160s 550.020us 5 5 100.00
kmac_same_csr_outstanding 2.600s 354.215us 20 20 100.00
V2 tl_d_partial_access kmac_csr_hw_reset 1.060s 292.565us 5 5 100.00
kmac_csr_rw 1.300s 113.309us 20 20 100.00
kmac_csr_aliasing 10.160s 550.020us 5 5 100.00
kmac_same_csr_outstanding 2.600s 354.215us 20 20 100.00
V2 TOTAL 1035 1050 98.57
V2S shadow_reg_update_error kmac_shadow_reg_errors 1.450s 103.060us 17 20 85.00
V2S shadow_reg_read_clear_staged_value kmac_shadow_reg_errors 1.450s 103.060us 17 20 85.00
V2S shadow_reg_storage_error kmac_shadow_reg_errors 1.450s 103.060us 17 20 85.00
V2S shadowed_reset_glitch kmac_shadow_reg_errors 1.450s 103.060us 17 20 85.00
V2S shadow_reg_update_error_with_csr_rw kmac_shadow_reg_errors_with_csr_rw 2.860s 128.866us 19 20 95.00
V2S tl_intg_err kmac_sec_cm 1.402m 5.565ms 5 5 100.00
kmac_tl_intg_err 5.170s 274.409us 20 20 100.00
V2S sec_cm_bus_integrity kmac_tl_intg_err 5.170s 274.409us 20 20 100.00
V2S sec_cm_lc_escalate_en_intersig_mubi kmac_lc_escalation 31.310s 2.995ms 50 50 100.00
V2S sec_cm_sw_key_key_masking kmac_smoke 1.432m 10.408ms 50 50 100.00
V2S sec_cm_key_sideload kmac_sideload 9.056m 42.590ms 50 50 100.00
V2S sec_cm_cfg_shadowed_config_shadow kmac_shadow_reg_errors 1.450s 103.060us 17 20 85.00
V2S sec_cm_fsm_sparse kmac_sec_cm 1.402m 5.565ms 5 5 100.00
V2S sec_cm_ctr_redun kmac_sec_cm 1.402m 5.565ms 5 5 100.00
V2S sec_cm_packer_ctr_redun kmac_sec_cm 1.402m 5.565ms 5 5 100.00
V2S sec_cm_cfg_shadowed_config_regwen kmac_smoke 1.432m 10.408ms 50 50 100.00
V2S sec_cm_fsm_global_esc kmac_lc_escalation 31.310s 2.995ms 50 50 100.00
V2S sec_cm_fsm_local_esc kmac_sec_cm 1.402m 5.565ms 5 5 100.00
V2S sec_cm_absorbed_ctrl_mubi kmac_mubi 6.784m 16.415ms 8 10 80.00
V2S sec_cm_sw_cmd_ctrl_sparse kmac_smoke 1.432m 10.408ms 50 50 100.00
V2S TOTAL 69 75 92.00
V3 throughput kmac_throughput 0 0 --
V3 stress_all_with_rand_reset kmac_stress_all_with_rand_reset 41.338m 117.606ms 12 50 24.00
V3 TOTAL 12 50 24.00
TOTAL 1231 1290 95.43

Testplan Progress

Items Total Written Passing Progress
V1 8 8 8 100.00
V2 25 25 16 64.00
V2S 5 5 2 40.00
V3 2 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
94.14 97.91 92.65 99.89 76.06 95.59 99.05 97.88

Failure Buckets

Past Results