KMAC/UNMASKED Simulation Results

Sunday January 07 2024 20:02:41 UTC

GitHub Revision: 042415198f

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 94802583296605211241780338187580260959003534163885373932116464911642413280689

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke kmac_smoke 1.039m 4.148ms 50 50 100.00
V1 csr_hw_reset kmac_csr_hw_reset 1.130s 67.857us 5 5 100.00
V1 csr_rw kmac_csr_rw 1.130s 27.031us 15 20 75.00
V1 csr_bit_bash kmac_csr_bit_bash 22.680s 3.285ms 5 5 100.00
V1 csr_aliasing kmac_csr_aliasing 10.310s 1.677ms 3 5 60.00
V1 csr_mem_rw_with_rand_reset kmac_csr_mem_rw_with_rand_reset 2.170s 49.920us 17 20 85.00
V1 regwen_csr_and_corresponding_lockable_csr kmac_csr_rw 1.130s 27.031us 15 20 75.00
kmac_csr_aliasing 10.310s 1.677ms 3 5 60.00
V1 mem_walk kmac_mem_walk 0.710s 12.784us 3 5 60.00
V1 mem_partial_access kmac_mem_partial_access 1.470s 38.138us 4 5 80.00
V1 TOTAL 102 115 88.70
V2 long_msg_and_output kmac_long_msg_and_output 45.516m 130.988ms 50 50 100.00
V2 burst_write kmac_burst_write 14.055m 41.851ms 49 50 98.00
V2 test_vectors kmac_test_vectors_sha3_224 35.510m 413.000ms 50 50 100.00
kmac_test_vectors_sha3_256 33.390m 384.439ms 50 50 100.00
kmac_test_vectors_sha3_384 24.508m 72.852ms 50 50 100.00
kmac_test_vectors_sha3_512 17.737m 465.219ms 50 50 100.00
kmac_test_vectors_shake_128 1.463h 527.431ms 50 50 100.00
kmac_test_vectors_shake_256 1.210h 745.313ms 50 50 100.00
kmac_test_vectors_kmac 5.250s 331.572us 50 50 100.00
kmac_test_vectors_kmac_xof 5.300s 1.924ms 50 50 100.00
V2 sideload kmac_sideload 6.834m 21.241ms 50 50 100.00
V2 app kmac_app 5.504m 179.492ms 49 50 98.00
V2 app_with_partial_data kmac_app_with_partial_data 4.917m 29.971ms 10 10 100.00
V2 entropy_refresh kmac_entropy_refresh 5.838m 21.663ms 49 50 98.00
V2 error kmac_error 6.452m 142.515ms 50 50 100.00
V2 key_error kmac_key_error 5.820s 8.590ms 49 50 98.00
V2 edn_timeout_error kmac_edn_timeout_error 38.630s 41.250ms 20 20 100.00
V2 entropy_mode_error kmac_entropy_mode_error 38.630s 5.733ms 20 20 100.00
V2 entropy_ready_error kmac_entropy_ready_error 1.016m 7.393ms 10 10 100.00
V2 lc_escalation kmac_lc_escalation 22.340s 5.878ms 50 50 100.00
V2 stress_all kmac_stress_all 41.565m 122.217ms 49 50 98.00
V2 intr_test kmac_intr_test 0.810s 27.653us 43 50 86.00
V2 alert_test kmac_alert_test 0.870s 19.517us 50 50 100.00
V2 tl_d_oob_addr_access kmac_tl_errors 3.730s 148.920us 15 20 75.00
V2 tl_d_illegal_access kmac_tl_errors 3.730s 148.920us 15 20 75.00
V2 tl_d_outstanding_access kmac_csr_hw_reset 1.130s 67.857us 5 5 100.00
kmac_csr_rw 1.130s 27.031us 15 20 75.00
kmac_csr_aliasing 10.310s 1.677ms 3 5 60.00
kmac_same_csr_outstanding 2.670s 121.747us 14 20 70.00
V2 tl_d_partial_access kmac_csr_hw_reset 1.130s 67.857us 5 5 100.00
kmac_csr_rw 1.130s 27.031us 15 20 75.00
kmac_csr_aliasing 10.310s 1.677ms 3 5 60.00
kmac_same_csr_outstanding 2.670s 121.747us 14 20 70.00
V2 TOTAL 1027 1050 97.81
V2S shadow_reg_update_error kmac_shadow_reg_errors 1.360s 76.780us 12 20 60.00
V2S shadow_reg_read_clear_staged_value kmac_shadow_reg_errors 1.360s 76.780us 12 20 60.00
V2S shadow_reg_storage_error kmac_shadow_reg_errors 1.360s 76.780us 12 20 60.00
V2S shadowed_reset_glitch kmac_shadow_reg_errors 1.360s 76.780us 12 20 60.00
V2S shadow_reg_update_error_with_csr_rw kmac_shadow_reg_errors_with_csr_rw 3.690s 1.303ms 17 20 85.00
V2S tl_intg_err kmac_sec_cm 48.100s 9.263ms 5 5 100.00
kmac_tl_intg_err 5.400s 998.046us 18 20 90.00
V2S sec_cm_bus_integrity kmac_tl_intg_err 5.400s 998.046us 18 20 90.00
V2S sec_cm_lc_escalate_en_intersig_mubi kmac_lc_escalation 22.340s 5.878ms 50 50 100.00
V2S sec_cm_sw_key_key_masking kmac_smoke 1.039m 4.148ms 50 50 100.00
V2S sec_cm_key_sideload kmac_sideload 6.834m 21.241ms 50 50 100.00
V2S sec_cm_cfg_shadowed_config_shadow kmac_shadow_reg_errors 1.360s 76.780us 12 20 60.00
V2S sec_cm_fsm_sparse kmac_sec_cm 48.100s 9.263ms 5 5 100.00
V2S sec_cm_ctr_redun kmac_sec_cm 48.100s 9.263ms 5 5 100.00
V2S sec_cm_packer_ctr_redun kmac_sec_cm 48.100s 9.263ms 5 5 100.00
V2S sec_cm_cfg_shadowed_config_regwen kmac_smoke 1.039m 4.148ms 50 50 100.00
V2S sec_cm_fsm_global_esc kmac_lc_escalation 22.340s 5.878ms 50 50 100.00
V2S sec_cm_fsm_local_esc kmac_sec_cm 48.100s 9.263ms 5 5 100.00
V2S sec_cm_absorbed_ctrl_mubi kmac_mubi 3.974m 9.849ms 10 10 100.00
V2S sec_cm_sw_cmd_ctrl_sparse kmac_smoke 1.039m 4.148ms 50 50 100.00
V2S TOTAL 62 75 82.67
V3 throughput kmac_throughput 0 0 --
V3 stress_all_with_rand_reset kmac_stress_all_with_rand_reset 51.709m 162.205ms 40 50 80.00
V3 TOTAL 40 50 80.00
TOTAL 1231 1290 95.43

Testplan Progress

Items Total Written Passing Progress
V1 8 8 3 37.50
V2 25 25 17 68.00
V2S 5 5 2 40.00
V3 2 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
95.46 96.58 92.46 100.00 88.64 94.67 98.84 97.02

Failure Buckets

Past Results