HMAC Simulation Results

Tuesday September 10 2024 22:04:06 UTC

GitHub Revision: 25b1acbf68

Branch: os_regression_2024_09_10

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 115096073277204595231937901342804627564470767004707790242822318429579153097636

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke hmac_smoke 22.360s 1.350ms 50 50 100.00
V1 csr_hw_reset hmac_csr_hw_reset 0.950s 41.386us 5 5 100.00
V1 csr_rw hmac_csr_rw 38.679s 19 20 95.00
V1 csr_bit_bash hmac_csr_bit_bash 14.610s 1.064ms 5 5 100.00
V1 csr_aliasing hmac_csr_aliasing 7.830s 7.341ms 5 5 100.00
V1 csr_mem_rw_with_rand_reset hmac_csr_mem_rw_with_rand_reset 15.290m 107.671ms 19 20 95.00
V1 regwen_csr_and_corresponding_lockable_csr hmac_csr_rw 38.679s 19 20 95.00
hmac_csr_aliasing 7.830s 7.341ms 5 5 100.00
V1 TOTAL 103 105 98.10
V2 long_msg hmac_long_msg 3.880m 3.435ms 50 50 100.00
V2 back_pressure hmac_back_pressure 1.870m 17.585ms 50 50 100.00
V2 test_vectors hmac_test_sha256_vectors 11.892m 52.658ms 5 5 100.00
hmac_test_sha384_vectors 47.581m 1.234s 5 5 100.00
hmac_test_sha512_vectors 55.216m 947.214ms 5 5 100.00
hmac_test_hmac256_vectors 1.404m 26.137ms 5 5 100.00
hmac_test_hmac384_vectors 1.616m 58.358ms 5 5 100.00
hmac_test_hmac512_vectors 2.487m 16.701ms 5 5 100.00
V2 burst_wr hmac_burst_wr 1.805m 11.492ms 50 50 100.00
V2 datapath_stress hmac_datapath_stress 24.491m 42.776ms 50 50 100.00
V2 error hmac_error 4.462m 18.818ms 50 50 100.00
V2 wipe_secret hmac_wipe_secret 2.987m 40.329ms 50 50 100.00
V2 save_and_restore hmac_smoke 22.360s 1.350ms 50 50 100.00
hmac_long_msg 3.880m 3.435ms 50 50 100.00
hmac_back_pressure 1.870m 17.585ms 50 50 100.00
hmac_datapath_stress 24.491m 42.776ms 50 50 100.00
hmac_burst_wr 1.805m 11.492ms 50 50 100.00
hmac_stress_all 1.005h 128.627ms 50 50 100.00
V2 fifo_empty_status_interrupt hmac_smoke 22.360s 1.350ms 50 50 100.00
hmac_long_msg 3.880m 3.435ms 50 50 100.00
hmac_back_pressure 1.870m 17.585ms 50 50 100.00
hmac_datapath_stress 24.491m 42.776ms 50 50 100.00
hmac_wipe_secret 2.987m 40.329ms 50 50 100.00
hmac_test_sha256_vectors 11.892m 52.658ms 5 5 100.00
hmac_test_sha384_vectors 47.581m 1.234s 5 5 100.00
hmac_test_sha512_vectors 55.216m 947.214ms 5 5 100.00
hmac_test_hmac256_vectors 1.404m 26.137ms 5 5 100.00
hmac_test_hmac384_vectors 1.616m 58.358ms 5 5 100.00
hmac_test_hmac512_vectors 2.487m 16.701ms 5 5 100.00
V2 wide_digest_configurable_key_length hmac_smoke 22.360s 1.350ms 50 50 100.00
hmac_long_msg 3.880m 3.435ms 50 50 100.00
hmac_back_pressure 1.870m 17.585ms 50 50 100.00
hmac_datapath_stress 24.491m 42.776ms 50 50 100.00
hmac_burst_wr 1.805m 11.492ms 50 50 100.00
hmac_error 4.462m 18.818ms 50 50 100.00
hmac_wipe_secret 2.987m 40.329ms 50 50 100.00
hmac_test_sha256_vectors 11.892m 52.658ms 5 5 100.00
hmac_test_sha384_vectors 47.581m 1.234s 5 5 100.00
hmac_test_sha512_vectors 55.216m 947.214ms 5 5 100.00
hmac_test_hmac256_vectors 1.404m 26.137ms 5 5 100.00
hmac_test_hmac384_vectors 1.616m 58.358ms 5 5 100.00
hmac_test_hmac512_vectors 2.487m 16.701ms 5 5 100.00
hmac_stress_all 1.005h 128.627ms 50 50 100.00
V2 stress_all hmac_stress_all 1.005h 128.627ms 50 50 100.00
V2 alert_test hmac_alert_test 0.970s 124.996us 50 50 100.00
V2 intr_test hmac_intr_test 49.642s 47 50 94.00
V2 tl_d_oob_addr_access hmac_tl_errors 49.701s 18 20 90.00
V2 tl_d_illegal_access hmac_tl_errors 49.701s 18 20 90.00
V2 tl_d_outstanding_access hmac_csr_hw_reset 0.950s 41.386us 5 5 100.00
hmac_csr_rw 38.679s 19 20 95.00
hmac_csr_aliasing 7.830s 7.341ms 5 5 100.00
hmac_same_csr_outstanding 49.578s 19 20 95.00
V2 tl_d_partial_access hmac_csr_hw_reset 0.950s 41.386us 5 5 100.00
hmac_csr_rw 38.679s 19 20 95.00
hmac_csr_aliasing 7.830s 7.341ms 5 5 100.00
hmac_same_csr_outstanding 49.578s 19 20 95.00
V2 TOTAL 514 520 98.85
V2S tl_intg_err hmac_sec_cm 1.680s 111.171us 5 5 100.00
hmac_tl_intg_err 49.674s 18 20 90.00
V2S sec_cm_bus_integrity hmac_tl_intg_err 49.674s 18 20 90.00
V2S TOTAL 23 25 92.00
V3 write_config_and_secret_key_during_msg_wr hmac_smoke 22.360s 1.350ms 50 50 100.00
V3 stress_all_with_rand_reset hmac_stress_all_with_rand_reset 6.370m 109.921ms 2 10 20.00
V3 TOTAL 2 10 20.00
TOTAL 642 660 97.27

Testplan Progress

Items Total Written Passing Progress
V1 6 6 4 66.67
V2 17 17 14 82.35
V2S 2 2 1 50.00
V3 1 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
97.61 95.40 97.17 100.00 94.12 98.27 98.48 99.85

Failure Buckets

Past Results