HMAC Simulation Results

Sunday January 07 2024 20:02:41 UTC

GitHub Revision: 042415198f

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 94802583296605211241780338187580260959003534163885373932116464911642413280689

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke hmac_smoke 4.620s 923.932us 50 50 100.00
V1 csr_hw_reset hmac_csr_hw_reset 0.690s 93.460us 4 5 80.00
V1 csr_rw hmac_csr_rw 0.740s 27.325us 18 20 90.00
V1 csr_bit_bash hmac_csr_bit_bash 9.160s 4.055ms 3 5 60.00
V1 csr_aliasing hmac_csr_aliasing 2.670s 461.489us 5 5 100.00
V1 csr_mem_rw_with_rand_reset hmac_csr_mem_rw_with_rand_reset 2.780s 36.115us 15 20 75.00
V1 regwen_csr_and_corresponding_lockable_csr hmac_csr_rw 0.740s 27.325us 18 20 90.00
hmac_csr_aliasing 2.670s 461.489us 5 5 100.00
V1 TOTAL 95 105 90.48
V2 long_msg hmac_long_msg 2.299m 8.263ms 50 50 100.00
V2 back_pressure hmac_back_pressure 1.043m 13.493ms 50 50 100.00
V2 test_vectors hmac_test_sha_vectors 8.429m 94.954ms 44 50 88.00
hmac_test_hmac_vectors 1.220s 71.311us 50 50 100.00
V2 burst_wr hmac_burst_wr 1.328m 1.688ms 50 50 100.00
V2 datapath_stress hmac_datapath_stress 2.231m 26.036ms 50 50 100.00
V2 error hmac_error 3.715m 19.015ms 50 50 100.00
V2 wipe_secret hmac_wipe_secret 1.508m 6.594ms 50 50 100.00
V2 stress_all hmac_stress_all 33.747m 735.665ms 50 50 100.00
V2 alert_test hmac_alert_test 0.630s 19.142us 50 50 100.00
V2 intr_test hmac_intr_test 0.610s 13.160us 45 50 90.00
V2 tl_d_oob_addr_access hmac_tl_errors 3.200s 240.183us 17 20 85.00
V2 tl_d_illegal_access hmac_tl_errors 3.200s 240.183us 17 20 85.00
V2 tl_d_outstanding_access hmac_csr_hw_reset 0.690s 93.460us 4 5 80.00
hmac_csr_rw 0.740s 27.325us 18 20 90.00
hmac_csr_aliasing 2.670s 461.489us 5 5 100.00
hmac_same_csr_outstanding 1.340s 66.304us 16 20 80.00
V2 tl_d_partial_access hmac_csr_hw_reset 0.690s 93.460us 4 5 80.00
hmac_csr_rw 0.740s 27.325us 18 20 90.00
hmac_csr_aliasing 2.670s 461.489us 5 5 100.00
hmac_same_csr_outstanding 1.340s 66.304us 16 20 80.00
V2 TOTAL 572 590 96.95
V2S tl_intg_err hmac_sec_cm 0.970s 153.862us 5 5 100.00
hmac_tl_intg_err 2.440s 173.036us 17 20 85.00
V2S sec_cm_bus_integrity hmac_tl_intg_err 2.440s 173.036us 17 20 85.00
V2S TOTAL 22 25 88.00
V3 write_config_and_secret_key_during_msg_wr hmac_smoke 4.620s 923.932us 50 50 100.00
V3 stress_all_with_rand_reset hmac_stress_all_with_rand_reset 1.595h 235.515ms 191 200 95.50
V3 TOTAL 191 200 95.50
TOTAL 880 920 95.65

Testplan Progress

Items Total Written Passing Progress
V1 6 6 2 33.33
V2 13 13 9 69.23
V2S 2 2 1 50.00
V3 1 1 0 0.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
99.62 99.53 98.69 100.00 100.00 99.76 99.49 99.86

Failure Buckets

Past Results