c8985d6745
Stage | Name | Tests | Max Job Runtime | Simulated Time | Passing | Total | Pass Rate |
---|---|---|---|---|---|---|---|
V1 | smoke | kmac_smoke | 1.132m | 11.113ms | 50 | 50 | 100.00 |
V1 | csr_hw_reset | kmac_csr_hw_reset | 1.090s | 200.596us | 5 | 5 | 100.00 |
V1 | csr_rw | kmac_csr_rw | 1.110s | 29.468us | 20 | 20 | 100.00 |
V1 | csr_bit_bash | kmac_csr_bit_bash | 19.780s | 6.527ms | 5 | 5 | 100.00 |
V1 | csr_aliasing | kmac_csr_aliasing | 9.240s | 538.173us | 5 | 5 | 100.00 |
V1 | csr_mem_rw_with_rand_reset | kmac_csr_mem_rw_with_rand_reset | 2.520s | 349.863us | 20 | 20 | 100.00 |
V1 | regwen_csr_and_corresponding_lockable_csr | kmac_csr_rw | 1.110s | 29.468us | 20 | 20 | 100.00 |
kmac_csr_aliasing | 9.240s | 538.173us | 5 | 5 | 100.00 | ||
V1 | mem_walk | kmac_mem_walk | 0.710s | 15.656us | 5 | 5 | 100.00 |
V1 | mem_partial_access | kmac_mem_partial_access | 1.360s | 39.841us | 5 | 5 | 100.00 |
V1 | TOTAL | 115 | 115 | 100.00 | |||
V2 | long_msg_and_output | kmac_long_msg_and_output | 59.521m | 249.726ms | 39 | 50 | 78.00 |
V2 | burst_write | kmac_burst_write | 17.528m | 54.481ms | 50 | 50 | 100.00 |
V2 | test_vectors | kmac_test_vectors_sha3_224 | 59.256m | 474.831ms | 47 | 50 | 94.00 |
kmac_test_vectors_sha3_256 | 58.764m | 576.870ms | 50 | 50 | 100.00 | ||
kmac_test_vectors_sha3_384 | 42.246m | 299.133ms | 50 | 50 | 100.00 | ||
kmac_test_vectors_sha3_512 | 26.784m | 204.148ms | 50 | 50 | 100.00 | ||
kmac_test_vectors_shake_128 | 1.683h | 181.373ms | 26 | 50 | 52.00 | ||
kmac_test_vectors_shake_256 | 1.358h | 182.116ms | 18 | 50 | 36.00 | ||
kmac_test_vectors_kmac | 5.960s | 265.999us | 50 | 50 | 100.00 | ||
kmac_test_vectors_kmac_xof | 6.460s | 2.495ms | 50 | 50 | 100.00 | ||
V2 | sideload | kmac_sideload | 8.206m | 30.353ms | 50 | 50 | 100.00 |
V2 | app | kmac_app | 7.600m | 80.387ms | 49 | 50 | 98.00 |
V2 | app_with_partial_data | kmac_app_with_partial_data | 5.877m | 15.936ms | 10 | 10 | 100.00 |
V2 | entropy_refresh | kmac_entropy_refresh | 6.417m | 27.886ms | 50 | 50 | 100.00 |
V2 | error | kmac_error | 8.583m | 158.206ms | 50 | 50 | 100.00 |
V2 | key_error | kmac_key_error | 12.680s | 19.678ms | 50 | 50 | 100.00 |
V2 | edn_timeout_error | kmac_edn_timeout_error | 45.830s | 24.605ms | 20 | 20 | 100.00 |
V2 | entropy_mode_error | kmac_entropy_mode_error | 33.340s | 542.238us | 20 | 20 | 100.00 |
V2 | entropy_ready_error | kmac_entropy_ready_error | 1.078m | 26.835ms | 10 | 10 | 100.00 |
V2 | lc_escalation | kmac_lc_escalation | 32.400s | 2.239ms | 50 | 50 | 100.00 |
V2 | stress_all | kmac_stress_all | 59.807m | 962.726ms | 50 | 50 | 100.00 |
V2 | intr_test | kmac_intr_test | 0.850s | 17.730us | 50 | 50 | 100.00 |
V2 | alert_test | kmac_alert_test | 0.890s | 69.189us | 50 | 50 | 100.00 |
V2 | tl_d_oob_addr_access | kmac_tl_errors | 3.680s | 120.322us | 20 | 20 | 100.00 |
V2 | tl_d_illegal_access | kmac_tl_errors | 3.680s | 120.322us | 20 | 20 | 100.00 |
V2 | tl_d_outstanding_access | kmac_csr_hw_reset | 1.090s | 200.596us | 5 | 5 | 100.00 |
kmac_csr_rw | 1.110s | 29.468us | 20 | 20 | 100.00 | ||
kmac_csr_aliasing | 9.240s | 538.173us | 5 | 5 | 100.00 | ||
kmac_same_csr_outstanding | 2.460s | 221.327us | 20 | 20 | 100.00 | ||
V2 | tl_d_partial_access | kmac_csr_hw_reset | 1.090s | 200.596us | 5 | 5 | 100.00 |
kmac_csr_rw | 1.110s | 29.468us | 20 | 20 | 100.00 | ||
kmac_csr_aliasing | 9.240s | 538.173us | 5 | 5 | 100.00 | ||
kmac_same_csr_outstanding | 2.460s | 221.327us | 20 | 20 | 100.00 | ||
V2 | TOTAL | 979 | 1050 | 93.24 | |||
V2S | shadow_reg_update_error | kmac_shadow_reg_errors | 1.640s | 75.258us | 20 | 20 | 100.00 |
V2S | shadow_reg_read_clear_staged_value | kmac_shadow_reg_errors | 1.640s | 75.258us | 20 | 20 | 100.00 |
V2S | shadow_reg_storage_error | kmac_shadow_reg_errors | 1.640s | 75.258us | 20 | 20 | 100.00 |
V2S | shadowed_reset_glitch | kmac_shadow_reg_errors | 1.640s | 75.258us | 20 | 20 | 100.00 |
V2S | shadow_reg_update_error_with_csr_rw | kmac_shadow_reg_errors_with_csr_rw | 3.150s | 497.406us | 20 | 20 | 100.00 |
V2S | tl_intg_err | kmac_sec_cm | 1.326m | 6.515ms | 5 | 5 | 100.00 |
kmac_tl_intg_err | 5.130s | 2.147ms | 20 | 20 | 100.00 | ||
V2S | sec_cm_bus_integrity | kmac_tl_intg_err | 5.130s | 2.147ms | 20 | 20 | 100.00 |
V2S | sec_cm_lc_escalate_en_intersig_mubi | kmac_lc_escalation | 32.400s | 2.239ms | 50 | 50 | 100.00 |
V2S | sec_cm_sw_key_key_masking | kmac_smoke | 1.132m | 11.113ms | 50 | 50 | 100.00 |
V2S | sec_cm_key_sideload | kmac_sideload | 8.206m | 30.353ms | 50 | 50 | 100.00 |
V2S | sec_cm_cfg_shadowed_config_shadow | kmac_shadow_reg_errors | 1.640s | 75.258us | 20 | 20 | 100.00 |
V2S | sec_cm_fsm_sparse | kmac_sec_cm | 1.326m | 6.515ms | 5 | 5 | 100.00 |
V2S | sec_cm_ctr_redun | kmac_sec_cm | 1.326m | 6.515ms | 5 | 5 | 100.00 |
V2S | sec_cm_packer_ctr_redun | kmac_sec_cm | 1.326m | 6.515ms | 5 | 5 | 100.00 |
V2S | sec_cm_cfg_shadowed_config_regwen | kmac_smoke | 1.132m | 11.113ms | 50 | 50 | 100.00 |
V2S | sec_cm_fsm_global_esc | kmac_lc_escalation | 32.400s | 2.239ms | 50 | 50 | 100.00 |
V2S | sec_cm_fsm_local_esc | kmac_sec_cm | 1.326m | 6.515ms | 5 | 5 | 100.00 |
V2S | sec_cm_absorbed_ctrl_mubi | kmac_mubi | 6.174m | 34.642ms | 10 | 10 | 100.00 |
V2S | sec_cm_sw_cmd_ctrl_sparse | kmac_smoke | 1.132m | 11.113ms | 50 | 50 | 100.00 |
V2S | TOTAL | 75 | 75 | 100.00 | |||
V3 | throughput | kmac_throughput | 0 | 0 | -- | ||
V3 | stress_all_with_rand_reset | kmac_stress_all_with_rand_reset | 25.324m | 110.573ms | 4 | 10 | 40.00 |
V3 | TOTAL | 4 | 10 | 40.00 | |||
TOTAL | 1173 | 1250 | 93.84 |
Items | Total | Written | Passing | Progress |
---|---|---|---|---|
V1 | 8 | 8 | 8 | 100.00 |
V2 | 25 | 25 | 20 | 80.00 |
V2S | 5 | 5 | 5 | 100.00 |
V3 | 2 | 1 | 0 | 0.00 |
SCORE | LINE | COND | TOGGLE | FSM | BRANCH | ASSERT | GROUP |
---|---|---|---|---|---|---|---|
92.21 | 95.89 | 92.30 | 100.00 | 67.77 | 94.11 | 98.84 | 96.58 |
Job kmac_unmasked-sim-vcs_run_default killed due to: Exit reason: User job exceeded runlimit: User job timed out
has 70 failures:
0.kmac_test_vectors_shake_128.46011768422178714298113804852458544679095558299434608030315493564459236955237
Log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/0.kmac_test_vectors_shake_128/latest/run.log
Job ID: smart:9bb74dd2-8f70-4440-be77-1e9215c3e3e8
3.kmac_test_vectors_shake_128.95453690161724291697482614952993443851253802012419924272408699385777502514371
Log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/3.kmac_test_vectors_shake_128/latest/run.log
Job ID: smart:2b8f28f7-20ad-4de0-9596-c4e199bd6baf
... and 22 more failures.
2.kmac_test_vectors_shake_256.87205110453079526117266146078272004409470726573994254819854306217437551794590
Log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/2.kmac_test_vectors_shake_256/latest/run.log
Job ID: smart:ffbfa852-66d8-462c-8967-484c4efe719e
4.kmac_test_vectors_shake_256.23067936622946797234617049896903792156869196809490029462066838051020358218014
Log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/4.kmac_test_vectors_shake_256/latest/run.log
Job ID: smart:adf5028b-0073-4196-96fb-d3211571c7b8
... and 30 more failures.
6.kmac_long_msg_and_output.1901047248039314869556095250322243565095811169779098961105200247356513836371
Log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/6.kmac_long_msg_and_output/latest/run.log
Job ID: smart:db0d4dbb-73c1-4ac1-b385-e34579a2f845
7.kmac_long_msg_and_output.94823541440530239957105994264574337812800211578063228666332747793919794534592
Log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/7.kmac_long_msg_and_output/latest/run.log
Job ID: smart:97ea4c5f-6605-4cbf-84d2-0666ab642b80
... and 9 more failures.
27.kmac_test_vectors_sha3_224.51898014733740027275168313493543063120305375896587536938633050101435958486006
Log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/27.kmac_test_vectors_sha3_224/latest/run.log
Job ID: smart:25f4017a-5ed7-447d-b04d-21d899646cef
34.kmac_test_vectors_sha3_224.76684308387413807630362906336028763025689320219634401837420231485262480744752
Log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/34.kmac_test_vectors_sha3_224/latest/run.log
Job ID: smart:d685eac4-5b85-4680-8717-a2a686d44070
... and 1 more failures.
UVM_ERROR (cip_base_vseq.sv:836) [kmac_common_vseq] Check failed (!has_outstanding_access()) Waited * cycles to issue a reset with no outstanding accesses.
has 5 failures:
0.kmac_stress_all_with_rand_reset.10877410876670867285461202286263647404853529525371058358646958481948106453925
Line 2929, in log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/0.kmac_stress_all_with_rand_reset/latest/run.log
UVM_ERROR @ 110572894128 ps: (cip_base_vseq.sv:836) [uvm_test_top.env.virtual_sequencer.kmac_common_vseq] Check failed (!has_outstanding_access()) Waited 10000 cycles to issue a reset with no outstanding accesses.
UVM_INFO @ 110572894128 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
1.kmac_stress_all_with_rand_reset.20920666963188647325029640288985915085242055733323831837520183678526399346838
Line 754, in log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/1.kmac_stress_all_with_rand_reset/latest/run.log
UVM_ERROR @ 150684988743 ps: (cip_base_vseq.sv:836) [uvm_test_top.env.virtual_sequencer.kmac_common_vseq] Check failed (!has_outstanding_access()) Waited 10000 cycles to issue a reset with no outstanding accesses.
UVM_INFO @ 150684988743 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 3 more failures.
UVM_ERROR (kmac_scoreboard.sv:1188) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: kmac_reg_block.err_code
has 1 failures:
4.kmac_stress_all_with_rand_reset.56998577426386940068820248705915063148955715114483789469460788941656309335762
Line 1066, in log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/4.kmac_stress_all_with_rand_reset/latest/run.log
UVM_ERROR @ 61525182863 ps: (kmac_scoreboard.sv:1188) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (0 [0x0] vs 2147483664 [0x80000010]) reg name: kmac_reg_block.err_code
UVM_INFO @ 61525182863 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
UVM_FATAL (kmac_scoreboard.sv:1638) [scoreboard] Check failed unmasked_digest[i] == dpi_digest[i] (* [*] vs * [*]) Mismatch between unmasked_digest[*] and dpi_digest[*]
has 1 failures:
33.kmac_app.70103831339777056853708887927122598691485648933033266295396835611710119945252
Line 429, in log /container/opentitan-public/scratch/os_regression/kmac_unmasked-sim-vcs/33.kmac_app/latest/run.log
UVM_FATAL @ 3631851153 ps: (kmac_scoreboard.sv:1638) [uvm_test_top.env.scoreboard] Check failed unmasked_digest[i] == dpi_digest[i] (196 [0xc4] vs 248 [0xf8]) Mismatch between unmasked_digest[0] and dpi_digest[0]
UVM_INFO @ 3631851153 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---