KEYMGR Simulation Results

Wednesday January 24 2024 20:02:24 UTC

GitHub Revision: `17d5a97c3b`

Branch: os_regression

Simulator: VCS

Build randomization enabled with --build-seed 111545506019531132515166311410934274348263845011639206515682989027305484635840

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	keymgr_smoke	40.200s	5.861ms	49	50	98.00
V1	random	keymgr_random	1.864m	17.679ms	47	50	94.00
V1	csr_hw_reset	keymgr_csr_hw_reset	1.230s	35.826us	5	5	100.00
V1	csr_rw	keymgr_csr_rw	1.650s	128.984us	19	20	95.00
V1	csr_bit_bash	keymgr_csr_bit_bash	26.460s	1.743ms	5	5	100.00
V1	csr_aliasing	keymgr_csr_aliasing	15.400s	2.104ms	5	5	100.00
V1	csr_mem_rw_with_rand_reset	keymgr_csr_mem_rw_with_rand_reset	1.950s	21.251us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	keymgr_csr_rw	1.650s	128.984us	19	20	95.00
		keymgr_csr_aliasing	15.400s	2.104ms	5	5	100.00
V1		TOTAL			150	155	96.77
V2	cfgen_during_op	keymgr_cfg_regwen	2.148m	3.057ms	49	50	98.00
V2	sideload	keymgr_sideload	1.011m	5.888ms	49	50	98.00
		keymgr_sideload_kmac	45.500s	3.642ms	49	50	98.00
		keymgr_sideload_aes	1.091m	1.860ms	49	50	98.00
		keymgr_sideload_otbn	59.740s	1.913ms	50	50	100.00
V2	direct_to_disabled_state	keymgr_direct_to_disabled	31.110s	2.792ms	49	50	98.00
V2	lc_disable	keymgr_lc_disable	9.220s	767.097us	48	50	96.00
V2	kmac_error_response	keymgr_kmac_rsp_err	1.045m	2.272ms	46	50	92.00
V2	invalid_sw_input	keymgr_sw_invalid_input	1.810m	9.430ms	50	50	100.00
V2	invalid_hw_input	keymgr_hwsw_invalid_input	1.110m	5.268ms	50	50	100.00
V2	sync_async_fault_cross	keymgr_sync_async_fault_cross	29.440s	1.146ms	49	50	98.00
V2	stress_all	keymgr_stress_all	7.090m	61.917ms	50	50	100.00
V2	intr_test	keymgr_intr_test	1.000s	22.804us	50	50	100.00
V2	alert_test	keymgr_alert_test	1.060s	81.621us	50	50	100.00
V2	tl_d_oob_addr_access	keymgr_tl_errors	4.900s	125.604us	20	20	100.00
V2	tl_d_illegal_access	keymgr_tl_errors	4.900s	125.604us	20	20	100.00
V2	tl_d_outstanding_access	keymgr_csr_hw_reset	1.230s	35.826us	5	5	100.00
		keymgr_csr_rw	1.650s	128.984us	19	20	95.00
		keymgr_csr_aliasing	15.400s	2.104ms	5	5	100.00
		keymgr_same_csr_outstanding	4.140s	288.510us	20	20	100.00
V2	tl_d_partial_access	keymgr_csr_hw_reset	1.230s	35.826us	5	5	100.00
		keymgr_csr_rw	1.650s	128.984us	19	20	95.00
		keymgr_csr_aliasing	15.400s	2.104ms	5	5	100.00
		keymgr_same_csr_outstanding	4.140s	288.510us	20	20	100.00
V2		TOTAL			728	740	98.38
V2S	sec_cm_additional_check	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
V2S	tl_intg_err	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
		keymgr_tl_intg_err	13.220s	1.104ms	20	20	100.00
V2S	shadow_reg_update_error	keymgr_shadow_reg_errors	7.710s	1.287ms	20	20	100.00
V2S	shadow_reg_read_clear_staged_value	keymgr_shadow_reg_errors	7.710s	1.287ms	20	20	100.00
V2S	shadow_reg_storage_error	keymgr_shadow_reg_errors	7.710s	1.287ms	20	20	100.00
V2S	shadowed_reset_glitch	keymgr_shadow_reg_errors	7.710s	1.287ms	20	20	100.00
V2S	shadow_reg_update_error_with_csr_rw	keymgr_shadow_reg_errors_with_csr_rw	16.000s	1.934ms	20	20	100.00
V2S	prim_count_check	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
V2S	prim_fsm_check	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
V2S	sec_cm_bus_integrity	keymgr_tl_intg_err	13.220s	1.104ms	20	20	100.00
V2S	sec_cm_config_shadow	keymgr_shadow_reg_errors	7.710s	1.287ms	20	20	100.00
V2S	sec_cm_op_config_regwen	keymgr_cfg_regwen	2.148m	3.057ms	49	50	98.00
V2S	sec_cm_reseed_config_regwen	keymgr_random	1.864m	17.679ms	47	50	94.00
		keymgr_csr_rw	1.650s	128.984us	19	20	95.00
V2S	sec_cm_sw_binding_config_regwen	keymgr_random	1.864m	17.679ms	47	50	94.00
		keymgr_csr_rw	1.650s	128.984us	19	20	95.00
V2S	sec_cm_max_key_ver_config_regwen	keymgr_random	1.864m	17.679ms	47	50	94.00
		keymgr_csr_rw	1.650s	128.984us	19	20	95.00
V2S	sec_cm_lc_ctrl_intersig_mubi	keymgr_lc_disable	9.220s	767.097us	48	50	96.00
V2S	sec_cm_constants_consistency	keymgr_hwsw_invalid_input	1.110m	5.268ms	50	50	100.00
V2S	sec_cm_intersig_consistency	keymgr_hwsw_invalid_input	1.110m	5.268ms	50	50	100.00
V2S	sec_cm_hw_key_sw_noaccess	keymgr_random	1.864m	17.679ms	47	50	94.00
V2S	sec_cm_output_keys_ctrl_redun	keymgr_sideload_protect	22.960s	2.005ms	49	50	98.00
V2S	sec_cm_ctrl_fsm_sparse	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
V2S	sec_cm_data_fsm_sparse	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
V2S	sec_cm_ctrl_fsm_local_esc	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
V2S	sec_cm_ctrl_fsm_consistency	keymgr_custom_cm	42.320s	10.278ms	49	50	98.00
V2S	sec_cm_ctrl_fsm_global_esc	keymgr_lc_disable	9.220s	767.097us	48	50	96.00
V2S	sec_cm_ctrl_ctr_redun	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
V2S	sec_cm_kmac_if_fsm_sparse	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
V2S	sec_cm_kmac_if_ctr_redun	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
V2S	sec_cm_kmac_if_cmd_ctrl_consistency	keymgr_custom_cm	42.320s	10.278ms	49	50	98.00
V2S	sec_cm_kmac_if_done_ctrl_consistency	keymgr_custom_cm	42.320s	10.278ms	49	50	98.00
V2S	sec_cm_reseed_ctr_redun	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
V2S	sec_cm_side_load_sel_ctrl_consistency	keymgr_custom_cm	42.320s	10.278ms	49	50	98.00
V2S	sec_cm_sideload_ctrl_fsm_sparse	keymgr_sec_cm	37.960s	2.421ms	5	5	100.00
V2S	sec_cm_ctrl_key_integrity	keymgr_custom_cm	42.320s	10.278ms	49	50	98.00
V2S		TOTAL			163	165	98.79
V3	stress_all_with_rand_reset	keymgr_stress_all_with_rand_reset	25.480s	394.929us	49	50	98.00
V3		TOTAL			49	50	98.00
		TOTAL			1090	1110	98.20

Testplan Progress

Items	Total	Written	Passing	Progress
V1	7	7	4	57.14
V2	16	16	8	50.00
V2S	6	6	4	66.67
V3	1	1	0	0.00

Coverage Results

Coverage Dashboard

SCORE	LINE	COND	TOGGLE	FSM	BRANCH	ASSERT	GROUP
97.87	99.07	98.03	98.90	100.00	99.11	98.41	91.61

Failure Buckets

UVM_ERROR (keymgr_scoreboard.sv:1013) [scoreboard] Check failed act != exp (* [*] vs * [*]) cdi_type: Attestation has 4 failures:

Test keymgr_kmac_rsp_err has 4 failures.

25.keymgr_kmac_rsp_err.57639407932404625538607788175130093271167894976215519843936731129131301672705
Line 347, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/25.keymgr_kmac_rsp_err/latest/run.log

  UVM_ERROR @  46017704 ps: (keymgr_scoreboard.sv:1013) [uvm_test_top.env.scoreboard] Check failed act != exp (626889682523870677109530477264111567684425935578854336413849242179552822287607771672644822768482200231406855067890894686157011531495662760784750929494523612956904013420844762134248347870611997038043579266444263090499549024252561744131894800250818949143764237710979481562024494674625905349536875630840864563058153845544186323365949513046136802970807493170635495531691 [0x8e37f555000000003a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f960d913a93ba60afeb815055699ac41359c767db6e57a76a2af31e78fe7e350ca9f1c7aaf0f38c6b79035c17887a0b29d6a2f821f9cab414141fe1c5b18805726fda430b67a4cd5dd4480a979e7f561a122875750ebab5f0abe9816b93e98ec2ad5048b9c2bb21dda908caee5d6d964ab] vs 626889682523870677109530477264111567684425935578854336413849242179552822287607771672644822768482200231406855067890894686157011531495662760784750929494523612956904013420844762134248347870611997038043579266444263090499549024252561744131894800250818949143764237710979481562024494674625905349536875630840864563058153845544186323365949513046136802970807493170635495531691 [0x8e37f555000000003a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f960d913a93ba60afeb815055699ac41359c767db6e57a76a2af31e78fe7e350ca9f1c7aaf0f38c6b79035c17887a0b29d6a2f821f9cab414141fe1c5b18805726fda430b67a4cd5dd4480a979e7f561a122875750ebab5f0abe9816b93e98ec2ad5048b9c2bb21dda908caee5d6d964ab]) cdi_type: Attestation
  
   DiversificationKey act: 0x22875750ebab5f0abe9816b93e98ec2ad5048b9c2bb21dda908caee5d6d964ab, exp: 0x22875750ebab5f0abe9816b93e98ec2ad5048b9c2bb21dda908caee5d6d964ab
   RomDigest act: 0x6a2f821f9cab414141fe1c5b18805726fda430b67a4cd5dd4480a979e7f561a1, exp: 0x6a2f821f9cab414141fe1c5b18805726fda430b67a4cd5dd4480a979e7f561a1
   HealthMeasurement act: 0x9f1c7aaf0f38c6b79035c17887a0b29d, exp: 0x9f1c7aaf0f38c6b79035c17887a0b29d

26.keymgr_kmac_rsp_err.3464215760737856376762623818121749162331155652534882500838144381714112821784
Line 323, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/26.keymgr_kmac_rsp_err/latest/run.log

  UVM_ERROR @ 158706798 ps: (keymgr_scoreboard.sv:1013) [uvm_test_top.env.scoreboard] Check failed act != exp (2176703563415199074570828179642422245801706958568754793145499377226081619535235094585251282769000374572974797458753596254472351639371406170658170536205461244429556259460413504883647070893179952392235084733157881078263965134097180169271844204957341364719567132240750546518484509421150895717120115390091559732916174969480544372334971064955725251363124787047183282667493720242097020918419398311200365869174632417165768861909794 [0x4eab581c000000000000000000000000000000000000000000000000000000003a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9a626861fece083161d1f1175dab0eb6990c51647df45fd26c187d868805c0fa43204bd1386bbdea1b711acc91100e1a7551c09247c1e7160e0e14b20e551c8b5783683b2645d388164a7c50e2d7ab419eb45ffa78c4c84bcaec5d04b0b4ac6040a94b3ef361a4cb1da90221356178322] vs 2176703563415199074570828179642422245801706958568754793145499377226081619535235094585251282769000374572974797458753596254472351639371406170658170536205461244429556259460413504883647070893179952392235084733157881078263965134097180169271844204957341364719567132240750546518484509421150895717120115390091559732916174969480544372334971064955725251363124787047183282667493720242097020918419398311200365869174632417165768861909794 [0x4eab581c000000000000000000000000000000000000000000000000000000003a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9a626861fece083161d1f1175dab0eb6990c51647df45fd26c187d868805c0fa43204bd1386bbdea1b711acc91100e1a7551c09247c1e7160e0e14b20e551c8b5783683b2645d388164a7c50e2d7ab419eb45ffa78c4c84bcaec5d04b0b4ac6040a94b3ef361a4cb1da90221356178322]) cdi_type: Attestation
  
   DiversificationKey act: 0xeb45ffa78c4c84bcaec5d04b0b4ac6040a94b3ef361a4cb1da90221356178322, exp: 0xeb45ffa78c4c84bcaec5d04b0b4ac6040a94b3ef361a4cb1da90221356178322
   RomDigest act: 0x551c09247c1e7160e0e14b20e551c8b5783683b2645d388164a7c50e2d7ab419, exp: 0x551c09247c1e7160e0e14b20e551c8b5783683b2645d388164a7c50e2d7ab419
   HealthMeasurement act: 0x3204bd1386bbdea1b711acc91100e1a7, exp: 0x3204bd1386bbdea1b711acc91100e1a7

... and 2 more failures.

Job keymgr-sim-vcs_run_default killed due to: Exit reason: Error: * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *] has 3 failures:
- Test keymgr_sideload has 1 failures.
  - 2.keymgr_sideload.15684117056673608601928960606032544168577310391914199879085849681647680585855
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/2.keymgr_sideload/latest/run.log
```
  Job ID: smart:f826f697-87f5-466f-9c26-1f1f06897e8c
```
- Test keymgr_direct_to_disabled has 1 failures.
  - 5.keymgr_direct_to_disabled.60411826815293264327312049831010489557137180147617133936014546517331911259007
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/5.keymgr_direct_to_disabled/latest/run.log
```
  Job ID: smart:77b67736-3f65-4d7b-bc13-bf53ae589adf
```
- Test keymgr_sideload_aes has 1 failures.
  - 43.keymgr_sideload_aes.96584682743701829785520953210730643631520733568465309057888840419320480141477
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/43.keymgr_sideload_aes/latest/run.log
```
  Job ID: smart:a2cb8c56-0585-44d0-8e52-74c023216de7
```
Job keymgr-sim-vcs_run_default killed due to: Exit reason: Error: * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *] has 3 failures:
- Test keymgr_lc_disable has 1 failures.
  - 9.keymgr_lc_disable.12096054986297469362683158020773673812086105361361453199231104216541656607934
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/9.keymgr_lc_disable/latest/run.log
```
  Job ID: smart:c49cec48-20d2-4423-b692-9be7f20ef11a
```
- Test keymgr_sync_async_fault_cross has 1 failures.
  - 35.keymgr_sync_async_fault_cross.966165272784306486298548379041674656278086206312726215924005643063503758390
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/35.keymgr_sync_async_fault_cross/latest/run.log
```
  Job ID: smart:4cb74ac9-6005-44b2-8736-faa231c6550a
```
- Test keymgr_cfg_regwen has 1 failures.
  - 48.keymgr_cfg_regwen.25844715111780087193859298341467376426369017904474212497127418280383757593247
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/48.keymgr_cfg_regwen/latest/run.log
```
  Job ID: smart:9cb6f64e-fb1d-4541-b823-04314091484c
```
Job keymgr-sim-vcs_run_default killed due to: Exit reason: Error: * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *] has 2 failures:
- Test keymgr_sideload_kmac has 1 failures.
  - 7.keymgr_sideload_kmac.22130100181494887735735560056074262478375919255980823145127637756162259346456
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/7.keymgr_sideload_kmac/latest/run.log
```
  Job ID: smart:89fed040-3400-47e2-b443-1defb55713cc
```
- Test keymgr_random has 1 failures.
  - 13.keymgr_random.12034328228858347351874195600918638372193631111584881892379255797290646201555
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/13.keymgr_random/latest/run.log
```
  Job ID: smart:835bc5e6-931e-42c5-bafd-d49f816cf01e
```
Job keymgr-sim-vcs_run_default killed due to: Exit reason: Error: * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *] has 2 failures:
- Test keymgr_random has 2 failures.
  - 11.keymgr_random.80762149369507158713387372029736047520918189195855988250722477623789679195087
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/11.keymgr_random/latest/run.log
```
  Job ID: smart:f78d0810-226c-4293-8fec-67a1b35edd65
```
  - 40.keymgr_random.52551992301255333378700030237099959735214283543080203814004641277231620646385
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/40.keymgr_random/latest/run.log
```
  Job ID: smart:6407bad4-7034-4624-9093-9cc760f3b938
```
UVM_FATAL (keymgr_custom_cm_vseq.sv:81) [keymgr_custom_cm_vseq] wait timeout occurred! has 1 failures:
- Test keymgr_custom_cm has 1 failures.
  - 1.keymgr_custom_cm.17764583465294569677982068437885681622333514349992352747177442384072395273541
    Line 430, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/1.keymgr_custom_cm/latest/run.log
```
  UVM_FATAL @ 10277638721 ps: (keymgr_custom_cm_vseq.sv:81) [uvm_test_top.env.virtual_sequencer.keymgr_custom_cm_vseq] wait timeout occurred!
  UVM_INFO @ 10277638721 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Job keymgr-sim-vcs_run_cover_reg_top killed due to: Exit reason: Error: * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *] has 1 failures:
- Test keymgr_csr_rw has 1 failures.
  - 13.keymgr_csr_rw.52745129781625796968624447185798594658199066179355099415890686208254061370941
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/13.keymgr_csr_rw/latest/run.log
```
  Job ID: smart:1ce8f52f-1fe2-4616-9359-2435f99588ff
```
Job keymgr-sim-vcs_run_default killed due to: Exit reason: Error: * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *] has 1 failures:
- Test keymgr_smoke has 1 failures.
  - 31.keymgr_smoke.68038347921608469745192163100195544698215966215072230223439661637733309450570
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/31.keymgr_smoke/latest/run.log
```
  Job ID: smart:f0e519ce-0c76-49e1-8171-53809d71d296
```
Job keymgr-sim-vcs_run_default killed due to: Exit reason: Error: * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *] has 1 failures:
- Test keymgr_sideload_protect has 1 failures.
  - 37.keymgr_sideload_protect.109475732764864763965952376881480179005304070252856655420367308024661697506878
    Log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/37.keymgr_sideload_protect/latest/run.log
```
  Job ID: smart:3c43d8af-36fe-4803-928a-e80efe53447b
```
UVM_ERROR (keymgr_scoreboard.sv:736) [scoreboard] Check failed item.d_data !=gmv(csr) (* [] vs * [])` has 1 failures:
- Test keymgr_stress_all_with_rand_reset has 1 failures.
  - 38.keymgr_stress_all_with_rand_reset.99136780220204584729809282576718763430491009175568944080254662557981965399005
    Line 663, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/38.keymgr_stress_all_with_rand_reset/latest/run.log
```
  UVM_ERROR @ 200279481 ps: (keymgr_scoreboard.sv:736) [uvm_test_top.env.scoreboard] Check failed item.d_data != `gmv(csr) (693108107 [0x294ffd8b] vs 693108107 [0x294ffd8b])
  UVM_INFO @ 200279481 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (keymgr_scoreboard.sv:674) [scoreboard] Check failed item.d_data == addr_phase_op_status (* [*] vs * [*]) has 1 failures:
- Test keymgr_lc_disable has 1 failures.
  - 48.keymgr_lc_disable.63564133060360273254724207650598659227299385970912030337568476159433109944133
    Line 613, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/48.keymgr_lc_disable/latest/run.log
```
  UVM_ERROR @  24828828 ps: (keymgr_scoreboard.sv:674) [uvm_test_top.env.scoreboard] Check failed item.d_data == addr_phase_op_status (2 [0x2] vs 3 [0x3])
  UVM_INFO @  24828828 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```