KEYMGR Simulation Results

Thursday May 25 2023 07:02:34 UTC

GitHub Revision: `94eb0df12`

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 77475240

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	keymgr_smoke	38.310s	3.746ms	50	50	100.00
V1	random	keymgr_random	1.552m	9.559ms	50	50	100.00
V1	csr_hw_reset	keymgr_csr_hw_reset	1.360s	54.341us	5	5	100.00
V1	csr_rw	keymgr_csr_rw	1.630s	125.962us	20	20	100.00
V1	csr_bit_bash	keymgr_csr_bit_bash	25.610s	5.118ms	5	5	100.00
V1	csr_aliasing	keymgr_csr_aliasing	8.620s	253.383us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	keymgr_csr_mem_rw_with_rand_reset	1.670s	172.065us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	keymgr_csr_rw	1.630s	125.962us	20	20	100.00
		keymgr_csr_aliasing	8.620s	253.383us	5	5	100.00
V1		TOTAL			155	155	100.00
V2	cfgen_during_op	keymgr_cfg_regwen	2.031m	2.272ms	50	50	100.00
V2	sideload	keymgr_sideload	26.100s	1.657ms	50	50	100.00
		keymgr_sideload_kmac	45.040s	3.348ms	50	50	100.00
		keymgr_sideload_aes	1.318m	32.266ms	50	50	100.00
		keymgr_sideload_otbn	45.160s	1.950ms	50	50	100.00
V2	direct_to_disabled_state	keymgr_direct_to_disabled	43.180s	5.079ms	50	50	100.00
V2	lc_disable	keymgr_lc_disable	26.130s	575.579us	50	50	100.00
V2	kmac_error_response	keymgr_kmac_rsp_err	1.267m	24.373ms	42	50	84.00
V2	invalid_sw_input	keymgr_sw_invalid_input	1.228m	14.420ms	50	50	100.00
V2	invalid_hw_input	keymgr_hwsw_invalid_input	28.980s	5.502ms	50	50	100.00
V2	sync_async_fault_cross	keymgr_sync_async_fault_cross	19.700s	956.071us	49	50	98.00
V2	stress_all	keymgr_stress_all	7.024m	21.403ms	49	50	98.00
V2	intr_test	keymgr_intr_test	0.930s	14.353us	50	50	100.00
V2	alert_test	keymgr_alert_test	1.010s	13.045us	50	50	100.00
V2	tl_d_oob_addr_access	keymgr_tl_errors	4.880s	188.997us	20	20	100.00
V2	tl_d_illegal_access	keymgr_tl_errors	4.880s	188.997us	20	20	100.00
V2	tl_d_outstanding_access	keymgr_csr_hw_reset	1.360s	54.341us	5	5	100.00
		keymgr_csr_rw	1.630s	125.962us	20	20	100.00
		keymgr_csr_aliasing	8.620s	253.383us	5	5	100.00
		keymgr_same_csr_outstanding	4.370s	445.837us	20	20	100.00
V2	tl_d_partial_access	keymgr_csr_hw_reset	1.360s	54.341us	5	5	100.00
		keymgr_csr_rw	1.630s	125.962us	20	20	100.00
		keymgr_csr_aliasing	8.620s	253.383us	5	5	100.00
		keymgr_same_csr_outstanding	4.370s	445.837us	20	20	100.00
V2		TOTAL			730	740	98.65
V2S	sec_cm_additional_check	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
V2S	tl_intg_err	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
		keymgr_tl_intg_err	58.310s	1.993ms	20	20	100.00
V2S	shadow_reg_update_error	keymgr_shadow_reg_errors	12.090s	2.441ms	20	20	100.00
V2S	shadow_reg_read_clear_staged_value	keymgr_shadow_reg_errors	12.090s	2.441ms	20	20	100.00
V2S	shadow_reg_storage_error	keymgr_shadow_reg_errors	12.090s	2.441ms	20	20	100.00
V2S	shadowed_reset_glitch	keymgr_shadow_reg_errors	12.090s	2.441ms	20	20	100.00
V2S	shadow_reg_update_error_with_csr_rw	keymgr_shadow_reg_errors_with_csr_rw	17.400s	951.560us	20	20	100.00
V2S	prim_count_check	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
V2S	prim_fsm_check	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
V2S	sec_cm_bus_integrity	keymgr_tl_intg_err	58.310s	1.993ms	20	20	100.00
V2S	sec_cm_config_shadow	keymgr_shadow_reg_errors	12.090s	2.441ms	20	20	100.00
V2S	sec_cm_op_config_regwen	keymgr_cfg_regwen	2.031m	2.272ms	50	50	100.00
V2S	sec_cm_reseed_config_regwen	keymgr_random	1.552m	9.559ms	50	50	100.00
		keymgr_csr_rw	1.630s	125.962us	20	20	100.00
V2S	sec_cm_sw_binding_config_regwen	keymgr_random	1.552m	9.559ms	50	50	100.00
		keymgr_csr_rw	1.630s	125.962us	20	20	100.00
V2S	sec_cm_max_key_ver_config_regwen	keymgr_random	1.552m	9.559ms	50	50	100.00
		keymgr_csr_rw	1.630s	125.962us	20	20	100.00
V2S	sec_cm_lc_ctrl_intersig_mubi	keymgr_lc_disable	26.130s	575.579us	50	50	100.00
V2S	sec_cm_constants_consistency	keymgr_hwsw_invalid_input	28.980s	5.502ms	50	50	100.00
V2S	sec_cm_intersig_consistency	keymgr_hwsw_invalid_input	28.980s	5.502ms	50	50	100.00
V2S	sec_cm_hw_key_sw_noaccess	keymgr_random	1.552m	9.559ms	50	50	100.00
V2S	sec_cm_output_keys_ctrl_redun	keymgr_sideload_protect	32.050s	5.307ms	50	50	100.00
V2S	sec_cm_ctrl_fsm_sparse	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
V2S	sec_cm_data_fsm_sparse	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
V2S	sec_cm_ctrl_fsm_local_esc	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
V2S	sec_cm_ctrl_fsm_consistency	keymgr_custom_cm	37.190s	2.296ms	50	50	100.00
V2S	sec_cm_ctrl_fsm_global_esc	keymgr_lc_disable	26.130s	575.579us	50	50	100.00
V2S	sec_cm_ctrl_ctr_redun	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
V2S	sec_cm_kmac_if_fsm_sparse	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
V2S	sec_cm_kmac_if_ctr_redun	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
V2S	sec_cm_kmac_if_cmd_ctrl_consistency	keymgr_custom_cm	37.190s	2.296ms	50	50	100.00
V2S	sec_cm_kmac_if_done_ctrl_consistency	keymgr_custom_cm	37.190s	2.296ms	50	50	100.00
V2S	sec_cm_reseed_ctr_redun	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
V2S	sec_cm_side_load_sel_ctrl_consistency	keymgr_custom_cm	37.190s	2.296ms	50	50	100.00
V2S	sec_cm_sideload_ctrl_fsm_sparse	keymgr_sec_cm	2.770m	12.000ms	5	5	100.00
V2S	sec_cm_ctrl_key_integrity	keymgr_custom_cm	37.190s	2.296ms	50	50	100.00
V2S		TOTAL			165	165	100.00
V3	stress_all_with_rand_reset	keymgr_stress_all_with_rand_reset	12.770s	364.741us	44	50	88.00
V3		TOTAL			44	50	88.00
		TOTAL			1094	1110	98.56

Testplan Progress

Items	Total	Written	Passing	Progress
V1	7	7	7	100.00
V2	16	16	13	81.25
V2S	6	6	6	100.00
V3	1	1	0	0.00

Coverage Results

Coverage Dashboard

SCORE	LINE	COND	TOGGLE	FSM	BRANCH	ASSERT	GROUP
97.87	99.09	98.17	98.70	100.00	99.17	98.38	91.58

Failure Buckets

UVM_ERROR (keymgr_scoreboard.sv:1012) [scoreboard] Check failed act != exp (* [*] vs * [*]) cdi_type: Attestation has 8 failures:

Test keymgr_kmac_rsp_err has 8 failures.

0.keymgr_kmac_rsp_err.2021712108
Line 292, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/0.keymgr_kmac_rsp_err/latest/run.log

  UVM_ERROR @  35800039 ps: (keymgr_scoreboard.sv:1012) [uvm_test_top.env.scoreboard] Check failed act != exp (159564949454153719834127020261221515839170764152322834608785072593468467044530465513330537000849053852466575528604071907341785385605615895604027338072507518931388703143884310051511658916463858005856910109525674138830894462670786991334806356431895065456795261143253782666728589163392980958470641078617929803343588007011587739034977629346281207194069244918588467833839163736349657775954567767638598915254953 [0x6a617cc000000000bff47fdfbb3b899ebbe1f0ff000000003a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9dcce0f0176e5d43b85f75ab1a68dc007a42c018199efbae78a212bece695155208c6db4ccadcc1a1ac4d5ecf83d86d75e35f42f12ecff89c8e36ee3ae5b63d42981bf2563a85cc8b8f3e3faa23dcb30b4dabdd87f04b120230291a6f3c951389e8b555c13baa45c4dc0c8bff81f4eaa9] vs 159564949454153719834127020261221515839170764152322834608785072593468467044530465513330537000849053852466575528604071907341785385605615895604027338072507518931388703143884310051511658916463858005856910109525674138830894462670786991334806356431895065456795261143253782666728589163392980958470641078617929803343588007011587739034977629346281207194069244918588467833839163736349657775954567767638598915254953 [0x6a617cc000000000bff47fdfbb3b899ebbe1f0ff000000003a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9dcce0f0176e5d43b85f75ab1a68dc007a42c018199efbae78a212bece695155208c6db4ccadcc1a1ac4d5ecf83d86d75e35f42f12ecff89c8e36ee3ae5b63d42981bf2563a85cc8b8f3e3faa23dcb30b4dabdd87f04b120230291a6f3c951389e8b555c13baa45c4dc0c8bff81f4eaa9]) cdi_type: Attestation
  
   DiversificationKey act: 0x4dabdd87f04b120230291a6f3c951389e8b555c13baa45c4dc0c8bff81f4eaa9, exp: 0x4dabdd87f04b120230291a6f3c951389e8b555c13baa45c4dc0c8bff81f4eaa9
   RomDigest act: 0xe35f42f12ecff89c8e36ee3ae5b63d42981bf2563a85cc8b8f3e3faa23dcb30b, exp: 0xe35f42f12ecff89c8e36ee3ae5b63d42981bf2563a85cc8b8f3e3faa23dcb30b
   HealthMeasurement act: 0x8c6db4ccadcc1a1ac4d5ecf83d86d75, exp: 0x8c6db4ccadcc1a1ac4d5ecf83d86d75

5.keymgr_kmac_rsp_err.2258483120
Line 256, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/5.keymgr_kmac_rsp_err/latest/run.log

  UVM_ERROR @ 276600272 ps: (keymgr_scoreboard.sv:1012) [uvm_test_top.env.scoreboard] Check failed act != exp (13869088684237589750254652523805745455607483863801036890679746459828093165537687795542928075837282548214259551422873584811075124309826772454605564873868337771475777393856249097876061635314797180338771836464964751504555046984344533756952599325900646553367125754295965825634818974342968939584673520964258401215821295395155153646865803324970174763994 [0x3a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f91eb4d71e9ed84a103f5b9d27aee9c0a1981ccc557c34b60581b62a799e998582cf5cd1db48e5f0911ec29dd0eab2cabe3714ad6e84ba7e332fce147ef2040f00b0227f20ed4cb0ecd2d429e743f0613a540c337faee836c92cb08de01577bd9fa02db57f04a077d0d48519d2b01bd3da] vs 13869088684237589750254652523805745455607483863801036890679746459828093165537687795542928075837282548214259551422873584811075124309826772454605564873868337771475777393856249097876061635314797180338771836464964751504555046984344533756952599325900646553367125754295965825634818974342968939584673520964258401215821295395155153646865803324970174763994 [0x3a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f91eb4d71e9ed84a103f5b9d27aee9c0a1981ccc557c34b60581b62a799e998582cf5cd1db48e5f0911ec29dd0eab2cabe3714ad6e84ba7e332fce147ef2040f00b0227f20ed4cb0ecd2d429e743f0613a540c337faee836c92cb08de01577bd9fa02db57f04a077d0d48519d2b01bd3da]) cdi_type: Attestation
  
   DiversificationKey act: 0x540c337faee836c92cb08de01577bd9fa02db57f04a077d0d48519d2b01bd3da, exp: 0x540c337faee836c92cb08de01577bd9fa02db57f04a077d0d48519d2b01bd3da
   RomDigest act: 0x3714ad6e84ba7e332fce147ef2040f00b0227f20ed4cb0ecd2d429e743f0613a, exp: 0x3714ad6e84ba7e332fce147ef2040f00b0227f20ed4cb0ecd2d429e743f0613a
   HealthMeasurement act: 0xcf5cd1db48e5f0911ec29dd0eab2cabe, exp: 0xcf5cd1db48e5f0911ec29dd0eab2cabe

... and 6 more failures.

UVM_ERROR (keymgr_scoreboard.sv:1010) [scoreboard] Check failed act == exp (* [*] vs * [*]) cdi_type: Attestation has 2 failures:

Test keymgr_stress_all_with_rand_reset has 2 failures.

12.keymgr_stress_all_with_rand_reset.3659588926
Line 1004, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/12.keymgr_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @ 204350009 ps: (keymgr_scoreboard.sv:1010) [uvm_test_top.env.scoreboard] Check failed act == exp (6507773677106675786473217355048097168516538779110811380716954487599668883678985396794495077575043955139319226689796508980806235370742949045604791374323258535449867740625265308435181171761951737267614803994905599878104397356628640696169786721495228848811547370984715155481275615183578668560944355922629500601255892341297230909448985835709097102326456444137301255360038788605955416070864619739087758818395081457909046280055672 [0xeb335d937bb99a3566711fc07493623ba879b05be05f740c0015d1da21e459b73a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9000000000000000000000000000000000000000000000000000000000000f0f000000000000000005cfbd765ce33f34ea20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507fa365df52da48cd752fb3a026a8e608f0098cfe5fa9810494829d0cd9479eb78] vs 2883205183659738311305383877907678450162289764490385050420903134151472519709121640739609748789039115225510289772801869632714659742685964449752798463791954161518093630588215940531842805014557620049689399306762333846716492352537752062011706896172702631768310932879037218856954821770437572833247566617582729867717225539780490582763327556218891924004253056831890520686593435747671827150041598439875647109530307822303762466859896 [0x68340dcabec7758ec68a93f6f136041a7b1601241920a8ea84822a92295a8b623a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9000000000000000000000000000000000000000000000000000000000000f0f000000000000000005cfbd765ce33f34ea20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507fa365df52da48cd752fb3a026a8e608f0098cfe5fa9810494829d0cd9479eb78]) cdi_type: Attestation
  
   DiversificationKey act: 0xfa365df52da48cd752fb3a026a8e608f0098cfe5fa9810494829d0cd9479eb78, exp: 0xfa365df52da48cd752fb3a026a8e608f0098cfe5fa9810494829d0cd9479eb78
   RomDigest act: 0xa20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507, exp: 0xa20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507
   HealthMeasurement act: 0x5cfbd765ce33f34e, exp: 0x5cfbd765ce33f34e

45.keymgr_stress_all_with_rand_reset.4032521773
Line 755, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/45.keymgr_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @  50375223 ps: (keymgr_scoreboard.sv:1010) [uvm_test_top.env.scoreboard] Check failed act == exp (230515726796195607976373771611524391545664763078238207582970060660963679851745391261513434384439742012960809862256620221993896006187592711291626016310451250649735514160404364138933550505040798947286881329398174140459404008927360443953060922208850484648858287652508415932228445864387152438847122234796118266897945843596954147750110931506276302258533553578266564350089320638845324350022878898232019092883768468377421346458343 [0x854c85ab9d2cf8f839ecbf77b0c4bc3aea8166d18e31f3d672162d526511ef73a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9f02c465eb6890258afa1933897309f2f539eaf54be51386e050686b03a46cd8c63fe92531b581e0dad8e4ffe9eba8533fcd6d2d722f9484d0e2225978b88d6018488f7d8c35b473d2b2e21bc88adbc0dedcf603b654b2ab2099a4e1b338ac85d1f330bb76c4be77841d0ce669e0b4ae7] vs 6451160972131786516431696367248625121573009843895812181012616964474958447810662179181442118798682687281040250918165836110987723168938307183455482465704901012364674007873747650853247197087929794966999649488186428151750384555691402847803002792026304136993450061068172642685576038870037047060362105322065702417926407775672447275599895853408456348661618744869132868424780417214670463351784001217550458258188463606853352066599655 [0xe927927d8afdd0d3efaaf175d0dabcc4f3af3b6a13888af20b9ba0581bafc2543a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9f02c465eb6890258afa1933897309f2f539eaf54be51386e050686b03a46cd8c63fe92531b581e0dad8e4ffe9eba8533fcd6d2d722f9484d0e2225978b88d6018488f7d8c35b473d2b2e21bc88adbc0dedcf603b654b2ab2099a4e1b338ac85d1f330bb76c4be77841d0ce669e0b4ae7]) cdi_type: Attestation
  
   DiversificationKey act: 0xedcf603b654b2ab2099a4e1b338ac85d1f330bb76c4be77841d0ce669e0b4ae7, exp: 0xedcf603b654b2ab2099a4e1b338ac85d1f330bb76c4be77841d0ce669e0b4ae7
   RomDigest act: 0xfcd6d2d722f9484d0e2225978b88d6018488f7d8c35b473d2b2e21bc88adbc0d, exp: 0xfcd6d2d722f9484d0e2225978b88d6018488f7d8c35b473d2b2e21bc88adbc0d
   HealthMeasurement act: 0x63fe92531b581e0dad8e4ffe9eba8533, exp: 0x63fe92531b581e0dad8e4ffe9eba8533

UVM_ERROR (cip_base_scoreboard.sv:281) scoreboard [scoreboard] alert recov_operation_err did not trigger max_delay:* has 1 failures:
- Test keymgr_stress_all has 1 failures.
  - 14.keymgr_stress_all.3753440616
    Line 597, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/14.keymgr_stress_all/latest/run.log
```
  UVM_ERROR @  51898033 ps: (cip_base_scoreboard.sv:281) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_operation_err did not trigger max_delay:0
  UVM_INFO @  51898033 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (keymgr_scoreboard.sv:136) [scoreboard] Check failed current_op_status == keymgr_pkg::OpWip (* [*] vs * [*]) has 1 failures:
- Test keymgr_stress_all_with_rand_reset has 1 failures.
  - 14.keymgr_stress_all_with_rand_reset.2211786204
    Line 473, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/14.keymgr_stress_all_with_rand_reset/latest/run.log
```
  UVM_ERROR @ 197599903 ps: (keymgr_scoreboard.sv:136) [uvm_test_top.env.scoreboard] Check failed current_op_status == keymgr_pkg::OpWip (2 [0x2] vs 1 [0x1])
  UVM_INFO @ 197599903 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (keymgr_scoreboard.sv:736) [scoreboard] Check failed item.d_data !=gmv(csr) (* [] vs * [])` has 1 failures:
- Test keymgr_stress_all_with_rand_reset has 1 failures.
  - 15.keymgr_stress_all_with_rand_reset.336325171
    Line 1164, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/15.keymgr_stress_all_with_rand_reset/latest/run.log
```
  UVM_ERROR @ 806104169 ps: (keymgr_scoreboard.sv:736) [uvm_test_top.env.scoreboard] Check failed item.d_data != `gmv(csr) (2262675402 [0x86ddafca] vs 2262675402 [0x86ddafca])
  UVM_INFO @ 806104169 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (cip_base_scoreboard.sv:241) scoreboard [scoreboard] alert recov_operation_err is not received! has 1 failures:
- Test keymgr_sync_async_fault_cross has 1 failures.
  - 20.keymgr_sync_async_fault_cross.587127837
    Line 309, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/20.keymgr_sync_async_fault_cross/latest/run.log
```
  UVM_ERROR @ 318341594 ps: (cip_base_scoreboard.sv:241) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_operation_err is not received!
  UVM_INFO @ 318341594 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (keymgr_scoreboard.sv:750) [scoreboard] Check failed item.d_data ==gmv(csr) (* [] vs * []) reg name: keymgr_reg_block.sw_binding_regwen` has 1 failures:
- Test keymgr_stress_all_with_rand_reset has 1 failures.
  - 27.keymgr_stress_all_with_rand_reset.1814755463
    Line 1012, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/27.keymgr_stress_all_with_rand_reset/latest/run.log
```
  UVM_ERROR @ 389536362 ps: (keymgr_scoreboard.sv:750) [uvm_test_top.env.scoreboard] Check failed item.d_data == `gmv(csr) (0 [0x0] vs 1 [0x1]) reg name: keymgr_reg_block.sw_binding_regwen
  UVM_INFO @ 389536362 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (keymgr_scoreboard.sv:674) [scoreboard] Check failed item.d_data == addr_phase_op_status (* [*] vs * [*]) has 1 failures:
- Test keymgr_stress_all_with_rand_reset has 1 failures.
  - 36.keymgr_stress_all_with_rand_reset.2656330183
    Line 838, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/36.keymgr_stress_all_with_rand_reset/latest/run.log
```
  UVM_ERROR @  99717052 ps: (keymgr_scoreboard.sv:674) [uvm_test_top.env.scoreboard] Check failed item.d_data == addr_phase_op_status (1 [0x1] vs 2 [0x2])
  UVM_INFO @  99717052 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```