KEYMGR Simulation Results

Saturday May 11 2024 19:02:11 UTC

GitHub Revision: `d3914e529e`

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 2197522926

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	keymgr_smoke	39.660s	1.429ms	50	50	100.00
V1	random	keymgr_random	49.210s	8.708ms	50	50	100.00
V1	csr_hw_reset	keymgr_csr_hw_reset	1.830s	101.570us	5	5	100.00
V1	csr_rw	keymgr_csr_rw	1.310s	94.782us	17	20	85.00
V1	csr_bit_bash	keymgr_csr_bit_bash	25.260s	6.114ms	4	5	80.00
V1	csr_aliasing	keymgr_csr_aliasing	9.370s	531.219us	3	5	60.00
V1	csr_mem_rw_with_rand_reset	keymgr_csr_mem_rw_with_rand_reset	2.020s	52.145us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	keymgr_csr_rw	1.310s	94.782us	17	20	85.00
		keymgr_csr_aliasing	9.370s	531.219us	3	5	60.00
V1		TOTAL			149	155	96.13
V2	cfgen_during_op	keymgr_cfg_regwen	2.244m	5.058ms	50	50	100.00
V2	sideload	keymgr_sideload	53.280s	3.851ms	50	50	100.00
		keymgr_sideload_kmac	1.374m	45.710ms	50	50	100.00
		keymgr_sideload_aes	1.169m	3.545ms	50	50	100.00
		keymgr_sideload_otbn	1.348m	8.187ms	50	50	100.00
V2	direct_to_disabled_state	keymgr_direct_to_disabled	23.370s	2.347ms	50	50	100.00
V2	lc_disable	keymgr_lc_disable	6.500s	794.908us	49	50	98.00
V2	kmac_error_response	keymgr_kmac_rsp_err	1.310m	2.401ms	46	50	92.00
V2	invalid_sw_input	keymgr_sw_invalid_input	2.048m	35.219ms	50	50	100.00
V2	invalid_hw_input	keymgr_hwsw_invalid_input	1.818m	11.394ms	50	50	100.00
V2	sync_async_fault_cross	keymgr_sync_async_fault_cross	33.040s	2.086ms	49	50	98.00
V2	stress_all	keymgr_stress_all	5.702m	20.712ms	49	50	98.00
V2	intr_test	keymgr_intr_test	0.920s	142.552us	50	50	100.00
V2	alert_test	keymgr_alert_test	1.050s	22.061us	50	50	100.00
V2	tl_d_oob_addr_access	keymgr_tl_errors	6.500s	691.876us	20	20	100.00
V2	tl_d_illegal_access	keymgr_tl_errors	6.500s	691.876us	20	20	100.00
V2	tl_d_outstanding_access	keymgr_csr_hw_reset	1.830s	101.570us	5	5	100.00
		keymgr_csr_rw	1.310s	94.782us	17	20	85.00
		keymgr_csr_aliasing	9.370s	531.219us	3	5	60.00
		keymgr_same_csr_outstanding	2.610s	35.234us	16	20	80.00
V2	tl_d_partial_access	keymgr_csr_hw_reset	1.830s	101.570us	5	5	100.00
		keymgr_csr_rw	1.310s	94.782us	17	20	85.00
		keymgr_csr_aliasing	9.370s	531.219us	3	5	60.00
		keymgr_same_csr_outstanding	2.610s	35.234us	16	20	80.00
V2		TOTAL			729	740	98.51
V2S	sec_cm_additional_check	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
V2S	tl_intg_err	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
		keymgr_tl_intg_err	57.300s	6.180ms	16	20	80.00
V2S	shadow_reg_update_error	keymgr_shadow_reg_errors	6.460s	207.650us	20	20	100.00
V2S	shadow_reg_read_clear_staged_value	keymgr_shadow_reg_errors	6.460s	207.650us	20	20	100.00
V2S	shadow_reg_storage_error	keymgr_shadow_reg_errors	6.460s	207.650us	20	20	100.00
V2S	shadowed_reset_glitch	keymgr_shadow_reg_errors	6.460s	207.650us	20	20	100.00
V2S	shadow_reg_update_error_with_csr_rw	keymgr_shadow_reg_errors_with_csr_rw	18.100s	641.369us	17	20	85.00
V2S	prim_count_check	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
V2S	prim_fsm_check	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
V2S	sec_cm_bus_integrity	keymgr_tl_intg_err	57.300s	6.180ms	16	20	80.00
V2S	sec_cm_config_shadow	keymgr_shadow_reg_errors	6.460s	207.650us	20	20	100.00
V2S	sec_cm_op_config_regwen	keymgr_cfg_regwen	2.244m	5.058ms	50	50	100.00
V2S	sec_cm_reseed_config_regwen	keymgr_random	49.210s	8.708ms	50	50	100.00
		keymgr_csr_rw	1.310s	94.782us	17	20	85.00
V2S	sec_cm_sw_binding_config_regwen	keymgr_random	49.210s	8.708ms	50	50	100.00
		keymgr_csr_rw	1.310s	94.782us	17	20	85.00
V2S	sec_cm_max_key_ver_config_regwen	keymgr_random	49.210s	8.708ms	50	50	100.00
		keymgr_csr_rw	1.310s	94.782us	17	20	85.00
V2S	sec_cm_lc_ctrl_intersig_mubi	keymgr_lc_disable	6.500s	794.908us	49	50	98.00
V2S	sec_cm_constants_consistency	keymgr_hwsw_invalid_input	1.818m	11.394ms	50	50	100.00
V2S	sec_cm_intersig_consistency	keymgr_hwsw_invalid_input	1.818m	11.394ms	50	50	100.00
V2S	sec_cm_hw_key_sw_noaccess	keymgr_random	49.210s	8.708ms	50	50	100.00
V2S	sec_cm_output_keys_ctrl_redun	keymgr_sideload_protect	21.990s	7.023ms	50	50	100.00
V2S	sec_cm_ctrl_fsm_sparse	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
V2S	sec_cm_data_fsm_sparse	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
V2S	sec_cm_ctrl_fsm_local_esc	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
V2S	sec_cm_ctrl_fsm_consistency	keymgr_custom_cm	35.090s	1.033ms	50	50	100.00
V2S	sec_cm_ctrl_fsm_global_esc	keymgr_lc_disable	6.500s	794.908us	49	50	98.00
V2S	sec_cm_ctrl_ctr_redun	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
V2S	sec_cm_kmac_if_fsm_sparse	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
V2S	sec_cm_kmac_if_ctr_redun	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
V2S	sec_cm_kmac_if_cmd_ctrl_consistency	keymgr_custom_cm	35.090s	1.033ms	50	50	100.00
V2S	sec_cm_kmac_if_done_ctrl_consistency	keymgr_custom_cm	35.090s	1.033ms	50	50	100.00
V2S	sec_cm_reseed_ctr_redun	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
V2S	sec_cm_side_load_sel_ctrl_consistency	keymgr_custom_cm	35.090s	1.033ms	50	50	100.00
V2S	sec_cm_sideload_ctrl_fsm_sparse	keymgr_sec_cm	1.200m	3.959ms	5	5	100.00
V2S	sec_cm_ctrl_key_integrity	keymgr_custom_cm	35.090s	1.033ms	50	50	100.00
V2S		TOTAL			158	165	95.76
V3	stress_all_with_rand_reset	keymgr_stress_all_with_rand_reset	13.540s	1.327ms	40	50	80.00
V3		TOTAL			40	50	80.00
		TOTAL			1076	1110	96.94

Testplan Progress

Items	Total	Written	Passing	Progress
V1	7	7	4	57.14
V2	16	16	11	68.75
V2S	6	6	4	66.67
V3	1	1	0	0.00

Coverage Results

Coverage Dashboard

SCORE	LINE	COND	TOGGLE	FSM	BRANCH	ASSERT	GROUP
97.81	99.10	98.07	98.42	100.00	99.11	98.41	91.54

Failure Buckets

Offending '(d2h.d_error || ((d2h.d_data & *) == (exp_vals[*] & *)))' has 17 failures:

Test keymgr_shadow_reg_errors_with_csr_rw has 3 failures.

0.keymgr_shadow_reg_errors_with_csr_rw.2673187329
Line 261, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/0.keymgr_shadow_reg_errors_with_csr_rw/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[11] & 'hffffffff)))'
  UVM_ERROR @ 417162922 ps: (keymgr_csr_assert_fpv.sv:396) [ASSERT FAILED] sealing_sw_binding_6_rd_A
  UVM_INFO @ 417162922 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

4.keymgr_shadow_reg_errors_with_csr_rw.1995317236
Line 255, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/4.keymgr_shadow_reg_errors_with_csr_rw/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[10] & 'hffffffff)))'
  UVM_ERROR @  44481448 ps: (keymgr_csr_assert_fpv.sv:391) [ASSERT FAILED] sealing_sw_binding_5_rd_A
  UVM_INFO @  44481448 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 1 more failures.

Test keymgr_csr_bit_bash has 1 failures.

0.keymgr_csr_bit_bash.130402472
Line 254, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/0.keymgr_csr_bit_bash/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[19] & 'hffffffff)))'
  UVM_ERROR @ 2869412739 ps: (keymgr_csr_assert_fpv.sv:436) [ASSERT FAILED] attest_sw_binding_6_rd_A
  UVM_INFO @ 2869412739 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Test keymgr_csr_aliasing has 2 failures.

0.keymgr_csr_aliasing.2763046243
Line 255, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/0.keymgr_csr_aliasing/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[6] & 'hffffffff)))'
  UVM_ERROR @ 864961857 ps: (keymgr_csr_assert_fpv.sv:371) [ASSERT FAILED] sealing_sw_binding_1_rd_A
  UVM_INFO @ 864961857 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

1.keymgr_csr_aliasing.2594351693
Line 255, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/1.keymgr_csr_aliasing/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[5] & 'hffffffff)))'
  UVM_ERROR @ 263701840 ps: (keymgr_csr_assert_fpv.sv:366) [ASSERT FAILED] sealing_sw_binding_0_rd_A
  UVM_INFO @ 263701840 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Test keymgr_tl_intg_err has 4 failures.

1.keymgr_tl_intg_err.2385600289
Line 257, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/1.keymgr_tl_intg_err/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[19] & 'hffffffff)))'
  UVM_ERROR @   7088422 ps: (keymgr_csr_assert_fpv.sv:436) [ASSERT FAILED] attest_sw_binding_6_rd_A
  UVM_INFO @   7088422 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

4.keymgr_tl_intg_err.1966574336
Line 281, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/4.keymgr_tl_intg_err/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[12] & 'hffffffff)))'
  UVM_ERROR @ 242186423 ps: (keymgr_csr_assert_fpv.sv:401) [ASSERT FAILED] sealing_sw_binding_7_rd_A
  UVM_INFO @ 242186423 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 2 more failures.

Test keymgr_same_csr_outstanding has 4 failures.

4.keymgr_same_csr_outstanding.1645254857
Line 255, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/4.keymgr_same_csr_outstanding/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[9] & 'hffffffff)))'
  UVM_ERROR @ 179270596 ps: (keymgr_csr_assert_fpv.sv:386) [ASSERT FAILED] sealing_sw_binding_4_rd_A
  UVM_INFO @ 179270596 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

7.keymgr_same_csr_outstanding.2224583874
Line 255, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/7.keymgr_same_csr_outstanding/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[9] & 'hffffffff)))'
  UVM_ERROR @ 201807927 ps: (keymgr_csr_assert_fpv.sv:386) [ASSERT FAILED] sealing_sw_binding_4_rd_A
  UVM_INFO @ 201807927 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 2 more failures.

... and 1 more tests.

UVM_ERROR (keymgr_scoreboard.sv:1017) [scoreboard] Check failed act == exp (* [*] vs * [*]) cdi_type: Attestation has 5 failures:

Test keymgr_stress_all_with_rand_reset has 5 failures.

24.keymgr_stress_all_with_rand_reset.2421233603
Line 1090, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/24.keymgr_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @ 443521086 ps: (keymgr_scoreboard.sv:1017) [uvm_test_top.env.scoreboard] Check failed act == exp (420513684500706607705403773652118860007310800296431377957338700334843099193500654133249222028895091638920433293584113129105635054960842510603983341046675516970324706701905406057342535230179262971229428943008200414531585062769335069997307971939604004129844948260117611686668712101766947692502544110689302778984148623792528222201388152231637279699237525029553674731375929539087918078581017922126254009922499267221655725460286267637966892014768227269086079872941004390566369388664074403405997515647255880 [0x83409e7b797f07b954593adbae337e8f5edebc39000000004cc8f775270840833a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9e4a16e7413b50cc5f6fed300568856c4a67a2f4132442f5aea60371c9cf808e4105bc5ee1b6193fbc97e5813f0d02eea0a41943bc60ccc4c67932fc09cbce18ad7651d68244dfa5866f79340533d20f9084d3af5df2df95ac986917662157a11b03291527bbc8b2aa621a150cf2b22b6f31fdbff6d0cff0677b116cd2fd2e9db25b6465c71ed2d079203186538848548] vs 181164135660345769959148492904981170425495753406952056334910170895550993617216045087659084322412220770198169940811194516147095657115839924474967946011007938206316115289986691523761034603580656023635832071250499169872437508201511006540064699675434641228358274161836023231497113862434103542407235106573692385894816336379907821626164172913274389337045585504331977888386738778833481387927983991344883986609857562572729263676065258611070867268951585145479522199886327434329595490955567105489980301890585928 [0x388bb17a00000000000000005beaf5b40f354c511cc2522b9e72e2749f87b4753a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9e4a16e7413b50cc5f6fed300568856c4a67a2f4132442f5aea60371c9cf808e4105bc5ee1b6193fbc97e5813f0d02eea0a41943bc60ccc4c67932fc09cbce18ad7651d68244dfa5866f79340533d20f9084d3af5df2df95ac986917662157a11b03291527bbc8b2aa621a150cf2b22b6f31fdbff6d0cff0677b116cd2fd2e9db25b6465c71ed2d079203186538848548]) cdi_type: Attestation
  
   DiversificationKey act: 0xf31fdbff6d0cff0677b116cd2fd2e9db25b6465c71ed2d079203186538848548, exp: 0xf31fdbff6d0cff0677b116cd2fd2e9db25b6465c71ed2d079203186538848548
   RomDigests act: 0xa41943bc60ccc4c67932fc09cbce18ad7651d68244dfa5866f79340533d20f9084d3af5df2df95ac986917662157a11b03291527bbc8b2aa621a150cf2b22b6, exp: 0xa41943bc60ccc4c67932fc09cbce18ad7651d68244dfa5866f79340533d20f9084d3af5df2df95ac986917662157a11b03291527bbc8b2aa621a150cf2b22b6
   HealthMeasurement act: 0x105bc5ee1b6193fbc97e5813f0d02eea, exp: 0x105bc5ee1b6193fbc97e5813f0d02eea

29.keymgr_stress_all_with_rand_reset.1140442286
Line 1744, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/29.keymgr_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @ 386499404 ps: (keymgr_scoreboard.sv:1017) [uvm_test_top.env.scoreboard] Check failed act == exp (435663692229058308166165679070577994364333328092768114710445065757183675398035232520754154170407052124785375766536151669110723926295798696529217325098707916945125182833914088566478641348980151105741657355475051739907482795845611181335764836553532316081849027496805060021442697923261015214535345133738534353743147512593115173939141839363117279515682995027057652978463578982664166274713136587927606483814309574885034992691500702231276168100885834374417617600613931399777452949707650614088617000057276250 [0x87fb295539d5da5c8a3b518845f822a0747b8e646212ba601ae0e94e1d06de783a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f96651ea4009476242c0b5238fec86337dfe69fcb7afd75bcdec654545606b448d1b16594b2bdcafabdef4f9b0ce12411100fd867694f4631bfbd72d0cd87123542b27eb054e66e87c5116acc122e7f516efa4afe515e2e8f1a9acfe05b5641d298532e9f82e6f17eec8294e5b92444de53e2ad45a3f5f9b41f5e73ca8d206f4f42e8dffd31f05ace403fe6a6a9091875a] vs 474665304687961967909224886484374907761300525020785919054166565968469494312527288822164497201159051428680280905796404056517941140979326064128225137292767683871620318039193423984556143331054387193020771605622602694652413358644271943940142212723332008214311086031654124242084996306066725848905209359371506535840820677763947276534657586257797731341361820440759017545986768382234595106497258609344937823096290149495033022851486693014681616131502978158210397780433869131293947952988880905767287444969981786 [0x94278953a5cae129dc5523f4636c8c471a428995f6afd208fe93591bde03c84a3a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f96651ea4009476242c0b5238fec86337dfe69fcb7afd75bcdec654545606b448d1b16594b2bdcafabdef4f9b0ce12411100fd867694f4631bfbd72d0cd87123542b27eb054e66e87c5116acc122e7f516efa4afe515e2e8f1a9acfe05b5641d298532e9f82e6f17eec8294e5b92444de53e2ad45a3f5f9b41f5e73ca8d206f4f42e8dffd31f05ace403fe6a6a9091875a]) cdi_type: Attestation
  
   DiversificationKey act: 0x3e2ad45a3f5f9b41f5e73ca8d206f4f42e8dffd31f05ace403fe6a6a9091875a, exp: 0x3e2ad45a3f5f9b41f5e73ca8d206f4f42e8dffd31f05ace403fe6a6a9091875a
   RomDigests act: 0xfd867694f4631bfbd72d0cd87123542b27eb054e66e87c5116acc122e7f516efa4afe515e2e8f1a9acfe05b5641d298532e9f82e6f17eec8294e5b92444de5, exp: 0xfd867694f4631bfbd72d0cd87123542b27eb054e66e87c5116acc122e7f516efa4afe515e2e8f1a9acfe05b5641d298532e9f82e6f17eec8294e5b92444de5
   HealthMeasurement act: 0x1b16594b2bdcafabdef4f9b0ce124111, exp: 0x1b16594b2bdcafabdef4f9b0ce124111

... and 3 more failures.

UVM_ERROR (keymgr_scoreboard.sv:1019) [scoreboard] Check failed act != exp (* [*] vs * [*]) cdi_type: Attestation has 4 failures:

Test keymgr_kmac_rsp_err has 4 failures.

8.keymgr_kmac_rsp_err.2731265105
Line 357, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/8.keymgr_kmac_rsp_err/latest/run.log

  UVM_ERROR @  30584706 ps: (keymgr_scoreboard.sv:1019) [uvm_test_top.env.scoreboard] Check failed act != exp (190483784832234603779001661884989069437928674203876161082034269644978675150749609220371659813246155995664594737964747540037057986693483280082124042849530179491348940687537081461147038062071741821876373528084284955323768326640110617170093268231424768371422305065885631762693248818267191300307693581477203152650784656500859733864943367542399957287156089770006430776242274786105627617990159520534300508846596916966671623610330087780160499205551384932225633062793768307190502113329958193276643939914257625 [0x3b745e3f958fd42806a53e41ab009df095bf9232c2773e6a041c7d63ae1064db3a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9bc5b1e0126932f9e0124422ab491987fcd93220144359f10185ca5eede644de898144111df1d7239d60ce35116301889a8fe49681a6d197a287c5f5f90b153e785e917e0ea84185f6c6740af2d7c0da13ba7910587b1cc00d57128672429316dc6077db92fa9a34207c10094d152874114fa5d0e6a0e531bfc7caf2911d10eed49ee902d133cabd8113d3556b5fe94d9] vs 190483784832234603779001661884989069437928674203876161082034269644978675150749609220371659813246155995664594737964747540037057986693483280082124042849530179491348940687537081461147038062071741821876373528084284955323768326640110617170093268231424768371422305065885631762693248818267191300307693581477203152650784656500859733864943367542399957287156089770006430776242274786105627617990159520534300508846596916966671623610330087780160499205551384932225633062793768307190502113329958193276643939914257625 [0x3b745e3f958fd42806a53e41ab009df095bf9232c2773e6a041c7d63ae1064db3a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9bc5b1e0126932f9e0124422ab491987fcd93220144359f10185ca5eede644de898144111df1d7239d60ce35116301889a8fe49681a6d197a287c5f5f90b153e785e917e0ea84185f6c6740af2d7c0da13ba7910587b1cc00d57128672429316dc6077db92fa9a34207c10094d152874114fa5d0e6a0e531bfc7caf2911d10eed49ee902d133cabd8113d3556b5fe94d9]) cdi_type: Attestation
  
   DiversificationKey act: 0x14fa5d0e6a0e531bfc7caf2911d10eed49ee902d133cabd8113d3556b5fe94d9, exp: 0x14fa5d0e6a0e531bfc7caf2911d10eed49ee902d133cabd8113d3556b5fe94d9
   RomDigests act: 0xa8fe49681a6d197a287c5f5f90b153e785e917e0ea84185f6c6740af2d7c0da13ba7910587b1cc00d57128672429316dc6077db92fa9a34207c10094d1528741, exp: 0xa8fe49681a6d197a287c5f5f90b153e785e917e0ea84185f6c6740af2d7c0da13ba7910587b1cc00d57128672429316dc6077db92fa9a34207c10094d1528741
   HealthMeasurement act: 0x98144111df1d7239d60ce35116301889, exp: 0x98144111df1d7239d60ce35116301889

10.keymgr_kmac_rsp_err.855992704
Line 611, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/10.keymgr_kmac_rsp_err/latest/run.log

  UVM_ERROR @ 338288020 ps: (keymgr_scoreboard.sv:1019) [uvm_test_top.env.scoreboard] Check failed act != exp (726203341015928642854390086859876898348906774168683270090151421278386237891866545417715404402984865397682895135774990966775282091588284646521274439052071879350825198102689268911164548564076646801853383326248524221501207268541886904585980585244679877110673463579719468274597997681637227543243126366217242329047194842557928477228919361455735798067850508813960466208694492493108019376559258182953819488200538682784052231016600436324780704545393066847156953532428001185899050237968269945973649953168209746 [0xe2aa5e39013c6025ac0ce1908a1a42dbcdd265dea248134ed6a59a43f77e8aa63a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f936f8949cbe56eed36220c26026cbd3283b6b91ac18390a8b5c00a8004ba82733fdca3c2b7a4977272ea244bf7311e13dc2573c0e1f72d158899038a21915f8b85c6469a8ea0782276ad87bf493eb9fb42c380ff2725ab28eb48cd33cb298e7f492358ba258d50a3d0b838d98ca1454ac63f96a07eb404feb242fe61d8a00fb9f677e6266547daa331629df6b306eb752] vs 726203341015928642854390086859876898348906774168683270090151421278386237891866545417715404402984865397682895135774990966775282091588284646521274439052071879350825198102689268911164548564076646801853383326248524221501207268541886904585980585244679877110673463579719468274597997681637227543243126366217242329047194842557928477228919361455735798067850508813960466208694492493108019376559258182953819488200538682784052231016600436324780704545393066847156953532428001185899050237968269945973649953168209746 [0xe2aa5e39013c6025ac0ce1908a1a42dbcdd265dea248134ed6a59a43f77e8aa63a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f936f8949cbe56eed36220c26026cbd3283b6b91ac18390a8b5c00a8004ba82733fdca3c2b7a4977272ea244bf7311e13dc2573c0e1f72d158899038a21915f8b85c6469a8ea0782276ad87bf493eb9fb42c380ff2725ab28eb48cd33cb298e7f492358ba258d50a3d0b838d98ca1454ac63f96a07eb404feb242fe61d8a00fb9f677e6266547daa331629df6b306eb752]) cdi_type: Attestation
  
   DiversificationKey act: 0x63f96a07eb404feb242fe61d8a00fb9f677e6266547daa331629df6b306eb752, exp: 0x63f96a07eb404feb242fe61d8a00fb9f677e6266547daa331629df6b306eb752
   RomDigests act: 0xc2573c0e1f72d158899038a21915f8b85c6469a8ea0782276ad87bf493eb9fb42c380ff2725ab28eb48cd33cb298e7f492358ba258d50a3d0b838d98ca1454ac, exp: 0xc2573c0e1f72d158899038a21915f8b85c6469a8ea0782276ad87bf493eb9fb42c380ff2725ab28eb48cd33cb298e7f492358ba258d50a3d0b838d98ca1454ac
   HealthMeasurement act: 0xfdca3c2b7a4977272ea244bf7311e13d, exp: 0xfdca3c2b7a4977272ea244bf7311e13d

... and 2 more failures.

UVM_ERROR (keymgr_scoreboard.sv:674) [scoreboard] Check failed item.d_data == addr_phase_op_status (* [*] vs * [*]) has 3 failures:
- Test keymgr_stress_all_with_rand_reset has 3 failures.
  - 11.keymgr_stress_all_with_rand_reset.1348191698
    Line 800, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/11.keymgr_stress_all_with_rand_reset/latest/run.log
```
  UVM_ERROR @ 280341762 ps: (keymgr_scoreboard.sv:674) [uvm_test_top.env.scoreboard] Check failed item.d_data == addr_phase_op_status (1 [0x1] vs 2 [0x2])
  UVM_INFO @ 280341762 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 21.keymgr_stress_all_with_rand_reset.1934214140
    Line 1068, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/21.keymgr_stress_all_with_rand_reset/latest/run.log
```
  UVM_ERROR @ 222904630 ps: (keymgr_scoreboard.sv:674) [uvm_test_top.env.scoreboard] Check failed item.d_data == addr_phase_op_status (1 [0x1] vs 2 [0x2])
  UVM_INFO @ 222904630 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 1 more failures.

UVM_ERROR (cip_base_scoreboard.sv:281) scoreboard [scoreboard] alert recov_operation_err did not trigger max_delay:* has 2 failures:

Test keymgr_lc_disable has 1 failures.

3.keymgr_lc_disable.3310813874
Line 461, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/3.keymgr_lc_disable/latest/run.log

  UVM_ERROR @ 118093115 ps: (cip_base_scoreboard.sv:281) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_operation_err did not trigger max_delay:2000
  UVM_INFO @ 118093115 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Test keymgr_stress_all has 1 failures.

47.keymgr_stress_all.3324561492
Line 3319, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/47.keymgr_stress_all/latest/run.log

  UVM_ERROR @ 551598569 ps: (cip_base_scoreboard.sv:281) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_operation_err did not trigger max_delay:0
  UVM_INFO @ 551598569 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

UVM_ERROR (keymgr_scoreboard.sv:736) [scoreboard] Check failed item.d_data !=gmv(csr) (* [] vs * [])` has 2 failures:

Test keymgr_stress_all_with_rand_reset has 2 failures.

4.keymgr_stress_all_with_rand_reset.729671242
Line 1151, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/4.keymgr_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @ 241080571 ps: (keymgr_scoreboard.sv:736) [uvm_test_top.env.scoreboard] Check failed item.d_data != `gmv(csr) (2180703505 [0x81fae511] vs 2180703505 [0x81fae511])
  UVM_INFO @ 241080571 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

37.keymgr_stress_all_with_rand_reset.618520639
Line 491, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/37.keymgr_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @ 191109957 ps: (keymgr_scoreboard.sv:736) [uvm_test_top.env.scoreboard] Check failed item.d_data != `gmv(csr) (1189602000 [0x46e7e2d0] vs 1189602000 [0x46e7e2d0])
  UVM_INFO @ 191109957 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

UVM_ERROR (cip_base_scoreboard.sv:241) scoreboard [scoreboard] alert recov_operation_err is not received! has 1 failures:
- Test keymgr_sync_async_fault_cross has 1 failures.
  - 46.keymgr_sync_async_fault_cross.1769874318
    Line 338, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/46.keymgr_sync_async_fault_cross/latest/run.log
```
  UVM_ERROR @  83187296 ps: (cip_base_scoreboard.sv:241) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_operation_err is not received!
  UVM_INFO @  83187296 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```