KEYMGR Simulation Results

Saturday June 01 2024 19:02:43 UTC

GitHub Revision: `eb6a0f1711`

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 1841380615

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	keymgr_smoke	1.206m	14.923ms	50	50	100.00
V1	random	keymgr_random	56.000s	1.899ms	50	50	100.00
V1	csr_hw_reset	keymgr_csr_hw_reset	1.160s	39.030us	5	5	100.00
V1	csr_rw	keymgr_csr_rw	1.390s	90.263us	14	20	70.00
V1	csr_bit_bash	keymgr_csr_bit_bash	27.120s	1.193ms	3	5	60.00
V1	csr_aliasing	keymgr_csr_aliasing	9.070s	370.793us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	keymgr_csr_mem_rw_with_rand_reset	2.110s	121.222us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	keymgr_csr_rw	1.390s	90.263us	14	20	70.00
		keymgr_csr_aliasing	9.070s	370.793us	5	5	100.00
V1		TOTAL			147	155	94.84
V2	cfgen_during_op	keymgr_cfg_regwen	2.657m	5.006ms	50	50	100.00
V2	sideload	keymgr_sideload	1.045m	3.460ms	50	50	100.00
		keymgr_sideload_kmac	40.870s	5.651ms	50	50	100.00
		keymgr_sideload_aes	52.920s	2.207ms	50	50	100.00
		keymgr_sideload_otbn	1.387m	11.882ms	50	50	100.00
V2	direct_to_disabled_state	keymgr_direct_to_disabled	49.570s	4.815ms	50	50	100.00
V2	lc_disable	keymgr_lc_disable	10.890s	1.169ms	48	50	96.00
V2	kmac_error_response	keymgr_kmac_rsp_err	1.654m	7.688ms	44	50	88.00
V2	invalid_sw_input	keymgr_sw_invalid_input	1.605m	5.225ms	50	50	100.00
V2	invalid_hw_input	keymgr_hwsw_invalid_input	1.288m	2.289ms	50	50	100.00
V2	sync_async_fault_cross	keymgr_sync_async_fault_cross	42.160s	1.740ms	50	50	100.00
V2	stress_all	keymgr_stress_all	5.587m	36.130ms	49	50	98.00
V2	intr_test	keymgr_intr_test	0.930s	14.676us	50	50	100.00
V2	alert_test	keymgr_alert_test	1.180s	27.155us	50	50	100.00
V2	tl_d_oob_addr_access	keymgr_tl_errors	4.160s	878.615us	20	20	100.00
V2	tl_d_illegal_access	keymgr_tl_errors	4.160s	878.615us	20	20	100.00
V2	tl_d_outstanding_access	keymgr_csr_hw_reset	1.160s	39.030us	5	5	100.00
		keymgr_csr_rw	1.390s	90.263us	14	20	70.00
		keymgr_csr_aliasing	9.070s	370.793us	5	5	100.00
		keymgr_same_csr_outstanding	2.540s	97.808us	14	20	70.00
V2	tl_d_partial_access	keymgr_csr_hw_reset	1.160s	39.030us	5	5	100.00
		keymgr_csr_rw	1.390s	90.263us	14	20	70.00
		keymgr_csr_aliasing	9.070s	370.793us	5	5	100.00
		keymgr_same_csr_outstanding	2.540s	97.808us	14	20	70.00
V2		TOTAL			725	740	97.97
V2S	sec_cm_additional_check	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
V2S	tl_intg_err	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
		keymgr_tl_intg_err	22.330s	1.287ms	12	20	60.00
V2S	shadow_reg_update_error	keymgr_shadow_reg_errors	33.310s	3.915ms	20	20	100.00
V2S	shadow_reg_read_clear_staged_value	keymgr_shadow_reg_errors	33.310s	3.915ms	20	20	100.00
V2S	shadow_reg_storage_error	keymgr_shadow_reg_errors	33.310s	3.915ms	20	20	100.00
V2S	shadowed_reset_glitch	keymgr_shadow_reg_errors	33.310s	3.915ms	20	20	100.00
V2S	shadow_reg_update_error_with_csr_rw	keymgr_shadow_reg_errors_with_csr_rw	12.170s	829.049us	10	20	50.00
V2S	prim_count_check	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
V2S	prim_fsm_check	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
V2S	sec_cm_bus_integrity	keymgr_tl_intg_err	22.330s	1.287ms	12	20	60.00
V2S	sec_cm_config_shadow	keymgr_shadow_reg_errors	33.310s	3.915ms	20	20	100.00
V2S	sec_cm_op_config_regwen	keymgr_cfg_regwen	2.657m	5.006ms	50	50	100.00
V2S	sec_cm_reseed_config_regwen	keymgr_random	56.000s	1.899ms	50	50	100.00
		keymgr_csr_rw	1.390s	90.263us	14	20	70.00
V2S	sec_cm_sw_binding_config_regwen	keymgr_random	56.000s	1.899ms	50	50	100.00
		keymgr_csr_rw	1.390s	90.263us	14	20	70.00
V2S	sec_cm_max_key_ver_config_regwen	keymgr_random	56.000s	1.899ms	50	50	100.00
		keymgr_csr_rw	1.390s	90.263us	14	20	70.00
V2S	sec_cm_lc_ctrl_intersig_mubi	keymgr_lc_disable	10.890s	1.169ms	48	50	96.00
V2S	sec_cm_constants_consistency	keymgr_hwsw_invalid_input	1.288m	2.289ms	50	50	100.00
V2S	sec_cm_intersig_consistency	keymgr_hwsw_invalid_input	1.288m	2.289ms	50	50	100.00
V2S	sec_cm_hw_key_sw_noaccess	keymgr_random	56.000s	1.899ms	50	50	100.00
V2S	sec_cm_output_keys_ctrl_redun	keymgr_sideload_protect	48.120s	6.396ms	50	50	100.00
V2S	sec_cm_ctrl_fsm_sparse	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
V2S	sec_cm_data_fsm_sparse	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
V2S	sec_cm_ctrl_fsm_local_esc	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
V2S	sec_cm_ctrl_fsm_consistency	keymgr_custom_cm	47.610s	4.018ms	50	50	100.00
V2S	sec_cm_ctrl_fsm_global_esc	keymgr_lc_disable	10.890s	1.169ms	48	50	96.00
V2S	sec_cm_ctrl_ctr_redun	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
V2S	sec_cm_kmac_if_fsm_sparse	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
V2S	sec_cm_kmac_if_ctr_redun	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
V2S	sec_cm_kmac_if_cmd_ctrl_consistency	keymgr_custom_cm	47.610s	4.018ms	50	50	100.00
V2S	sec_cm_kmac_if_done_ctrl_consistency	keymgr_custom_cm	47.610s	4.018ms	50	50	100.00
V2S	sec_cm_reseed_ctr_redun	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
V2S	sec_cm_side_load_sel_ctrl_consistency	keymgr_custom_cm	47.610s	4.018ms	50	50	100.00
V2S	sec_cm_sideload_ctrl_fsm_sparse	keymgr_sec_cm	1.452m	9.100ms	5	5	100.00
V2S	sec_cm_ctrl_key_integrity	keymgr_custom_cm	47.610s	4.018ms	50	50	100.00
V2S		TOTAL			147	165	89.09
V3	stress_all_with_rand_reset	keymgr_stress_all_with_rand_reset	17.100s	930.618us	45	50	90.00
V3		TOTAL			45	50	90.00
		TOTAL			1064	1110	95.86

Testplan Progress

Items	Total	Written	Passing	Progress
V1	7	7	5	71.43
V2	16	16	12	75.00
V2S	6	6	4	66.67
V3	1	1	0	0.00

Coverage Results

Coverage Dashboard

SCORE	LINE	COND	TOGGLE	FSM	BRANCH	ASSERT	GROUP
97.86	99.10	98.03	98.68	100.00	99.12	98.41	91.71

Failure Buckets

Offending '(d2h.d_error || ((d2h.d_data & *) == (exp_vals[*] & *)))' has 32 failures:

Test keymgr_shadow_reg_errors_with_csr_rw has 10 failures.

0.keymgr_shadow_reg_errors_with_csr_rw.1117498718
Line 264, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/0.keymgr_shadow_reg_errors_with_csr_rw/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[16] & 'hffffffff)))'
  UVM_ERROR @  50682856 ps: (keymgr_csr_assert_fpv.sv:421) [ASSERT FAILED] attest_sw_binding_3_rd_A
  UVM_INFO @  50682856 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

2.keymgr_shadow_reg_errors_with_csr_rw.248266696
Line 254, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/2.keymgr_shadow_reg_errors_with_csr_rw/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[19] & 'hffffffff)))'
  UVM_ERROR @  14954103 ps: (keymgr_csr_assert_fpv.sv:436) [ASSERT FAILED] attest_sw_binding_6_rd_A
  UVM_INFO @  14954103 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 8 more failures.

Test keymgr_csr_bit_bash has 2 failures.

0.keymgr_csr_bit_bash.2442703223
Line 255, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/0.keymgr_csr_bit_bash/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[19] & 'hffffffff)))'
  UVM_ERROR @ 1616875377 ps: (keymgr_csr_assert_fpv.sv:436) [ASSERT FAILED] attest_sw_binding_6_rd_A
  UVM_INFO @ 1616875377 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

1.keymgr_csr_bit_bash.2617300441
Line 255, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/1.keymgr_csr_bit_bash/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[13] & 'hffffffff)))'
  UVM_ERROR @ 846410844 ps: (keymgr_csr_assert_fpv.sv:406) [ASSERT FAILED] attest_sw_binding_0_rd_A
  UVM_INFO @ 846410844 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Test keymgr_tl_intg_err has 8 failures.

1.keymgr_tl_intg_err.1573506548
Line 265, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/1.keymgr_tl_intg_err/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[5] & 'hffffffff)))'
  UVM_ERROR @  46468054 ps: (keymgr_csr_assert_fpv.sv:366) [ASSERT FAILED] sealing_sw_binding_0_rd_A
  UVM_INFO @  46468054 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

3.keymgr_tl_intg_err.3616545695
Line 272, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/3.keymgr_tl_intg_err/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[18] & 'hffffffff)))'
  UVM_ERROR @ 555257308 ps: (keymgr_csr_assert_fpv.sv:431) [ASSERT FAILED] attest_sw_binding_5_rd_A
  UVM_INFO @ 555257308 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 6 more failures.

Test keymgr_same_csr_outstanding has 6 failures.

1.keymgr_same_csr_outstanding.893600196
Line 255, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/1.keymgr_same_csr_outstanding/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[14] & 'hffffffff)))'
  UVM_ERROR @ 141194477 ps: (keymgr_csr_assert_fpv.sv:411) [ASSERT FAILED] attest_sw_binding_1_rd_A
  UVM_INFO @ 141194477 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

3.keymgr_same_csr_outstanding.417631347
Line 255, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/3.keymgr_same_csr_outstanding/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[12] & 'hffffffff)))'
  UVM_ERROR @  36148428 ps: (keymgr_csr_assert_fpv.sv:401) [ASSERT FAILED] sealing_sw_binding_7_rd_A
  UVM_INFO @  36148428 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 4 more failures.

Test keymgr_csr_rw has 6 failures.

2.keymgr_csr_rw.451379245
Line 255, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/2.keymgr_csr_rw/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[12] & 'hffffffff)))'
  UVM_ERROR @   6839781 ps: (keymgr_csr_assert_fpv.sv:401) [ASSERT FAILED] sealing_sw_binding_7_rd_A
  UVM_INFO @   6839781 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

6.keymgr_csr_rw.3376305279
Line 255, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/6.keymgr_csr_rw/latest/run.log

      Offending '(d2h.d_error || ((d2h.d_data & 'hffffffff) == (exp_vals[12] & 'hffffffff)))'
  UVM_ERROR @  18106043 ps: (keymgr_csr_assert_fpv.sv:401) [ASSERT FAILED] sealing_sw_binding_7_rd_A
  UVM_INFO @  18106043 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 4 more failures.

UVM_ERROR (keymgr_scoreboard.sv:1019) [scoreboard] Check failed act != exp (* [*] vs * [*]) cdi_type: Attestation has 6 failures:

Test keymgr_kmac_rsp_err has 6 failures.

3.keymgr_kmac_rsp_err.2660256237
Line 419, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/3.keymgr_kmac_rsp_err/latest/run.log

  UVM_ERROR @ 224940145 ps: (keymgr_scoreboard.sv:1019) [uvm_test_top.env.scoreboard] Check failed act != exp (634857637560072643323296931372858760505168654778257073807101601696348593683612681561572985819807641254673832459656514475806405837204245366505163748183397816665096438586309328563424062535610575006946677368228195032699854716340626531965758504389734112288249518201293920515766697846786653715809312652045657054086432812617191473160804603966007487113671446120739263781820082423504744699121068479577508481951158647809400828046821847020607463432822763191699666696228321546493249699203535394195009118668019131 [0xc627810b1866e7122389782f57ef380630650fb24dbb6325000000001cd027f03a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f91a50eef6811b8362262f3307b1bedbb8ac5a6251742c1d035c9ab85ba5a257ad31dbdd7379eabcddc0d18b6371cb71088c34b8c375fe8e00844f060d7d31dfb6fc3464889269af28a8a3c20d5ac3010c117daa44a81e84afe6aaf220629b2679dc1df59ceed2aeefc885e9f77204cfcf443aae0a0449b9fffe96c01eca474460ba3f464042ef2eb42b49513ce17355bb] vs 634857637560072643323296931372858760505168654778257073807101601696348593683612681561572985819807641254673832459656514475806405837204245366505163748183397816665096438586309328563424062535610575006946677368228195032699854716340626531965758504389734112288249518201293920515766697846786653715809312652045657054086432812617191473160804603966007487113671446120739263781820082423504744699121068479577508481951158647809400828046821847020607463432822763191699666696228321546493249699203535394195009118668019131 [0xc627810b1866e7122389782f57ef380630650fb24dbb6325000000001cd027f03a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f91a50eef6811b8362262f3307b1bedbb8ac5a6251742c1d035c9ab85ba5a257ad31dbdd7379eabcddc0d18b6371cb71088c34b8c375fe8e00844f060d7d31dfb6fc3464889269af28a8a3c20d5ac3010c117daa44a81e84afe6aaf220629b2679dc1df59ceed2aeefc885e9f77204cfcf443aae0a0449b9fffe96c01eca474460ba3f464042ef2eb42b49513ce17355bb]) cdi_type: Attestation
  
   DiversificationKey act: 0x443aae0a0449b9fffe96c01eca474460ba3f464042ef2eb42b49513ce17355bb, exp: 0x443aae0a0449b9fffe96c01eca474460ba3f464042ef2eb42b49513ce17355bb
   RomDigests act: 0x8c34b8c375fe8e00844f060d7d31dfb6fc3464889269af28a8a3c20d5ac3010c117daa44a81e84afe6aaf220629b2679dc1df59ceed2aeefc885e9f77204cfcf, exp: 0x8c34b8c375fe8e00844f060d7d31dfb6fc3464889269af28a8a3c20d5ac3010c117daa44a81e84afe6aaf220629b2679dc1df59ceed2aeefc885e9f77204cfcf
   HealthMeasurement act: 0x31dbdd7379eabcddc0d18b6371cb7108, exp: 0x31dbdd7379eabcddc0d18b6371cb7108

6.keymgr_kmac_rsp_err.641293490
Line 335, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/6.keymgr_kmac_rsp_err/latest/run.log

  UVM_ERROR @  21569541 ps: (keymgr_scoreboard.sv:1019) [uvm_test_top.env.scoreboard] Check failed act != exp (445358742217103708236206976384558252590862620411747135343077917419684849258029947841645224096018634204732042703600538651907612420060940899078790866030602149219249376934918680420524478801572355493229356365402536930047649872069882440787144657459887181029079065147362426595756681213971105093795465424275338398997135031939643099311553279111014273759556498939914013184114978125766380118400343508724175223236118138091685678487760523586541937170019582149472661260349638357067216623849673678416087952517137956 [0x8b01d51033302ed8a71b2596484e4247fb4ada33a5c0b1c02ad86978a9d856413a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f94b2ae8674c96f0d8056c2448ce82890fe001de0db9d9e292d31db557fb065a62995f73e70646712f65696c586f78064e0cc9807562867f2928b4bb6635babf1d04a64c80b4c6d6d3be591cddfebfa706ef3e7bd29732bb89c6e7630aeef2efee15aec85d4b79b42a96cbe188dcfba373022679f54e51ad92b5fbe86f9f537f76bb8e28a636e3607b98aaf0a4eb928624] vs 445358742217103708236206976384558252590862620411747135343077917419684849258029947841645224096018634204732042703600538651907612420060940899078790866030602149219249376934918680420524478801572355493229356365402536930047649872069882440787144657459887181029079065147362426595756681213971105093795465424275338398997135031939643099311553279111014273759556498939914013184114978125766380118400343508724175223236118138091685678487760523586541937170019582149472661260349638357067216623849673678416087952517137956 [0x8b01d51033302ed8a71b2596484e4247fb4ada33a5c0b1c02ad86978a9d856413a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f94b2ae8674c96f0d8056c2448ce82890fe001de0db9d9e292d31db557fb065a62995f73e70646712f65696c586f78064e0cc9807562867f2928b4bb6635babf1d04a64c80b4c6d6d3be591cddfebfa706ef3e7bd29732bb89c6e7630aeef2efee15aec85d4b79b42a96cbe188dcfba373022679f54e51ad92b5fbe86f9f537f76bb8e28a636e3607b98aaf0a4eb928624]) cdi_type: Attestation
  
   DiversificationKey act: 0x22679f54e51ad92b5fbe86f9f537f76bb8e28a636e3607b98aaf0a4eb928624, exp: 0x22679f54e51ad92b5fbe86f9f537f76bb8e28a636e3607b98aaf0a4eb928624
   RomDigests act: 0xcc9807562867f2928b4bb6635babf1d04a64c80b4c6d6d3be591cddfebfa706ef3e7bd29732bb89c6e7630aeef2efee15aec85d4b79b42a96cbe188dcfba373, exp: 0xcc9807562867f2928b4bb6635babf1d04a64c80b4c6d6d3be591cddfebfa706ef3e7bd29732bb89c6e7630aeef2efee15aec85d4b79b42a96cbe188dcfba373
   HealthMeasurement act: 0x995f73e70646712f65696c586f78064e, exp: 0x995f73e70646712f65696c586f78064e

... and 4 more failures.

UVM_ERROR (keymgr_scoreboard.sv:1017) [scoreboard] Check failed act == exp (* [*] vs * [*]) cdi_type: Attestation has 3 failures:

Test keymgr_stress_all_with_rand_reset has 3 failures.

5.keymgr_stress_all_with_rand_reset.1657568066
Line 667, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/5.keymgr_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @ 389400743 ps: (keymgr_scoreboard.sv:1017) [uvm_test_top.env.scoreboard] Check failed act == exp (323912800307177340984963993334548295588897741960089871409510415804399202684466013167909727408344161913994148589882928099058061855224399936440850866106697009203290309283040677370475353701761147098957979774618898004217498185983861216624667807678836929206520188025559436160190902441213443511163222666628224021788436936047216239676575349128987661207668323762805023809764590950967634736036831204086793350350217802302017579080842174639804306623442725330479645539038766544800408578324819519229188053454615287 [0x6519d8b1706ea9cd4156ea7b75a4eb3db21fa112f49c96c8ac287b57e276e13d3a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f94a307349a1d425a072ed6fdb4e7b8c81615b06adf526df20e655de0587aaed164b22aa039324b7ad328dae436e13f809e80c7cb20417b256003609e2728f12ad8c319b12b129bdfc301b65b5d9660d05daad1e90aa4dd781d1cef2f3d1914b46143f5ad5438a326550aea3ad09ddc489a8562c27057cdd52711119e9d1e3e37c16fbc7db694162f7f192b36b2a88f2f7] vs 554017408458233166264174037973550105864724357435439535054052572446253750531806591123390760464831280932019505019082785143202537740481230543645396238973178256200432355509796549592437504856786571448876580932014597209212594318497733203697223968977655124146315871683217636297582105074852517977329666827486214915169260853802587284487616273506069329085119496515006293445004634803018121277865486108444855609924835980228957505472476562168240437376392533511832952389555903273528898674348390027147213342052512503 [0xacec111dacd0bd89f7e9e9987ade2389cff568b20fef5d1b9345bda9aa14e5183a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f94a307349a1d425a072ed6fdb4e7b8c81615b06adf526df20e655de0587aaed164b22aa039324b7ad328dae436e13f809e80c7cb20417b256003609e2728f12ad8c319b12b129bdfc301b65b5d9660d05daad1e90aa4dd781d1cef2f3d1914b46143f5ad5438a326550aea3ad09ddc489a8562c27057cdd52711119e9d1e3e37c16fbc7db694162f7f192b36b2a88f2f7]) cdi_type: Attestation
  
   DiversificationKey act: 0xa8562c27057cdd52711119e9d1e3e37c16fbc7db694162f7f192b36b2a88f2f7, exp: 0xa8562c27057cdd52711119e9d1e3e37c16fbc7db694162f7f192b36b2a88f2f7
   RomDigests act: 0xe80c7cb20417b256003609e2728f12ad8c319b12b129bdfc301b65b5d9660d05daad1e90aa4dd781d1cef2f3d1914b46143f5ad5438a326550aea3ad09ddc489, exp: 0xe80c7cb20417b256003609e2728f12ad8c319b12b129bdfc301b65b5d9660d05daad1e90aa4dd781d1cef2f3d1914b46143f5ad5438a326550aea3ad09ddc489
   HealthMeasurement act: 0x4b22aa039324b7ad328dae436e13f809, exp: 0x4b22aa039324b7ad328dae436e13f809

22.keymgr_stress_all_with_rand_reset.2912308217
Line 950, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/22.keymgr_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @ 235823822 ps: (keymgr_scoreboard.sv:1017) [uvm_test_top.env.scoreboard] Check failed act == exp (404382554613566949810926324676496833700495344267370704319473204853508024048925963205002847731148371157611395895717410540356077255375181138965268789818517539394075281218978197609532141758284913586446211052674544274057611856464918356907033521471045443751122294673306711502436674003220697356085739891236657887207832276223970085653340981076620144407630655268126026569515425467543941060674399942483029520828573024045554997248521230598570849055864077998009513400764876703711670193462952492443101154596481912 [0x7e37ae6cee7bb9bf28358b67e4efadc8b10bc2d27517442473cd89e96421956e3a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9000000000000000000000000000000000000000000000000000000000000f0f000000000000000005cfbd765ce33f34ea20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507a20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507fa365df52da48cd752fb3a026a8e608f0098cfe5fa9810494829d0cd9479eb78] vs 748427164302637862178411497769756884844875282674030146207990828410174523296800113948071492084156476015026556199649624965293129305897680448578697949965281326024291053144947692005724252456579120251556555151970859014745827231485103528907127537474563164496259449639161483459233596684495402126070797645215904300975629157116613814503867947856265918777851778289814678658859329494205546107192192865067473015353513751819483142476537591800636242477876627969229661919230298636307712813373701682806833137252428664 [0xe99a2283000000007fbb58af9cc55ad622b840070d52a91500000000c8afc9e03a0a6d73cd50897de4d744bd65ebdb3837ea77087d878651c517c18a5742b2f9000000000000000000000000000000000000000000000000000000000000f0f000000000000000005cfbd765ce33f34ea20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507a20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507fa365df52da48cd752fb3a026a8e608f0098cfe5fa9810494829d0cd9479eb78]) cdi_type: Attestation
  
   DiversificationKey act: 0xfa365df52da48cd752fb3a026a8e608f0098cfe5fa9810494829d0cd9479eb78, exp: 0xfa365df52da48cd752fb3a026a8e608f0098cfe5fa9810494829d0cd9479eb78
   RomDigests act: 0xa20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507a20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507, exp: 0xa20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507a20a046cf42e6eac560a3f82bfa76285b5c1d4aea7c915e49a32d1c89be0f507
   HealthMeasurement act: 0x5cfbd765ce33f34e, exp: 0x5cfbd765ce33f34e

... and 1 more failures.

UVM_ERROR (keymgr_scoreboard.sv:674) [scoreboard] Check failed item.d_data == addr_phase_op_status (* [*] vs * [*]) has 3 failures:

Test keymgr_stress_all_with_rand_reset has 2 failures.

12.keymgr_stress_all_with_rand_reset.2838498090
Line 1182, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/12.keymgr_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @ 783803007 ps: (keymgr_scoreboard.sv:674) [uvm_test_top.env.scoreboard] Check failed item.d_data == addr_phase_op_status (1 [0x1] vs 2 [0x2])
  UVM_INFO @ 783803007 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

14.keymgr_stress_all_with_rand_reset.1243538197
Line 869, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/14.keymgr_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @ 206168876 ps: (keymgr_scoreboard.sv:674) [uvm_test_top.env.scoreboard] Check failed item.d_data == addr_phase_op_status (1 [0x1] vs 2 [0x2])
  UVM_INFO @ 206168876 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Test keymgr_lc_disable has 1 failures.

23.keymgr_lc_disable.192181175
Line 473, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/23.keymgr_lc_disable/latest/run.log

  UVM_ERROR @  34588143 ps: (keymgr_scoreboard.sv:674) [uvm_test_top.env.scoreboard] Check failed item.d_data == addr_phase_op_status (2 [0x2] vs 3 [0x3])
  UVM_INFO @  34588143 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

UVM_ERROR (cip_base_scoreboard.sv:281) scoreboard [scoreboard] alert recov_operation_err did not trigger max_delay:* has 2 failures:

Test keymgr_stress_all has 1 failures.

20.keymgr_stress_all.1399623632
Line 1384, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/20.keymgr_stress_all/latest/run.log

  UVM_ERROR @ 561890190 ps: (cip_base_scoreboard.sv:281) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_operation_err did not trigger max_delay:0
  UVM_INFO @ 561890190 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Test keymgr_lc_disable has 1 failures.

45.keymgr_lc_disable.4157624696
Line 348, in log /container/opentitan-public/scratch/os_regression/keymgr-sim-vcs/45.keymgr_lc_disable/latest/run.log

  UVM_ERROR @  55500950 ps: (cip_base_scoreboard.sv:281) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_operation_err did not trigger max_delay:2000
  UVM_INFO @  55500950 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---