ENTROPY_SRC Simulation Results

Tuesday August 06 2024 23:02:29 UTC

GitHub Revision: `5fd4ecc0fc`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 56304622830272859824235340993951659280265419461975949533183046575604373639200

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	4.000s	31.549us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	4.000s	175.461us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	4.000s	61.076us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	15.000s	10.920ms	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	6.000s	82.514us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	3.000s	157.619us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	4.000s	61.076us	20	20	100.00
		entropy_src_csr_aliasing	6.000s	82.514us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	4.000s	31.549us	50	50	100.00
		entropy_src_rng	10.250m	20.062ms	299	300	99.67
		entropy_src_fw_ov	10.550m	20.036ms	252	300	84.00
V2	firmware_mode	entropy_src_fw_ov	10.550m	20.036ms	252	300	84.00
V2	rng_mode	entropy_src_rng	10.250m	20.062ms	299	300	99.67
V2	rng_max_rate	entropy_src_rng_max_rate	18.533m	20.083ms	394	400	98.50
V2	health_checks	entropy_src_rng	10.250m	20.062ms	299	300	99.67
V2	conditioning	entropy_src_rng	10.250m	20.062ms	299	300	99.67
V2	interrupts	entropy_src_rng	10.250m	20.062ms	299	300	99.67
		entropy_src_intr	34.000s	1.946ms	50	50	100.00
V2	alerts	entropy_src_rng	10.250m	20.062ms	299	300	99.67
		entropy_src_functional_alerts	4.000s	59.648us	50	50	100.00
V2	stress_all	entropy_src_stress_all	8.800m	20.120ms	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	9.933m	10.012ms	964	1000	96.40
V2	firmware_ov_read_contiguous_data	entropy_src_fw_ov_contiguous	26.000s	1.719ms	50	50	100.00
V2	intr_test	entropy_src_intr_test	4.000s	31.316us	50	50	100.00
V2	alert_test	entropy_src_alert_test	3.000s	20.930us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	7.000s	139.505us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	7.000s	139.505us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	4.000s	175.461us	5	5	100.00
		entropy_src_csr_rw	4.000s	61.076us	20	20	100.00
		entropy_src_csr_aliasing	6.000s	82.514us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	403.711us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	4.000s	175.461us	5	5	100.00
		entropy_src_csr_rw	4.000s	61.076us	20	20	100.00
		entropy_src_csr_aliasing	6.000s	82.514us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	403.711us	20	20	100.00
V2		TOTAL			2249	2340	96.11
V2S	tl_intg_err	entropy_src_sec_cm	4.000s	53.048us	5	5	100.00
		entropy_src_tl_intg_err	6.000s	166.633us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	10.250m	20.062ms	299	300	99.67
		entropy_src_cfg_regwen	4.000s	21.698us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	10.250m	20.062ms	299	300	99.67
V2S	sec_cm_config_redun	entropy_src_rng	10.250m	20.062ms	299	300	99.67
V2S	sec_cm_intersig_mubi	entropy_src_rng	10.250m	20.062ms	299	300	99.67
		entropy_src_fw_ov	10.550m	20.036ms	252	300	84.00
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	9.933m	10.012ms	964	1000	96.40
		entropy_src_sec_cm	4.000s	53.048us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	9.933m	10.012ms	964	1000	96.40
		entropy_src_sec_cm	4.000s	53.048us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	10.250m	20.062ms	299	300	99.67
V2S	sec_cm_fifo_ctr_redun	entropy_src_functional_errors	9.933m	10.012ms	964	1000	96.40
		entropy_src_sec_cm	4.000s	53.048us	5	5	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	9.933m	10.012ms	964	1000	96.40
		entropy_src_sec_cm	4.000s	53.048us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	9.933m	10.012ms	964	1000	96.40
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	4.000s	59.648us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	6.000s	166.633us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	9.450m	18.078ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
		TOTAL			2479	2570	96.46

Testplan Progress

Items	Total	Written	Passing	Progress
V1	6	6	6	100.00
V2	12	12	8	66.67
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
97.16	98.19	95.43	98.36	95.88	96.59	97.92	90.49	95.93

Failure Buckets

UVM_ERROR (cip_base_scoreboard.sv:243) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 17 failures:
- Test entropy_src_fw_ov has 17 failures.
  - 1.entropy_src_fw_ov.47135009356782303489627376688372983381352879574947691850173510884732952489308
    Line 1089, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/1.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 7318451391 ps: (cip_base_scoreboard.sv:243) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 7318451391 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 21.entropy_src_fw_ov.267841824209583060700192277851099143701123487872854165278994788882758832249
    Line 1646, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/21.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 10148106396 ps: (cip_base_scoreboard.sv:243) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 10148106396 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 15 more failures.

UVM_ERROR (entropy_src_scoreboard.sv:2035) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.err_code has 17 failures:

Test entropy_src_fw_ov has 17 failures.

3.entropy_src_fw_ov.105124772952625949415247813689901459736413329910748325876724881187138799270959
Line 1226, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/3.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 16610544888 ps: (entropy_src_scoreboard.sv:2035) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 16610544888 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

13.entropy_src_fw_ov.22668927169918448401580752414674049409046894002520872908941988510704388360391
Line 798, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/13.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 9667973960 ps: (entropy_src_scoreboard.sv:2035) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 9667973960 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 15 more failures.

UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 15 failures:
- Test entropy_src_functional_errors has 15 failures.
  - 174.entropy_src_functional_errors.6036083590842117297775171988224190364623545257695670878567573107701234558804
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/174.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10064721143 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x66271dd8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10064721143 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 244.entropy_src_functional_errors.111195470424240269325204241404320759727933751910511796056730072251980650826143
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/244.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10012689727 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xd189e0d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10012689727 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 13 more failures.
Exit reason: Error: User command failed UVM_ERROR (cip_base_scoreboard.sv:243) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 12 failures:
- Test entropy_src_fw_ov has 12 failures.
  - 14.entropy_src_fw_ov.94806656767979639728366798672994845084291537819267956961027301611465656955696
    Line 991, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/14.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 7817397331 ps: (cip_base_scoreboard.sv:243) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 7817397331 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 57.entropy_src_fw_ov.94447395918683429095085256526700284696986145995508399878366856870847082123991
    Line 1042, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/57.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 8685732472 ps: (cip_base_scoreboard.sv:243) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 8685732472 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 10 more failures.
UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 9 failures:
- Test entropy_src_functional_errors has 9 failures.
  - 140.entropy_src_functional_errors.30697843067566616539474037681337854266229120187422973553491650171574224039291
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/140.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10017319542 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xb1f6a4d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10017319542 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 167.entropy_src_functional_errors.96402572524848440036582108875676407191604879086710095950752786902226662968209
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/167.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10023571817 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x2fa153d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10023571817 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 7 more failures.
UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 6 failures:
- Test entropy_src_functional_errors has 6 failures.
  - 38.entropy_src_functional_errors.5102056848895484456369234597465200849590584583032296693245350760290316338688
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/38.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10025789186 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xc37531d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10025789186 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 61.entropy_src_functional_errors.14713809776873840736430596854563323384159211666713591437789033811650111883459
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/61.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10018725808 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xed9e00d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10018725808 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 4 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 5 failures:
- Test entropy_src_functional_errors has 5 failures.
  - 26.entropy_src_functional_errors.96372229541276578461777136193687758834427651246271366224556803024198373278247
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/26.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10018791748 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x416063d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10018791748 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 102.entropy_src_functional_errors.51872964717834139929413019091375745782611242056303294365499257125652477111704
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/102.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10249415033 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x2455a1d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10249415033 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.

UVM_ERROR (entropy_src_scoreboard.sv:2035) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.alert_summary_fail_counts has 4 failures:

Test entropy_src_rng has 1 failures.

63.entropy_src_rng.113475033198553241324736027920038853216330907090968282619703029289459415014885
Line 2294, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/63.entropy_src_rng/latest/run.log

  UVM_ERROR @ 6629641773 ps: (entropy_src_scoreboard.sv:2035) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1 [0x1] vs 0 [0x0]) reg name: entropy_src_reg_block.alert_summary_fail_counts
  UVM_INFO @ 6629641773 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Test entropy_src_rng_max_rate has 3 failures.

93.entropy_src_rng_max_rate.28625008450680108010704305223301654322405968432550255400381986834704478017760
Line 1620, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/93.entropy_src_rng_max_rate/latest/run.log

  UVM_ERROR @ 7927564891 ps: (entropy_src_scoreboard.sv:2035) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (5 [0x5] vs 4 [0x4]) reg name: entropy_src_reg_block.alert_summary_fail_counts
  UVM_INFO @ 7927564891 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

287.entropy_src_rng_max_rate.98354468814341773873772939054966577777451543063423737676007365579309421276775
Line 886, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/287.entropy_src_rng_max_rate/latest/run.log

  UVM_ERROR @ 2882671031 ps: (entropy_src_scoreboard.sv:2035) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (0 [0x0] vs 1 [0x1]) reg name: entropy_src_reg_block.alert_summary_fail_counts
  UVM_INFO @ 2882671031 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 1 more failures.

UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 2 failures:
- Test entropy_src_rng_max_rate has 2 failures.
  - 83.entropy_src_rng_max_rate.51479052000113992797354246187199203155320775066569869474744559955119297344696
    Line 2207, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/83.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 19315423584 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 19315423584 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 298.entropy_src_rng_max_rate.9590231252048046974159736229280676390127135332670131922849799874269781948038
    Line 1516, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/298.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 7488252372 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 7488252372 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (cip_base_scoreboard.sv:305) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 2 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 90.entropy_src_fw_ov.81507796903755131291510679514504908481397563054440265134834938635003322842460
    Line 857, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/90.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 4895269314 ps: (cip_base_scoreboard.sv:305) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 4895269314 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
- Test entropy_src_rng_max_rate has 1 failures.
  - 312.entropy_src_rng_max_rate.39150912028320121813740689906768697645130387186904508935286868496300714062058
    Line 1193, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/312.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 2240507346 ps: (cip_base_scoreboard.sv:305) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 2240507346 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (entropy_src_scoreboard.sv:2020) [scoreboard] Check failed fw_ov_wr_fifo_full_prediction == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.fw_ov_wr_fifo_full has 1 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 111.entropy_src_fw_ov.38947026426191291508365135650027455650640062078279413722934155837900914175978
    Line 965, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/111.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 2643183257 ps: (entropy_src_scoreboard.sv:2020) [uvm_test_top.env.scoreboard] Check failed fw_ov_wr_fifo_full_prediction == item.d_data (0 [0x0] vs 1 [0x1]) reg name: entropy_src_reg_block.fw_ov_wr_fifo_full
  UVM_INFO @ 2643183257 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 1 failures:
- Test entropy_src_functional_errors has 1 failures.
  - 234.entropy_src_functional_errors.103023423882779404668331553789386127144882150038735027094660679604143827030371
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/234.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10015808081 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x908b84d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10015808081 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```