ENTROPY_SRC Simulation Results

Friday June 21 2024 23:02:45 UTC

GitHub Revision: `de38ce313c`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 40294666978553523170681160506532247841705182588034413483474981853853670477454

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	14.000s	58.211us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	5.000s	166.191us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	4.000s	92.221us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	13.000s	538.091us	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	8.000s	134.926us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	5.000s	33.607us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	4.000s	92.221us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	134.926us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	14.000s	58.211us	50	50	100.00
		entropy_src_rng	4.550m	10.054ms	300	300	100.00
		entropy_src_fw_ov	2.317m	5.024ms	289	300	96.33
V2	firmware_mode	entropy_src_fw_ov	2.317m	5.024ms	289	300	96.33
V2	rng_mode	entropy_src_rng	4.550m	10.054ms	300	300	100.00
V2	rng_max_rate	entropy_src_rng_max_rate	8.817m	10.080ms	389	400	97.25
V2	health_checks	entropy_src_rng	4.550m	10.054ms	300	300	100.00
V2	conditioning	entropy_src_rng	4.550m	10.054ms	300	300	100.00
V2	interrupts	entropy_src_rng	4.550m	10.054ms	300	300	100.00
V2	alerts	entropy_src_rng	4.550m	10.054ms	300	300	100.00
		entropy_src_functional_alerts	15.000s	66.067us	50	50	100.00
V2	stress_all	entropy_src_stress_all	15.000s	123.504us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	9.583m	10.013ms	961	1000	96.10
V2	firmware_ov_read_contiguous_data	entropy_src_fw_ov_contiguous	24.000s	343.303us	50	50	100.00
V2	intr_test	entropy_src_intr_test	4.000s	67.911us	50	50	100.00
V2	alert_test	entropy_src_alert_test	13.000s	44.906us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	7.000s	2.682ms	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	7.000s	2.682ms	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	5.000s	166.191us	5	5	100.00
		entropy_src_csr_rw	4.000s	92.221us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	134.926us	5	5	100.00
		entropy_src_same_csr_outstanding	10.000s	167.784us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	5.000s	166.191us	5	5	100.00
		entropy_src_csr_rw	4.000s	92.221us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	134.926us	5	5	100.00
		entropy_src_same_csr_outstanding	10.000s	167.784us	20	20	100.00
V2		TOTAL			2229	2290	97.34
V2S	tl_intg_err	entropy_src_sec_cm	4.000s	92.733us	5	5	100.00
		entropy_src_tl_intg_err	7.000s	199.740us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	4.550m	10.054ms	300	300	100.00
		entropy_src_cfg_regwen	9.000s	18.701us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	4.550m	10.054ms	300	300	100.00
V2S	sec_cm_config_redun	entropy_src_rng	4.550m	10.054ms	300	300	100.00
V2S	sec_cm_intersig_mubi	entropy_src_rng	4.550m	10.054ms	300	300	100.00
		entropy_src_fw_ov	2.317m	5.024ms	289	300	96.33
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	9.583m	10.013ms	961	1000	96.10
		entropy_src_sec_cm	4.000s	92.733us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	9.583m	10.013ms	961	1000	96.10
		entropy_src_sec_cm	4.000s	92.733us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	4.550m	10.054ms	300	300	100.00
V2S	sec_cm_fifo_ctr_redun	entropy_src_functional_errors	9.583m	10.013ms	961	1000	96.10
		entropy_src_sec_cm	4.000s	92.733us	5	5	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	9.583m	10.013ms	961	1000	96.10
		entropy_src_sec_cm	4.000s	92.733us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	9.583m	10.013ms	961	1000	96.10
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	15.000s	66.067us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	7.000s	199.740us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	4.367m	10.046ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
	Unmapped tests	entropy_src_intr	23.000s	4.826ms	46	50	92.00
		TOTAL			2505	2570	97.47

Testplan Progress

Items	Total	Written	Passing	Progress
N.A.	1	1	0	0.00
V1	6	6	6	100.00
V2	11	11	8	72.73
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
86.73	98.23	95.53	98.38	95.88	88.12	97.92	90.46	58.99

Failure Buckets

UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 14 failures:
- Test entropy_src_functional_errors has 14 failures.
  - 134.entropy_src_functional_errors.18662548117592432550403568030464473316682540271755207665657466063705869273
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/134.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10065583124 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xda8eced8) == 0x1
  UVM_INFO @ 10065583124 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 200.entropy_src_functional_errors.96213184707091936827422544326008252459650180637984907113196224852473033587440
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/200.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10028865952 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x7bd0b0d8) == 0x1
  UVM_INFO @ 10028865952 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 12 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 11 failures:
- Test entropy_src_functional_errors has 11 failures.
  - 35.entropy_src_functional_errors.40415904862059711665470536653931118027169096814968545041240516862303146497653
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/35.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10021130753 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xc4c532d8) == 0x1
  UVM_INFO @ 10021130753 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 115.entropy_src_functional_errors.85285811480176337962146256693110643017945880572873625168630981222023850698797
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/115.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10013105168 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x1b5d41d8) == 0x1
  UVM_INFO @ 10013105168 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 9 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 8 failures:
- Test entropy_src_functional_errors has 8 failures.
  - 136.entropy_src_functional_errors.59083344299227613020393407277531704401065370228676679535598253920872772452798
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/136.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10113559853 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x4688fbd8) == 0x1
  UVM_INFO @ 10113559853 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 469.entropy_src_functional_errors.84667260298020871976091413220486864738966929440427290740141061618745950874484
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/469.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10047460804 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x4886b1d8) == 0x1
  UVM_INFO @ 10047460804 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 6 more failures.

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_*/rtl/sha*.sv,505): Assertion KeccakIdleWhenNoRunHs_A has failed has 7 failures:

Test entropy_src_rng_max_rate has 6 failures.

76.entropy_src_rng_max_rate.68194658812149324983350170564283433994579326006756633036268884207631400992759
Line 2262, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/76.entropy_src_rng_max_rate/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_0.1/rtl/sha3.sv,505): (time 10141381591 PS) Assertion tb.dut.u_entropy_src_core.u_sha3.KeccakIdleWhenNoRunHs_A has failed
  UVM_ERROR @ 10141381591 ps: (sha3.sv:505) [ASSERT FAILED] KeccakIdleWhenNoRunHs_A
  UVM_INFO @ 10141381591 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

82.entropy_src_rng_max_rate.81723137639159576151351874086088912735305367234069128771310859764066053859266
Line 2360, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/82.entropy_src_rng_max_rate/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_0.1/rtl/sha3.sv,505): (time 10009870666 PS) Assertion tb.dut.u_entropy_src_core.u_sha3.KeccakIdleWhenNoRunHs_A has failed
  UVM_ERROR @ 10009870666 ps: (sha3.sv:505) [ASSERT FAILED] KeccakIdleWhenNoRunHs_A
  UVM_INFO @ 10009870666 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 4 more failures.

Test entropy_src_fw_ov has 1 failures.

80.entropy_src_fw_ov.26664675333559151190495921199197588542457948342931716601595759226483061724411
Line 1438, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/80.entropy_src_fw_ov/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_0.1/rtl/sha3.sv,505): (time 5046336879 PS) Assertion tb.dut.u_entropy_src_core.u_sha3.KeccakIdleWhenNoRunHs_A has failed
  UVM_ERROR @ 5046336879 ps: (sha3.sv:505) [ASSERT FAILED] KeccakIdleWhenNoRunHs_A
  UVM_INFO @ 5046336879 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

UVM_ERROR (entropy_src_scoreboard.sv:1885) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.err_code has 5 failures:

Test entropy_src_fw_ov has 5 failures.

27.entropy_src_fw_ov.106314213048244889053714005428634845291093654675897814196618491795837943655593
Line 378, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/27.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 1819287922 ps: (entropy_src_scoreboard.sv:1885) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 1819287922 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

163.entropy_src_fw_ov.75484164979212104672419452670832755677134302595385523849964297920771049181338
Line 958, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/163.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 4905687574 ps: (entropy_src_scoreboard.sv:1885) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 4905687574 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 3 more failures.

UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 5 failures:
- Test entropy_src_fw_ov has 5 failures.
  - 100.entropy_src_fw_ov.28805169077859461858945151329299481050891035235819782659228993037126187015771
    Line 532, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/100.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 2243821414 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 2243821414 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 203.entropy_src_fw_ov.51694481991210739831580199842007842267943655788947594675995230347515132352053
    Line 533, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/203.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 2442264109 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 2442264109 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3406): Assertion Final_PreconFifoPushedPostStartup_A has failed has 4 failures:

Test entropy_src_intr has 4 failures.

0.entropy_src_intr.92296336690062863493648946353828022346350319043848169802225161589173028587837
Line 375, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/0.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3406): (time 517830298 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

5.entropy_src_intr.100206795043145941199923436379280276663883789830085750029345990555767043502846
Line 375, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/5.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3406): (time 1560723320 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

... and 2 more failures.

UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 4 failures:
- Test entropy_src_rng_max_rate has 4 failures.
  - 115.entropy_src_rng_max_rate.6418013365601518618021646921658260347705243328037618396577526732253947501389
    Line 2017, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/115.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 6299873690 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 6299873690 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 264.entropy_src_rng_max_rate.101961355306410010389297415865421009939855077141109755150577769502998160392962
    Line 431, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/264.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 330436853 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 330436853 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 2 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 3 failures:
- Test entropy_src_functional_errors has 3 failures.
  - 518.entropy_src_functional_errors.25271650024242986910528287934365529075736777400435867519384719896813424374324
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/518.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10017198405 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xdab479d8) == 0x1
  UVM_INFO @ 10017198405 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 701.entropy_src_functional_errors.39394540224797000517240049929304419293537713605591101627112381016401839744380
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/701.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10065274435 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x9e9bf0d8) == 0x1
  UVM_INFO @ 10065274435 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 1 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 2 failures:
- Test entropy_src_functional_errors has 2 failures.
  - 125.entropy_src_functional_errors.106094414008732992922918176229121293894880484505940825477249028146224802481379
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/125.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10033252137 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x78df45d8) == 0x1
  UVM_INFO @ 10033252137 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 150.entropy_src_functional_errors.73719902200198772411784076115590335244866298000832410797878995550664801711107
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/150.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10013026191 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x6ef3b2d8) == 0x1
  UVM_INFO @ 10013026191 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 391.entropy_src_rng_max_rate.14557184975551453243724226471374711553440988603495293485520902266095597719864
    Line 3103, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/391.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 6530180530 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 6530180530 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 1 failures:
- Test entropy_src_functional_errors has 1 failures.
  - 655.entropy_src_functional_errors.105748244261330209986063862812009960341712919768132235763263726104647333137582
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/655.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10060330749 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xf41e8fd8) == 0x1
  UVM_INFO @ 10060330749 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```