ENTROPY_SRC Simulation Results

Thursday May 30 2024 19:02:59 UTC

GitHub Revision: `8cb25a6867`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 26638040090898561482658723926798947801831709189350919955228328310045202344042

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	4.000s	26.064us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	4.000s	67.864us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	4.000s	113.220us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	15.000s	1.361ms	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	8.000s	814.223us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	8.000s	54.365us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	4.000s	113.220us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	814.223us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	4.000s	26.064us	50	50	100.00
		entropy_src_rng	4.617m	10.076ms	300	300	100.00
		entropy_src_fw_ov	2.417m	5.024ms	289	300	96.33
V2	firmware_mode	entropy_src_fw_ov	2.417m	5.024ms	289	300	96.33
V2	rng_mode	entropy_src_rng	4.617m	10.076ms	300	300	100.00
V2	rng_max_rate	entropy_src_rng_max_rate	8.700m	10.084ms	382	400	95.50
V2	health_checks	entropy_src_rng	4.617m	10.076ms	300	300	100.00
V2	conditioning	entropy_src_rng	4.617m	10.076ms	300	300	100.00
V2	interrupts	entropy_src_rng	4.617m	10.076ms	300	300	100.00
V2	alerts	entropy_src_rng	4.617m	10.076ms	300	300	100.00
		entropy_src_functional_alerts	5.000s	951.042us	50	50	100.00
V2	stress_all	entropy_src_stress_all	10.000s	330.139us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	9.667m	10.012ms	961	1000	96.10
V2	firmware_ov_read_contiguous_data	entropy_src_fw_ov_contiguous	23.000s	2.384ms	50	50	100.00
V2	intr_test	entropy_src_intr_test	8.000s	23.528us	50	50	100.00
V2	alert_test	entropy_src_alert_test	4.000s	26.347us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	10.000s	317.782us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	10.000s	317.782us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	4.000s	67.864us	5	5	100.00
		entropy_src_csr_rw	4.000s	113.220us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	814.223us	5	5	100.00
		entropy_src_same_csr_outstanding	4.000s	266.517us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	4.000s	67.864us	5	5	100.00
		entropy_src_csr_rw	4.000s	113.220us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	814.223us	5	5	100.00
		entropy_src_same_csr_outstanding	4.000s	266.517us	20	20	100.00
V2		TOTAL			2222	2290	97.03
V2S	tl_intg_err	entropy_src_sec_cm	4.000s	63.060us	5	5	100.00
		entropy_src_tl_intg_err	10.000s	308.017us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	4.617m	10.076ms	300	300	100.00
		entropy_src_cfg_regwen	4.000s	41.201us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	4.617m	10.076ms	300	300	100.00
V2S	sec_cm_config_redun	entropy_src_rng	4.617m	10.076ms	300	300	100.00
V2S	sec_cm_intersig_mubi	entropy_src_rng	4.617m	10.076ms	300	300	100.00
		entropy_src_fw_ov	2.417m	5.024ms	289	300	96.33
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	9.667m	10.012ms	961	1000	96.10
		entropy_src_sec_cm	4.000s	63.060us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	9.667m	10.012ms	961	1000	96.10
		entropy_src_sec_cm	4.000s	63.060us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	4.617m	10.076ms	300	300	100.00
V2S	sec_cm_fifo_ctr_redun	entropy_src_functional_errors	9.667m	10.012ms	961	1000	96.10
		entropy_src_sec_cm	4.000s	63.060us	5	5	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	9.667m	10.012ms	961	1000	96.10
		entropy_src_sec_cm	4.000s	63.060us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	9.667m	10.012ms	961	1000	96.10
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	5.000s	951.042us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	10.000s	308.017us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	4.850m	10.085ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
	Unmapped tests	entropy_src_intr	30.000s	1.959ms	44	50	88.00
		TOTAL			2496	2570	97.12

Testplan Progress

Items	Total	Written	Passing	Progress
N.A.	1	1	0	0.00
V1	6	6	6	100.00
V2	11	11	8	72.73
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
86.59	98.21	95.47	98.36	95.84	88.15	96.88	90.46	58.52

Failure Buckets

UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 16 failures:
- Test entropy_src_functional_errors has 16 failures.
  - 21.entropy_src_functional_errors.94703247521734338193560903079293078131730746863151522355312601137667201351627
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/21.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10064699986 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x621b19d8) == 0x1
  UVM_INFO @ 10064699986 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 134.entropy_src_functional_errors.101595678556683127580956585979357915073214890891368227491885857753805052756680
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/134.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10066223571 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xe5d576d8) == 0x1
  UVM_INFO @ 10066223571 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 14 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 11 failures:
- Test entropy_src_functional_errors has 11 failures.
  - 11.entropy_src_functional_errors.100186764039783234031028143876315831507623108048517891847199560003479298295681
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/11.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10018099123 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x671279d8) == 0x1
  UVM_INFO @ 10018099123 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 229.entropy_src_functional_errors.114629919232925725951258811961567548639126777287170801907652553879207782377660
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/229.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10076913750 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x22bfb3d8) == 0x1
  UVM_INFO @ 10076913750 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 9 more failures.

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_*/rtl/sha*.sv,505): Assertion KeccakIdleWhenNoRunHs_A has failed has 8 failures:

Test entropy_src_rng_max_rate has 7 failures.

17.entropy_src_rng_max_rate.38145143012171864199188794079428897613508465425938823399817834835207563291542
Line 3980, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/17.entropy_src_rng_max_rate/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_0.1/rtl/sha3.sv,505): (time 10061051340 PS) Assertion tb.dut.u_entropy_src_core.u_sha3.KeccakIdleWhenNoRunHs_A has failed
  UVM_ERROR @ 10061051340 ps: (sha3.sv:505) [ASSERT FAILED] KeccakIdleWhenNoRunHs_A
  UVM_INFO @ 10061051340 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

73.entropy_src_rng_max_rate.112900035042011838190183387733757339882581583909887705042846087793051214899401
Line 4053, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/73.entropy_src_rng_max_rate/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_0.1/rtl/sha3.sv,505): (time 10006533203 PS) Assertion tb.dut.u_entropy_src_core.u_sha3.KeccakIdleWhenNoRunHs_A has failed
  UVM_ERROR @ 10006533203 ps: (sha3.sv:505) [ASSERT FAILED] KeccakIdleWhenNoRunHs_A
  UVM_INFO @ 10006533203 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 5 more failures.

Test entropy_src_fw_ov has 1 failures.

216.entropy_src_fw_ov.52739692639569421320516654120715916380888078572727604038354705182789603358047
Line 693, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/216.entropy_src_fw_ov/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_0.1/rtl/sha3.sv,505): (time 5011815880 PS) Assertion tb.dut.u_entropy_src_core.u_sha3.KeccakIdleWhenNoRunHs_A has failed
  UVM_ERROR @ 5011815880 ps: (sha3.sv:505) [ASSERT FAILED] KeccakIdleWhenNoRunHs_A
  UVM_INFO @ 5011815880 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 7 failures:
- Test entropy_src_fw_ov has 7 failures.
  - 63.entropy_src_fw_ov.19062814054876456149301209050569616514274192830875886432006382354971674346384
    Line 543, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/63.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 3732281063 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 3732281063 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 116.entropy_src_fw_ov.94539921024246356870588651308034637296900848642529633345454875749576782904079
    Line 379, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/116.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 2903573265 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 2903573265 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 5 more failures.

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3392): Assertion Final_PreconFifoPushedPostStartup_A has failed has 6 failures:

Test entropy_src_intr has 6 failures.

9.entropy_src_intr.7488706939833283270255120844591270797404217834873945954063470029178414940186
Line 375, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/9.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3392): (time 532879178 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

13.entropy_src_intr.86918172337342525699881600279939791225311676977142380282263178323847935647921
Line 375, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/13.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3392): (time 944967840 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

... and 4 more failures.

UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 6 failures:
- Test entropy_src_rng_max_rate has 6 failures.
  - 120.entropy_src_rng_max_rate.304470673983147603558341163591851348505296365645069277024684379162938617234
    Line 1096, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/120.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 8380968167 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 8380968167 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 204.entropy_src_rng_max_rate.43463880905153878861276591801196470930842558053210692819747214785834531347816
    Line 1001, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/204.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 3013574584 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 3013574584 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 4 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 5 failures:
- Test entropy_src_functional_errors has 5 failures.
  - 108.entropy_src_functional_errors.29832363152215450309905673838584410915675869317413418481619925460086422526843
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/108.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10015343782 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x50e8cad8) == 0x1
  UVM_INFO @ 10015343782 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 173.entropy_src_functional_errors.105263947770700354480630820574717854506770966123732456530671236181913607384783
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/173.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10015728221 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x7aa803d8) == 0x1
  UVM_INFO @ 10015728221 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.
Exit reason: Error: User command failed UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 3 failures:
- Test entropy_src_fw_ov has 3 failures.
  - 100.entropy_src_fw_ov.82794448618300484394408719099951971214134828072597757705370584142511211779289
    Line 532, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/100.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 1751867731 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 1751867731 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 107.entropy_src_fw_ov.100020969257691383947218312381732322705420279602248702180967459603205635852946
    Line 875, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/107.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 4538069813 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 4538069813 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 1 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 3 failures:
- Test entropy_src_functional_errors has 3 failures.
  - 333.entropy_src_functional_errors.36433115323508213680227411574264290979957819420234044361486757200410262744871
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/333.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10013250704 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xcd614d8) == 0x1
  UVM_INFO @ 10013250704 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 737.entropy_src_functional_errors.68293686307083122213153039011260537337479164841643112844205532466757637473017
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/737.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10031837838 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xd12ce5d8) == 0x1
  UVM_INFO @ 10031837838 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 1 more failures.
UVM_ERROR (cip_base_scoreboard.sv:302) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 2 failures:
- Test entropy_src_rng_max_rate has 2 failures.
  - 187.entropy_src_rng_max_rate.20811508519404634656396531091847038746517693772303701425066904892178060805067
    Line 853, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/187.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 2265191814 ps: (cip_base_scoreboard.sv:302) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 2265191814 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 235.entropy_src_rng_max_rate.99255155844089111035223766436439864751439999951219397543082686483770514376286
    Line 1884, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/235.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 8991617093 ps: (cip_base_scoreboard.sv:302) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 8991617093 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 2 failures:
- Test entropy_src_functional_errors has 2 failures.
  - 255.entropy_src_functional_errors.115509535609168034029564626415377654336901963889186709581158683152386760819689
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/255.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10124292028 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x45fb9ad8) == 0x1
  UVM_INFO @ 10124292028 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 847.entropy_src_functional_errors.108483028849024027774676004772185989191890406607203620151042914274590301126476
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/847.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10013232114 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x64b4b8d8) == 0x1
  UVM_INFO @ 10013232114 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 2 failures:
- Test entropy_src_functional_errors has 2 failures.
  - 313.entropy_src_functional_errors.47353672100525658369777514276974415160834162704182150048748873869583006039374
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/313.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10018901775 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x3131c4d8) == 0x1
  UVM_INFO @ 10018901775 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 859.entropy_src_functional_errors.15040369422881754052069753307603063144812100344841158831739964233521801519636
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/859.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10035439692 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x8b3d60d8) == 0x1
  UVM_INFO @ 10035439692 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_ERROR (cip_base_scoreboard.sv:302) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 72.entropy_src_rng_max_rate.420356452439610004691066688657636250246568416834708087549836197521642941105
    Line 4826, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/72.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 9885435079 ps: (cip_base_scoreboard.sv:302) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 9885435079 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3380): Assertion Final_EsfinalFifoPushedPostStartup_A has failed has 1 failures:

Test entropy_src_rng_max_rate has 1 failures.

103.entropy_src_rng_max_rate.83008395099741706889131263159113609609617103623059501997279919018907951219468
Line 4521, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/103.entropy_src_rng_max_rate/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3380): (time 10030785489 PS) Assertion tb.dut.u_entropy_src_core.Final_EsfinalFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

Exit reason: Error: User command failed UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 328.entropy_src_rng_max_rate.18231050632038111127096058931612919954278692568346726114043622741325557316757
    Line 839, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/328.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 3296737596 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 3296737596 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```