ENTROPY_SRC Simulation Results

Tuesday July 02 2024 14:17:13 UTC

GitHub Revision: `abd7ce57f2`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 7120396591488306882161367642496372905152431708445539866860566607772054886363

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	13.000s	43.471us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	5.000s	37.472us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	14.000s	38.703us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	14.000s	2.780ms	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	7.000s	214.007us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	9.000s	52.459us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	14.000s	38.703us	20	20	100.00
		entropy_src_csr_aliasing	7.000s	214.007us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	13.000s	43.471us	50	50	100.00
		entropy_src_rng	4.683m	10.040ms	298	300	99.33
		entropy_src_fw_ov	2.367m	5.058ms	285	300	95.00
V2	firmware_mode	entropy_src_fw_ov	2.367m	5.058ms	285	300	95.00
V2	rng_mode	entropy_src_rng	4.683m	10.040ms	298	300	99.33
V2	rng_max_rate	entropy_src_rng_max_rate	8.617m	10.056ms	384	400	96.00
V2	health_checks	entropy_src_rng	4.683m	10.040ms	298	300	99.33
V2	conditioning	entropy_src_rng	4.683m	10.040ms	298	300	99.33
V2	interrupts	entropy_src_rng	4.683m	10.040ms	298	300	99.33
V2	alerts	entropy_src_rng	4.683m	10.040ms	298	300	99.33
		entropy_src_functional_alerts	13.000s	121.069us	50	50	100.00
V2	stress_all	entropy_src_stress_all	16.000s	135.226us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	10.050m	10.012ms	972	1000	97.20
V2	firmware_ov_read_contiguous_data	entropy_src_fw_ov_contiguous	29.000s	334.176us	50	50	100.00
V2	intr_test	entropy_src_intr_test	8.000s	69.829us	50	50	100.00
V2	alert_test	entropy_src_alert_test	12.000s	35.680us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	8.000s	593.775us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	8.000s	593.775us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	5.000s	37.472us	5	5	100.00
		entropy_src_csr_rw	14.000s	38.703us	20	20	100.00
		entropy_src_csr_aliasing	7.000s	214.007us	5	5	100.00
		entropy_src_same_csr_outstanding	15.000s	155.802us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	5.000s	37.472us	5	5	100.00
		entropy_src_csr_rw	14.000s	38.703us	20	20	100.00
		entropy_src_csr_aliasing	7.000s	214.007us	5	5	100.00
		entropy_src_same_csr_outstanding	15.000s	155.802us	20	20	100.00
V2		TOTAL			2229	2290	97.34
V2S	tl_intg_err	entropy_src_sec_cm	4.000s	266.491us	5	5	100.00
		entropy_src_tl_intg_err	7.000s	187.321us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	4.683m	10.040ms	298	300	99.33
		entropy_src_cfg_regwen	4.000s	23.806us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	4.683m	10.040ms	298	300	99.33
V2S	sec_cm_config_redun	entropy_src_rng	4.683m	10.040ms	298	300	99.33
V2S	sec_cm_intersig_mubi	entropy_src_rng	4.683m	10.040ms	298	300	99.33
		entropy_src_fw_ov	2.367m	5.058ms	285	300	95.00
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	10.050m	10.012ms	972	1000	97.20
		entropy_src_sec_cm	4.000s	266.491us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	10.050m	10.012ms	972	1000	97.20
		entropy_src_sec_cm	4.000s	266.491us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	4.683m	10.040ms	298	300	99.33
V2S	sec_cm_fifo_ctr_redun	entropy_src_functional_errors	10.050m	10.012ms	972	1000	97.20
		entropy_src_sec_cm	4.000s	266.491us	5	5	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	10.050m	10.012ms	972	1000	97.20
		entropy_src_sec_cm	4.000s	266.491us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	10.050m	10.012ms	972	1000	97.20
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	13.000s	121.069us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	7.000s	187.321us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	4.683m	10.036ms	49	50	98.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			49	50	98.00
	Unmapped tests	entropy_src_intr	30.000s	498.614us	44	50	88.00
		TOTAL			2502	2570	97.35

Testplan Progress

Items	Total	Written	Passing	Progress
N.A.	1	1	0	0.00
V1	6	6	6	100.00
V2	11	11	7	63.64
V2S	3	3	3	100.00
V3	2	1	0	0.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
97.09	98.15	95.32	98.33	95.79	96.62	96.88	90.48	95.54

Failure Buckets

UVM_ERROR (entropy_src_scoreboard.sv:1905) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.err_code has 9 failures:

Test entropy_src_fw_ov has 9 failures.

2.entropy_src_fw_ov.94187357247369700098039281501197595043613346798935059745189121094955116344253
Line 1291, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/2.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 4758499316 ps: (entropy_src_scoreboard.sv:1905) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 4758499316 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

19.entropy_src_fw_ov.101177411759644270271583428730020196525615108460400438894704546732327515724356
Line 536, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/19.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 5107559571 ps: (entropy_src_scoreboard.sv:1905) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 5107559571 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 7 more failures.

UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 8 failures:
- Test entropy_src_functional_errors has 8 failures.
  - 74.entropy_src_functional_errors.33350586796486970699928997339277316077296407220253247374601529918401407902204
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/74.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10181351536 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x6d0953d8) == 0x1
  UVM_INFO @ 10181351536 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 130.entropy_src_functional_errors.43864715455192614958348447135648140554659887905443950035452073696189758047491
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/130.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10015441352 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x585524d8) == 0x1
  UVM_INFO @ 10015441352 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 6 more failures.

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3414): Assertion Final_PreconFifoPushedPostStartup_A has failed has 6 failures:

Test entropy_src_intr has 6 failures.

1.entropy_src_intr.71154232313280986311081249100468554210260203571008447683235878594659274991459
Line 375, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/1.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3414): (time 548775136 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

8.entropy_src_intr.96709474349524225543650049462224633290173199634020388583158076578817146159132
Line 375, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/8.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3414): (time 524790153 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

... and 4 more failures.

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_*/rtl/sha*.sv,505): Assertion KeccakIdleWhenNoRunHs_A has failed has 6 failures:

Test entropy_src_rng has 1 failures.

13.entropy_src_rng.82228692961627319231441854359171787673672380387725470963284929988953270400221
Line 2261, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/13.entropy_src_rng/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_0.1/rtl/sha3.sv,505): (time 10001613110 PS) Assertion tb.dut.u_entropy_src_core.u_sha3.KeccakIdleWhenNoRunHs_A has failed
  UVM_ERROR @ 10001613110 ps: (sha3.sv:505) [ASSERT FAILED] KeccakIdleWhenNoRunHs_A
  UVM_INFO @ 10001613110 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Test entropy_src_rng_max_rate has 5 failures.

26.entropy_src_rng_max_rate.9028282185928653199440102581547803188166386053058254727829613695587096703600
Line 1816, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/26.entropy_src_rng_max_rate/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_0.1/rtl/sha3.sv,505): (time 10036110270 PS) Assertion tb.dut.u_entropy_src_core.u_sha3.KeccakIdleWhenNoRunHs_A has failed
  UVM_ERROR @ 10036110270 ps: (sha3.sv:505) [ASSERT FAILED] KeccakIdleWhenNoRunHs_A
  UVM_INFO @ 10036110270 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

196.entropy_src_rng_max_rate.7545160113941305060348147826392103186326005755846673515769923937686073204213
Line 1912, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/196.entropy_src_rng_max_rate/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_0.1/rtl/sha3.sv,505): (time 10010723583 PS) Assertion tb.dut.u_entropy_src_core.u_sha3.KeccakIdleWhenNoRunHs_A has failed
  UVM_ERROR @ 10010723583 ps: (sha3.sv:505) [ASSERT FAILED] KeccakIdleWhenNoRunHs_A
  UVM_INFO @ 10010723583 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 3 more failures.

UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 6 failures:
- Test entropy_src_functional_errors has 6 failures.
  - 56.entropy_src_functional_errors.49839261437387045662088349765700822985102415402082071745288280606744616206587
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/56.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10147677381 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xc7b807d8) == 0x1
  UVM_INFO @ 10147677381 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 139.entropy_src_functional_errors.89329492277876973568259668252138586073084624057323012618102449540619408928386
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/139.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10044871491 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x58f608d8) == 0x1
  UVM_INFO @ 10044871491 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 4 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 6 failures:
- Test entropy_src_functional_errors has 6 failures.
  - 103.entropy_src_functional_errors.86224970726791451434739097808453334875108215938945658687134502627594879503577
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/103.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10030147638 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x5eab6ed8) == 0x1
  UVM_INFO @ 10030147638 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 240.entropy_src_functional_errors.99543971947178531591215858425501132505150324899153096839666615258248961643871
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/240.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10017005130 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x3d0f08d8) == 0x1
  UVM_INFO @ 10017005130 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 4 more failures.
UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 5 failures:
- Test entropy_src_fw_ov has 5 failures.
  - 37.entropy_src_fw_ov.7165367781255828909589337828854362434394874418815676278102158225315584838452
    Line 431, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/37.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 2525562587 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 2525562587 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 47.entropy_src_fw_ov.34718593514766913914876783270264595492392156560695296945741044391353421165970
    Line 634, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/47.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 4318414973 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 4318414973 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.
UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 5 failures:
- Test entropy_src_rng_max_rate has 5 failures.
  - 117.entropy_src_rng_max_rate.88538441334481426082306604995794310957939510369449746450399260416209711551014
    Line 1195, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/117.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 5597631334 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 5597631334 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 168.entropy_src_rng_max_rate.49596343835295617938754862277643115899150614909744264340409940838655032711575
    Line 1043, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/168.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 7902863170 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 7902863170 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 4 failures:
- Test entropy_src_functional_errors has 4 failures.
  - 439.entropy_src_functional_errors.79454703433113212571752113836276289381470537218962995470169039331313078931768
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/439.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10028529648 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xccf434d8) == 0x1
  UVM_INFO @ 10028529648 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 623.entropy_src_functional_errors.44388097894250169072518469336470034138966968682472465016727472770772598986983
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/623.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10017209048 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xe497f7d8) == 0x1
  UVM_INFO @ 10017209048 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 2 more failures.
UVM_ERROR (cip_base_scoreboard.sv:302) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 2 failures:
- Test entropy_src_rng has 1 failures.
  - 93.entropy_src_rng.94394222169911915880572366077968847061042806901484326154834359658213158044428
    Line 486, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/93.entropy_src_rng/latest/run.log
```
  UVM_ERROR @ 1519823205 ps: (cip_base_scoreboard.sv:302) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 1519823205 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
- Test entropy_src_rng_max_rate has 1 failures.
  - 207.entropy_src_rng_max_rate.31790935676471657650328747271844352207083937223554101049603754043387639327666
    Line 1659, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/207.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 8494124780 ps: (cip_base_scoreboard.sv:302) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 8494124780 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 2 failures:
- Test entropy_src_functional_errors has 2 failures.
  - 172.entropy_src_functional_errors.95997143220708781587439281145803944119078374127563618478311883565342443956806
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/172.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10082968953 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x6e1f38d8) == 0x1
  UVM_INFO @ 10082968953 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 705.entropy_src_functional_errors.26721700699507576453748677734936178531155694318070589974297065781235261808315
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/705.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10013092405 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xc84ef1d8) == 0x1
  UVM_INFO @ 10013092405 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3402): Assertion AtReset_EsfinalFifoPushedPostStartup_A has failed has 2 failures:

Test entropy_src_rng_max_rate has 2 failures.

265.entropy_src_rng_max_rate.93959768203045734472044929967039213998696741812759841457348058253335664083818
Line 2785, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/265.entropy_src_rng_max_rate/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3402): (time 7557888817 PS) Assertion tb.dut.u_entropy_src_core.AtReset_EsfinalFifoPushedPostStartup_A has failed
  UVM_ERROR @ 7557888817 ps: (entropy_src_core.sv:3402) [ASSERT FAILED] AtReset_EsfinalFifoPushedPostStartup_A
  UVM_INFO @ 7557888817 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

323.entropy_src_rng_max_rate.37050167152794017411485499012277801786724071990412491155406941142579559164624
Line 2119, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/323.entropy_src_rng_max_rate/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3402): (time 9191674381 PS) Assertion tb.dut.u_entropy_src_core.AtReset_EsfinalFifoPushedPostStartup_A has failed
  UVM_ERROR @ 9191674381 ps: (entropy_src_core.sv:3402) [ASSERT FAILED] AtReset_EsfinalFifoPushedPostStartup_A
  UVM_INFO @ 9191674381 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Exit reason: Error: User command failed UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 2 failures:
- Test entropy_src_rng_max_rate has 2 failures.
  - 290.entropy_src_rng_max_rate.104741194414091398907705737770288689485818856168624189735470215184339509146112
    Line 734, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/290.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 1271160598 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 1271160598 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 366.entropy_src_rng_max_rate.29198537680225716116879077868685581964384973555054706105770985644017456909300
    Line 859, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/366.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 1914530056 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 1914530056 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 2 failures:
- Test entropy_src_functional_errors has 2 failures.
  - 753.entropy_src_functional_errors.101171048218834113579470562227340011728457841105743963673071048705260659943380
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/753.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10070408435 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x2026fad8) == 0x1
  UVM_INFO @ 10070408435 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 939.entropy_src_functional_errors.63915219051008427703337184499264044620745744925932184837629741947754486878297
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/939.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10011639282 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xa1023cd8) == 0x1
  UVM_INFO @ 10011639282 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3387): Assertion PreconPostStartupDiffNonNegative_A has failed has 1 failures:
- Test entropy_src_rng_with_xht_rsps has 1 failures.
  - 20.entropy_src_rng_with_xht_rsps.6921994262259133946808659231658850875832259996395695296660190537125872020977
    Line 1163, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/20.entropy_src_rng_with_xht_rsps/latest/run.log
```
  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3387): (time 8674562159 PS) Assertion tb.dut.u_entropy_src_core.unmblk1.PreconPostStartupDiffNonNegative_A has failed
  UVM_ERROR @ 8674562159 ps: (entropy_src_core.sv:3387) [ASSERT FAILED] PreconPostStartupDiffNonNegative_A
  UVM_INFO @ 8674562159 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 1 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 159.entropy_src_fw_ov.106175817428590389393388722966185540360061603233287770459625483778199357556071
    Line 791, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/159.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 4135449414 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 4135449414 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (entropy_src_scoreboard.sv:1905) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.alert_summary_fail_counts has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 352.entropy_src_rng_max_rate.106931119737432253628661500108516612048304749059783168391547468138648620152840
    Line 889, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/352.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 951997148 ps: (entropy_src_scoreboard.sv:1905) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (0 [0x0] vs 1 [0x1]) reg name: entropy_src_reg_block.alert_summary_fail_counts
  UVM_INFO @ 951997148 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```