ENTROPY_SRC Simulation Results

Saturday July 27 2024 23:02:25 UTC

GitHub Revision: `eca25c0ff8`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 6528518538521148567139195500524222710943459299328477504124649113671643189924

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	13.000s	27.566us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	4.000s	77.520us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	4.000s	131.856us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	14.000s	3.917ms	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	8.000s	276.092us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	4.000s	112.911us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	4.000s	131.856us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	276.092us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	13.000s	27.566us	50	50	100.00
		entropy_src_rng	5.400m	10.034ms	300	300	100.00
		entropy_src_fw_ov	2.833m	5.092ms	279	300	93.00
V2	firmware_mode	entropy_src_fw_ov	2.833m	5.092ms	279	300	93.00
V2	rng_mode	entropy_src_rng	5.400m	10.034ms	300	300	100.00
V2	rng_max_rate	entropy_src_rng_max_rate	9.900m	10.071ms	396	400	99.00
V2	health_checks	entropy_src_rng	5.400m	10.034ms	300	300	100.00
V2	conditioning	entropy_src_rng	5.400m	10.034ms	300	300	100.00
V2	interrupts	entropy_src_rng	5.400m	10.034ms	300	300	100.00
		entropy_src_intr	15.000s	1.175ms	50	50	100.00
V2	alerts	entropy_src_rng	5.400m	10.034ms	300	300	100.00
		entropy_src_functional_alerts	12.000s	234.538us	50	50	100.00
V2	stress_all	entropy_src_stress_all	13.000s	778.218us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	9.867m	10.012ms	967	1000	96.70
V2	firmware_ov_read_contiguous_data	entropy_src_fw_ov_contiguous	23.000s	1.636ms	50	50	100.00
V2	intr_test	entropy_src_intr_test	9.000s	23.789us	50	50	100.00
V2	alert_test	entropy_src_alert_test	8.000s	31.261us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	7.000s	642.262us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	7.000s	642.262us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	4.000s	77.520us	5	5	100.00
		entropy_src_csr_rw	4.000s	131.856us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	276.092us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	246.724us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	4.000s	77.520us	5	5	100.00
		entropy_src_csr_rw	4.000s	131.856us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	276.092us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	246.724us	20	20	100.00
V2		TOTAL			2282	2340	97.52
V2S	tl_intg_err	entropy_src_sec_cm	4.000s	188.504us	5	5	100.00
		entropy_src_tl_intg_err	8.000s	236.543us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	5.400m	10.034ms	300	300	100.00
		entropy_src_cfg_regwen	17.000s	24.476us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	5.400m	10.034ms	300	300	100.00
V2S	sec_cm_config_redun	entropy_src_rng	5.400m	10.034ms	300	300	100.00
V2S	sec_cm_intersig_mubi	entropy_src_rng	5.400m	10.034ms	300	300	100.00
		entropy_src_fw_ov	2.833m	5.092ms	279	300	93.00
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	9.867m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	4.000s	188.504us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	9.867m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	4.000s	188.504us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	5.400m	10.034ms	300	300	100.00
V2S	sec_cm_fifo_ctr_redun	entropy_src_functional_errors	9.867m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	4.000s	188.504us	5	5	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	9.867m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	4.000s	188.504us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	9.867m	10.012ms	967	1000	96.70
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	12.000s	234.538us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	8.000s	236.543us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	4.983m	10.020ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
		TOTAL			2512	2570	97.74

Testplan Progress

Items	Total	Written	Passing	Progress
V1	6	6	6	100.00
V2	12	12	9	75.00
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
97.12	98.11	95.22	98.33	95.79	96.62	96.88	90.48	96.00

Failure Buckets

UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 11 failures:
- Test entropy_src_functional_errors has 11 failures.
  - 45.entropy_src_functional_errors.109646630743090827065304769139893703386783437633017642546661014071067966022482
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/45.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10018024604 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x5220d5d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10018024604 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 142.entropy_src_functional_errors.53686195899198458201178568133585818544055688459981556587347379636378882359976
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/142.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10018323022 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x22bf1cd8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10018323022 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 9 more failures.
UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 9 failures:
- Test entropy_src_functional_errors has 9 failures.
  - 117.entropy_src_functional_errors.17928681229141837425350769061169347833683050922635232366571545219151470400918
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/117.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10027458189 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xea37e5d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10027458189 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 262.entropy_src_functional_errors.22125866751258964519169530064309415072875981756912462494351550445314445331157
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/262.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10023545845 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x925246d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10023545845 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 7 more failures.

UVM_ERROR (entropy_src_scoreboard.sv:2031) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.err_code has 8 failures:

Test entropy_src_fw_ov has 8 failures.

25.entropy_src_fw_ov.32394085788000242859306507666307599759087686925179826409130915354121070027323
Line 687, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/25.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 1995363730 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 1995363730 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

53.entropy_src_fw_ov.28264337568813333614951068142137295540922587291460168799503153481058892266685
Line 482, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/53.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 2223608617 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 2223608617 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 6 more failures.

UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 7 failures:
- Test entropy_src_fw_ov has 7 failures.
  - 18.entropy_src_fw_ov.50586930345910748032704451553607737793564109968862702396705890302403151752789
    Line 431, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/18.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 3109206414 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 3109206414 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 63.entropy_src_fw_ov.81203467158885086427286551539626572557303324432678556609041954439237504431008
    Line 654, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/63.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 3454793200 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 3454793200 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 5 more failures.
Exit reason: Error: User command failed UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 5 failures:
- Test entropy_src_fw_ov has 5 failures.
  - 62.entropy_src_fw_ov.14385111620015569384186805671656441433674129891017814124920355094894466235953
    Line 961, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/62.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 4691047835 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 4691047835 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 65.entropy_src_fw_ov.101646337851331513090955369564092942858541607587642225221777037509379986866743
    Line 940, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/65.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 4903377750 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 4903377750 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 5 failures:
- Test entropy_src_functional_errors has 5 failures.
  - 225.entropy_src_functional_errors.96218969912872698560169988305553774793313146918748058751727143239785219703750
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/225.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10016457380 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x579c57d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10016457380 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 277.entropy_src_functional_errors.39035645377480783591403159962000855014445759704488139343060485472393740605897
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/277.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10012361885 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xc02228d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10012361885 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 4 failures:
- Test entropy_src_functional_errors has 4 failures.
  - 509.entropy_src_functional_errors.50279009548309230707624500341831347188709793825056717454881181575300803951345
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/509.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10014703298 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x1e12b6d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10014703298 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 798.entropy_src_functional_errors.93969544177744868887599466082244504867611376877899964942389958062626373613582
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/798.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10017527894 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x422091d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10017527894 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 2 more failures.
UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 3 failures:
- Test entropy_src_functional_errors has 3 failures.
  - 56.entropy_src_functional_errors.9899459121496201902064176555555706068310855415116565281468616500751154649766
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/56.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10017899315 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x7c937bd8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10017899315 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 351.entropy_src_functional_errors.92134132174276661306808371272862142052910477877014529952809640909443146449510
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/351.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10016489630 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x518733d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10016489630 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 1 more failures.
UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 2 failures:
- Test entropy_src_rng_max_rate has 2 failures.
  - 227.entropy_src_rng_max_rate.57199733017073162243764876782057407228787709878594777693792899364354730761900
    Line 852, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/227.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 4533875898 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 4533875898 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 398.entropy_src_rng_max_rate.37094847321779000274612297587762510372194337049639346220490003298006589599681
    Line 841, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/398.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 2663603875 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 2663603875 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (entropy_src_scoreboard.sv:2649) [scoreboard] Check failed match_found == * (* [*] vs * [*]) All candidate csrng seeds have been checked, with no match has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 158.entropy_src_rng_max_rate.109067609258997083715385655299888798060024650073498958644802495258990485534231
    Line 1762, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/158.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 3947331724 ps: (entropy_src_scoreboard.sv:2649) [uvm_test_top.env.scoreboard] Check failed match_found == 1 (0 [0x0] vs 1 [0x1]) All candidate csrng seeds have been checked, with no match
  UVM_INFO @ 3947331724 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3400): Assertion AtReset_EsfinalFifoPushedPostStartup_A has failed has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 219.entropy_src_rng_max_rate.7862010968505602419866910563176703575761016446041345118291242066668790336485
    Line 1861, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/219.entropy_src_rng_max_rate/latest/run.log
```
  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3400): (time 6766153370 PS) Assertion tb.dut.u_entropy_src_core.AtReset_EsfinalFifoPushedPostStartup_A has failed
  UVM_ERROR @ 6766153370 ps: (entropy_src_core.sv:3400) [ASSERT FAILED] AtReset_EsfinalFifoPushedPostStartup_A
  UVM_INFO @ 6766153370 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (entropy_src_scoreboard.sv:2016) [scoreboard] Check failed fw_ov_wr_fifo_full_prediction == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.fw_ov_wr_fifo_full has 1 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 229.entropy_src_fw_ov.54550435978874595677984001714538425318423403814920594467146296877026323301740
    Line 811, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/229.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 3016484911 ps: (entropy_src_scoreboard.sv:2016) [uvm_test_top.env.scoreboard] Check failed fw_ov_wr_fifo_full_prediction == item.d_data (1 [0x1] vs 0 [0x0]) reg name: entropy_src_reg_block.fw_ov_wr_fifo_full
  UVM_INFO @ 3016484911 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 1 failures:
- Test entropy_src_functional_errors has 1 failures.
  - 673.entropy_src_functional_errors.69218827370948613263004215007343584180013341975561406954467436990144947805138
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/673.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10025667609 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x97f988d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10025667609 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```