ENTROPY_SRC Simulation Results

Tuesday August 13 2024 23:04:47 UTC

GitHub Revision: `098010d125`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 12185085088694708177096441863424670920996379189869351644310607217057882846251

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	9.000s	33.080us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	7.000s	65.908us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	6.000s	49.952us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	14.000s	1.527ms	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	5.000s	957.484us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	9.000s	96.179us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	6.000s	49.952us	20	20	100.00
		entropy_src_csr_aliasing	5.000s	957.484us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	9.000s	33.080us	50	50	100.00
		entropy_src_rng	10.400m	20.062ms	299	300	99.67
		entropy_src_fw_ov	11.350m	20.087ms	259	300	86.33
V2	firmware_mode	entropy_src_fw_ov	11.350m	20.087ms	259	300	86.33
V2	rng_mode	entropy_src_rng	10.400m	20.062ms	299	300	99.67
V2	rng_max_rate	entropy_src_rng_max_rate	19.000m	20.026ms	391	400	97.75
V2	health_checks	entropy_src_rng	10.400m	20.062ms	299	300	99.67
V2	conditioning	entropy_src_rng	10.400m	20.062ms	299	300	99.67
V2	interrupts	entropy_src_rng	10.400m	20.062ms	299	300	99.67
		entropy_src_intr	33.000s	503.489us	50	50	100.00
V2	alerts	entropy_src_rng	10.400m	20.062ms	299	300	99.67
		entropy_src_functional_alerts	19.000s	61.602us	50	50	100.00
V2	stress_all	entropy_src_stress_all	8.933m	20.180ms	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	9.283m	10.013ms	965	1000	96.50
V2	firmware_ov_read_contiguous_data	entropy_src_fw_ov_contiguous	24.000s	351.590us	50	50	100.00
V2	intr_test	entropy_src_intr_test	12.000s	15.678us	50	50	100.00
V2	alert_test	entropy_src_alert_test	8.000s	23.065us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	15.000s	42.390us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	15.000s	42.390us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	7.000s	65.908us	5	5	100.00
		entropy_src_csr_rw	6.000s	49.952us	20	20	100.00
		entropy_src_csr_aliasing	5.000s	957.484us	5	5	100.00
		entropy_src_same_csr_outstanding	11.000s	25.638us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	7.000s	65.908us	5	5	100.00
		entropy_src_csr_rw	6.000s	49.952us	20	20	100.00
		entropy_src_csr_aliasing	5.000s	957.484us	5	5	100.00
		entropy_src_same_csr_outstanding	11.000s	25.638us	20	20	100.00
V2		TOTAL			2254	2340	96.32
V2S	tl_intg_err	entropy_src_sec_cm	4.000s	537.190us	5	5	100.00
		entropy_src_tl_intg_err	13.000s	646.884us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	10.400m	20.062ms	299	300	99.67
		entropy_src_cfg_regwen	8.000s	45.318us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	10.400m	20.062ms	299	300	99.67
V2S	sec_cm_config_redun	entropy_src_rng	10.400m	20.062ms	299	300	99.67
V2S	sec_cm_intersig_mubi	entropy_src_rng	10.400m	20.062ms	299	300	99.67
		entropy_src_fw_ov	11.350m	20.087ms	259	300	86.33
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	9.283m	10.013ms	965	1000	96.50
		entropy_src_sec_cm	4.000s	537.190us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	9.283m	10.013ms	965	1000	96.50
		entropy_src_sec_cm	4.000s	537.190us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	10.400m	20.062ms	299	300	99.67
V2S	sec_cm_fifo_ctr_redun	entropy_src_functional_errors	9.283m	10.013ms	965	1000	96.50
		entropy_src_sec_cm	4.000s	537.190us	5	5	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	9.283m	10.013ms	965	1000	96.50
		entropy_src_sec_cm	4.000s	537.190us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	9.283m	10.013ms	965	1000	96.50
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	19.000s	61.602us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	13.000s	646.884us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	10.133m	20.086ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
		TOTAL			2484	2570	96.65

Testplan Progress

Items	Total	Written	Passing	Progress
V1	6	6	6	100.00
V2	12	12	8	66.67
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
97.18	98.15	95.32	98.33	95.84	96.71	96.88	90.83	96.16

Failure Buckets

UVM_ERROR (entropy_src_scoreboard.sv:2073) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.err_code has 20 failures:

Test entropy_src_fw_ov has 20 failures.

12.entropy_src_fw_ov.50762634777308689680417866545046543976994341986491751910481353350606712348344
Line 379, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/12.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 1591415803 ps: (entropy_src_scoreboard.sv:2073) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 1591415803 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

22.entropy_src_fw_ov.62723735084003800809218207614623972063737306412767732074019740135630801766003
Line 532, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/22.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 2248377293 ps: (entropy_src_scoreboard.sv:2073) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 2248377293 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 18 more failures.

UVM_ERROR (cip_base_scoreboard.sv:243) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 14 failures:
- Test entropy_src_fw_ov has 14 failures.
  - 35.entropy_src_fw_ov.785593684703929163006054733774815966082289618722642695095280709668001920928
    Line 533, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/35.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 5811458235 ps: (cip_base_scoreboard.sv:243) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 5811458235 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 41.entropy_src_fw_ov.22283054623458782817390518818614353082107876826581655029119552589256419999944
    Line 1246, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/41.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 10403116782 ps: (cip_base_scoreboard.sv:243) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 10403116782 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 12 more failures.
UVM_FATAL (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 9 failures:
- Test entropy_src_functional_errors has 9 failures.
  - 0.entropy_src_functional_errors.97422716885126108426403484406689812304173295183576989717517340411399776070900
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/0.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10014387147 ps: (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xe0c3f3d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10014387147 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 46.entropy_src_functional_errors.12629966941159544226035423643751743335414924862843862958300897935296113448436
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/46.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10062893269 ps: (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xf8937dd8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10062893269 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 7 more failures.
UVM_FATAL (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 8 failures:
- Test entropy_src_functional_errors has 8 failures.
  - 335.entropy_src_functional_errors.44645563624846764758718230421087256675313064134153442791457268814597797600382
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/335.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10012367436 ps: (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x10d501d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10012367436 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 408.entropy_src_functional_errors.17324664599127552875885935838995816507819397235800646110192729777108782793511
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/408.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10066176093 ps: (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x98d505d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10066176093 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 6 more failures.
UVM_FATAL (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 7 failures:
- Test entropy_src_functional_errors has 7 failures.
  - 137.entropy_src_functional_errors.70781272692383971618009690060773473710687858037831461359265807063708278134331
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/137.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10068593207 ps: (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x9ef2a6d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10068593207 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 290.entropy_src_functional_errors.107854675828993274412010104915916953986268294163185673304266438290473287484459
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/290.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10055367912 ps: (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x5385a9d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10055367912 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 5 more failures.
Exit reason: Error: User command failed UVM_ERROR (cip_base_scoreboard.sv:243) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 6 failures:
- Test entropy_src_fw_ov has 6 failures.
  - 24.entropy_src_fw_ov.100355651572777886584574867625960075147223971453529827435669822034397125395831
    Line 1399, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/24.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 9339468458 ps: (cip_base_scoreboard.sv:243) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 9339468458 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 110.entropy_src_fw_ov.39936419854852430975226008426292663571858277946755687176176943138975709220877
    Line 1246, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/110.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 7332348480 ps: (cip_base_scoreboard.sv:243) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 7332348480 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 4 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 5 failures:
- Test entropy_src_functional_errors has 5 failures.
  - 24.entropy_src_functional_errors.5075672490367007440659492511553367416594292713313823071158111837667628921151
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/24.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10033737961 ps: (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xc984c7d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10033737961 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 181.entropy_src_functional_errors.114684681598906668090728514384202434196445757524066290606903156740601859892100
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/181.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10072452382 ps: (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xf46d61d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10072452382 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 5 failures:
- Test entropy_src_functional_errors has 5 failures.
  - 127.entropy_src_functional_errors.89210328642143990205535428871081269173160976902338141520133835398592224994304
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/127.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10017444346 ps: (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xcb5b85d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10017444346 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 300.entropy_src_functional_errors.76234253694936020849324226098445162613082581256765811257053270760514438158511
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/300.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10114828741 ps: (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x5bf3f6d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10114828741 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.
UVM_ERROR (entropy_src_scoreboard.sv:2073) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.alert_summary_fail_counts has 3 failures:
- Test entropy_src_rng_max_rate has 3 failures.
  - 76.entropy_src_rng_max_rate.53584054093836084215568405232990494474404489723931736542289176364084215028021
    Line 1807, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/76.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 9075977352 ps: (entropy_src_scoreboard.sv:2073) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (0 [0x0] vs 1 [0x1]) reg name: entropy_src_reg_block.alert_summary_fail_counts
  UVM_INFO @ 9075977352 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 104.entropy_src_rng_max_rate.105384360629160966313828428951312347249784077780420097835393474036385128572688
    Line 2225, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/104.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 17679786907 ps: (entropy_src_scoreboard.sv:2073) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (6 [0x6] vs 5 [0x5]) reg name: entropy_src_reg_block.alert_summary_fail_counts
  UVM_INFO @ 17679786907 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 1 more failures.

Exit reason: Error: User command failed Job returned non-zero exit code has 2 failures:

Test entropy_src_rng_max_rate has 2 failures.

244.entropy_src_rng_max_rate.44895270039235971375766436925197194112589616736526949076717469792373283860209
Log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/244.entropy_src_rng_max_rate/latest/run.log

    workdir  :  /workspace/coverage
    dutinst  :  tb.dut(entropy_src)
    scope    :  default
    testname :  244.entropy_src_rng_max_rate.391753457
  
  coverage files:
    model(design data) :  /workspace/coverage/default/244.entropy_src_rng_max_rate.391753457/icc_5feb958b_5eb9357c.ucm
    data               :  /workspace/coverage/default/244.entropy_src_rng_max_rate.391753457/icc_5feb958b_5eb9357c.ucd
  TOOL:    xrun(64)    21.09-s006: Exiting on Aug 13, 2024 at 17:29:18 PDT  (total: 00:01:37)
  make: *** [/workspace/mnt/repo_top/hw/dv/tools/dvsim/sim.mk:191: simulate] Error 1

373.entropy_src_rng_max_rate.109608233307899379114377111238890356814500401147552636267130535612425709923051
Log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/373.entropy_src_rng_max_rate/latest/run.log

    workdir  :  /workspace/coverage
    dutinst  :  tb.dut(entropy_src)
    scope    :  default
    testname :  373.entropy_src_rng_max_rate.23177963
  
  coverage files:
    model(design data) :  /workspace/coverage/default/373.entropy_src_rng_max_rate.23177963/icc_5feb958b_5eb9357c.ucm
    data               :  /workspace/coverage/default/373.entropy_src_rng_max_rate.23177963/icc_5feb958b_5eb9357c.ucd
  TOOL:    xrun(64)    21.09-s006: Exiting on Aug 13, 2024 at 17:39:31 PDT  (total: 00:09:26)
  make: *** [/workspace/mnt/repo_top/hw/dv/tools/dvsim/sim.mk:191: simulate] Error 1

UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 65.entropy_src_rng_max_rate.3264309304449655159788166845245606966274266639017491476029944535771319872996
    Line 535, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/65.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 664885488 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 664885488 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (entropy_src_scoreboard.sv:2874) [scoreboard] Check failed prediction == csr_val (* [*] vs * [*]) Prediction for observe FIFO access failed. has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 75.entropy_src_rng_max_rate.9217415503019138352964592501150029701721440441455051662944678998686398329804
    Line 994, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/75.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 3499686454 ps: (entropy_src_scoreboard.sv:2874) [uvm_test_top.env.scoreboard] Check failed prediction == csr_val (0 [0x0] vs 1104963960 [0x41dc6978]) Prediction for observe FIFO access failed.
  UVM_INFO @ 3499686454 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (entropy_src_scoreboard.sv:2073) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.repcnt_hi_watermarks has 1 failures:
- Test entropy_src_rng has 1 failures.
  - 77.entropy_src_rng.16274628379812471070744986873074893434911519192691329352489085782480613437947
    Line 2056, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/77.entropy_src_rng/latest/run.log
```
  UVM_ERROR @ 14793364202 ps: (entropy_src_scoreboard.sv:2073) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (754974734 [0x2d00000e] vs 4294901774 [0xffff000e]) reg name: entropy_src_reg_block.repcnt_hi_watermarks
  UVM_INFO @ 14793364202 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 1 failures:
- Test entropy_src_functional_errors has 1 failures.
  - 166.entropy_src_functional_errors.113915131453753981997189856808281657369374307793891969695297686386991175103518
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/166.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10028237594 ps: (csr_utils_pkg.sv:587) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xb8d73ed8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10028237594 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (entropy_src_scoreboard.sv:2058) [scoreboard] Check failed fw_ov_wr_fifo_full_prediction == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.fw_ov_wr_fifo_full has 1 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 268.entropy_src_fw_ov.39938963146869362779972537289281926394166313547040593246483822571150600715594
    Line 1246, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/268.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 6340931787 ps: (entropy_src_scoreboard.sv:2058) [uvm_test_top.env.scoreboard] Check failed fw_ov_wr_fifo_full_prediction == item.d_data (1 [0x1] vs 0 [0x0]) reg name: entropy_src_reg_block.fw_ov_wr_fifo_full
  UVM_INFO @ 6340931787 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (entropy_src_scoreboard.sv:2073) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.recov_alert_sts has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 301.entropy_src_rng_max_rate.77069430336846044464864716973565935173672751468589463294030856246706436152656
    Line 1659, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/301.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 9440853795 ps: (entropy_src_scoreboard.sv:2073) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (4096 [0x1000] vs 0 [0x0]) reg name: entropy_src_reg_block.recov_alert_sts
  UVM_INFO @ 9440853795 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3390): Assertion PreconPostStartupDiffNonNegative_A has failed has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 362.entropy_src_rng_max_rate.4442744847154255813876963520088520878713832887446738573147421275322626671808
    Line 2071, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/362.entropy_src_rng_max_rate/latest/run.log
```
  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3390): (time 11110835207 PS) Assertion tb.dut.u_entropy_src_core.unmblk1.PreconPostStartupDiffNonNegative_A has failed
  UVM_ERROR @ 11110835207 ps: (entropy_src_core.sv:3390) [ASSERT FAILED] PreconPostStartupDiffNonNegative_A
  UVM_INFO @ 11110835207 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```