ENTROPY_SRC Simulation Results

Friday August 02 2024 23:02:48 UTC

GitHub Revision: `c8985d6745`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 75989420798843487383163268541581889763599806834398027919895759109584083292465

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	4.000s	49.808us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	4.000s	78.143us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	5.000s	31.953us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	15.000s	3.161ms	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	8.000s	300.559us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	9.000s	37.170us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	5.000s	31.953us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	300.559us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	4.000s	49.808us	50	50	100.00
		entropy_src_rng	10.633m	20.036ms	300	300	100.00
		entropy_src_fw_ov	10.500m	19.026ms	258	300	86.00
V2	firmware_mode	entropy_src_fw_ov	10.500m	19.026ms	258	300	86.00
V2	rng_mode	entropy_src_rng	10.633m	20.036ms	300	300	100.00
V2	rng_max_rate	entropy_src_rng_max_rate	18.700m	20.099ms	397	400	99.25
V2	health_checks	entropy_src_rng	10.633m	20.036ms	300	300	100.00
V2	conditioning	entropy_src_rng	10.633m	20.036ms	300	300	100.00
V2	interrupts	entropy_src_rng	10.633m	20.036ms	300	300	100.00
		entropy_src_intr	24.000s	3.899ms	50	50	100.00
V2	alerts	entropy_src_rng	10.633m	20.036ms	300	300	100.00
		entropy_src_functional_alerts	5.000s	250.795us	50	50	100.00
V2	stress_all	entropy_src_stress_all	11.067m	27.069ms	42	50	84.00
V2	functional_errors	entropy_src_functional_errors	10.667m	10.012ms	967	1000	96.70
V2	firmware_ov_read_contiguous_data	entropy_src_fw_ov_contiguous	26.000s	343.995us	50	50	100.00
V2	intr_test	entropy_src_intr_test	7.000s	17.033us	50	50	100.00
V2	alert_test	entropy_src_alert_test	3.000s	16.571us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	8.000s	328.492us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	8.000s	328.492us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	4.000s	78.143us	5	5	100.00
		entropy_src_csr_rw	5.000s	31.953us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	300.559us	5	5	100.00
		entropy_src_same_csr_outstanding	6.000s	33.049us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	4.000s	78.143us	5	5	100.00
		entropy_src_csr_rw	5.000s	31.953us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	300.559us	5	5	100.00
		entropy_src_same_csr_outstanding	6.000s	33.049us	20	20	100.00
V2		TOTAL			2254	2340	96.32
V2S	tl_intg_err	entropy_src_sec_cm	4.000s	90.990us	5	5	100.00
		entropy_src_tl_intg_err	8.000s	348.510us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	10.633m	20.036ms	300	300	100.00
		entropy_src_cfg_regwen	3.000s	82.786us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	10.633m	20.036ms	300	300	100.00
V2S	sec_cm_config_redun	entropy_src_rng	10.633m	20.036ms	300	300	100.00
V2S	sec_cm_intersig_mubi	entropy_src_rng	10.633m	20.036ms	300	300	100.00
		entropy_src_fw_ov	10.500m	19.026ms	258	300	86.00
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	10.667m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	4.000s	90.990us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	10.667m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	4.000s	90.990us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	10.633m	20.036ms	300	300	100.00
V2S	sec_cm_fifo_ctr_redun	entropy_src_functional_errors	10.667m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	4.000s	90.990us	5	5	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	10.667m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	4.000s	90.990us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	10.667m	10.012ms	967	1000	96.70
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	5.000s	250.795us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	8.000s	348.510us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	10.967m	20.060ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
		TOTAL			2484	2570	96.65

Testplan Progress

Items	Total	Written	Passing	Progress
V1	6	6	6	100.00
V2	12	12	8	66.67
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
97.15	98.19	95.43	98.36	95.79	96.68	96.88	90.48	95.85

Failure Buckets

UVM_ERROR (entropy_src_scoreboard.sv:2031) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.err_code has 23 failures:

Test entropy_src_fw_ov has 23 failures.

1.entropy_src_fw_ov.49871217899931263749488338377648874567437154690891286180623596019760810698680
Line 698, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/1.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 3630241161 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 3630241161 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

14.entropy_src_fw_ov.39645521591647062934304772581978993690812542298060804174663780415942088062206
Line 634, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/14.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 6114537544 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 6114537544 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 21 more failures.

UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 14 failures:
- Test entropy_src_fw_ov has 14 failures.
  - 6.entropy_src_fw_ov.91548998636575750339137860019116688757841526513642804574929707175474179558736
    Line 840, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/6.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 5709870352 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 5709870352 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 13.entropy_src_fw_ov.6421448113108311410109949067547920624920503008889928110522339676089662712279
    Line 1207, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/13.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 6466304970 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 6466304970 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 12 more failures.
UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 11 failures:
- Test entropy_src_functional_errors has 11 failures.
  - 87.entropy_src_functional_errors.72132899085863682332778187433249833265145818760311503665971560070724031688896
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/87.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10100581036 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x92cfcad8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10100581036 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 98.entropy_src_functional_errors.53325334423833601736322021392856279916301289932726665365030025419865433175970
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/98.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10047051745 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x55eded8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10047051745 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 9 more failures.
UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 10 failures:
- Test entropy_src_functional_errors has 10 failures.
  - 55.entropy_src_functional_errors.57683230354159743309674408946775729758230349502621522063482941793618356190289
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/55.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10056040205 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xad058ed8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10056040205 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 323.entropy_src_functional_errors.103139005605459219798126590519060028629034591285439178461174126664328283569018
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/323.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10056845746 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xd68f26d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10056845746 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 8 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 7 failures:
- Test entropy_src_functional_errors has 7 failures.
  - 68.entropy_src_functional_errors.10740661744043785404394896022313611999502236438750633649172243681049696985058
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/68.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10074181277 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x822662d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10074181277 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 164.entropy_src_functional_errors.81727987274116889830685925023549783216266382673506422664855378841581394571300
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/164.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10059961673 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x9baa24d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10059961673 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 5 more failures.
Exit reason: Error: User command failed UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 3 failures:
- Test entropy_src_fw_ov has 3 failures.
  - 117.entropy_src_fw_ov.22949052376184481981544026563163394618774440516397792002289904400348513357630
    Line 693, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/117.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 3212973738 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 3212973738 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 158.entropy_src_fw_ov.52284730893145782159873760496986075964399475243626095256364383156982424974385
    Line 2019, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/158.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 16622027784 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 16622027784 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 1 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 3 failures:
- Test entropy_src_functional_errors has 3 failures.
  - 160.entropy_src_functional_errors.63617950652818704077846738816868910651222204675908740787133609208350904599622
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/160.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10062024760 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x9d2d16d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10062024760 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 470.entropy_src_functional_errors.35957254064115701294157748772993339386120525189735411338956455352992710398367
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/470.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10020242115 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x2120a7d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10020242115 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 1 more failures.
Exit reason: Error: User command failed UVM_FATAL (entropy_src_scoreboard.sv:2649) [scoreboard] Check failed match_found == * (* [*] vs * [*]) All candidate csrng seeds have been checked, with no match has 2 failures:
- Test entropy_src_fw_ov has 2 failures.
  - 17.entropy_src_fw_ov.1774326585257744526637711205490682170100480794116025775945633788144360662595
    Line 1178, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/17.entropy_src_fw_ov/latest/run.log
```
  UVM_FATAL @ 2518982877 ps: (entropy_src_scoreboard.sv:2649) [uvm_test_top.env.scoreboard] Check failed match_found == 1 (0 [0x0] vs 1 [0x1]) All candidate csrng seeds have been checked, with no match
  UVM_INFO @ 2518982877 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 74.entropy_src_fw_ov.73532968536816312849555007800156343080393395904885457174387434710379446659694
    Line 1549, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/74.entropy_src_fw_ov/latest/run.log
```
  UVM_FATAL @ 11696802091 ps: (entropy_src_scoreboard.sv:2649) [uvm_test_top.env.scoreboard] Check failed match_found == 1 (0 [0x0] vs 1 [0x1]) All candidate csrng seeds have been checked, with no match
  UVM_INFO @ 11696802091 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=11) has 2 failures:
- Test entropy_src_stress_all has 2 failures.
  - 22.entropy_src_stress_all.39663780035689461293857276323743869270012000981033641385183408325373156671499
    Line 543, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/22.entropy_src_stress_all/latest/run.log
```
  UVM_FATAL @ 22303427416 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=0x7e911a00, Comparison=CompareOpEq, exp_data=0x1, call_count=11)
  UVM_INFO @ 22303427416 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 24.entropy_src_stress_all.12261338050558113575350861640158414970821081572684736258175008057185288491606
    Line 535, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/24.entropy_src_stress_all/latest/run.log
```
  UVM_FATAL @ 18301902001 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=0xbe58c400, Comparison=CompareOpEq, exp_data=0x1, call_count=11)
  UVM_INFO @ 18301902001 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=2) has 2 failures:
- Test entropy_src_functional_errors has 2 failures.
  - 229.entropy_src_functional_errors.99130069776917257159289076687736995697150343601248964302115418170596284382530
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/229.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10023178753 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xa17e57d8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10023178753 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 444.entropy_src_functional_errors.29830885049715302109794548856054864824903113184660656130934594837235800845436
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/444.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10147233849 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x5788cfd8, Comparison=CompareOpEq, exp_data=0x1, call_count=2)
  UVM_INFO @ 10147233849 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 2 failures:
- Test entropy_src_rng_max_rate has 2 failures.
  - 246.entropy_src_rng_max_rate.51494209529985525658256274140341079557137892893610479212172828567533927082603
    Line 431, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/246.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 344006106 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 344006106 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 287.entropy_src_rng_max_rate.112400359088742633683549335559053934879124866875800579938390362586320102622960
    Line 1400, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/287.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 4811464928 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 4811464928 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=25) has 1 failures:
- Test entropy_src_stress_all has 1 failures.
  - 9.entropy_src_stress_all.92839478920517460473746198377386301285319097240237852570413729708193976882696
    Line 830, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/9.entropy_src_stress_all/latest/run.log
```
  UVM_FATAL @ 20455433726 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=0x1c378a00, Comparison=CompareOpEq, exp_data=0x1, call_count=25)
  UVM_INFO @ 20455433726 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=43) has 1 failures:
- Test entropy_src_stress_all has 1 failures.
  - 10.entropy_src_stress_all.26813306765939922673676291279438643677787228179506277468071219827733539807571
    Line 1231, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/10.entropy_src_stress_all/latest/run.log
```
  UVM_FATAL @ 19032856859 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=0x7ade1600, Comparison=CompareOpEq, exp_data=0x1, call_count=43)
  UVM_INFO @ 19032856859 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=23) has 1 failures:
- Test entropy_src_stress_all has 1 failures.
  - 32.entropy_src_stress_all.47476123734904246849915705280453711077280021003961916677163317949658947522501
    Line 693, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/32.entropy_src_stress_all/latest/run.log
```
  UVM_FATAL @ 18144571670 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=0x24d6b800, Comparison=CompareOpEq, exp_data=0x1, call_count=23)
  UVM_INFO @ 18144571670 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=5) has 1 failures:
- Test entropy_src_stress_all has 1 failures.
  - 37.entropy_src_stress_all.59317754888817156476147361863856849595459671143065793287727868033105279067426
    Line 388, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/37.entropy_src_stress_all/latest/run.log
```
  UVM_FATAL @ 18238934287 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=0xec5c4700, Comparison=CompareOpEq, exp_data=0x1, call_count=5)
  UVM_INFO @ 18238934287 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=51) has 1 failures:
- Test entropy_src_stress_all has 1 failures.
  - 45.entropy_src_stress_all.55467715459219015285917442118083434705175636992795582618051331445695811553640
    Line 1524, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/45.entropy_src_stress_all/latest/run.log
```
  UVM_FATAL @ 30134754751 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=0x7cf5100, Comparison=CompareOpEq, exp_data=0x1, call_count=51)
  UVM_INFO @ 30134754751 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=*, Comparison=CompareOpEq, exp_data=*, call_count=5) has 1 failures:
- Test entropy_src_stress_all has 1 failures.
  - 46.entropy_src_stress_all.32441026050778104098223489764060789386037123758531481343124606940307257850817
    Line 388, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/46.entropy_src_stress_all/latest/run.log
```
  UVM_FATAL @ 27069287998 ps: (csr_utils_pkg.sv:597) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.intr_state.es_entropy_valid (addr=0x85a63e00, Comparison=CompareOpEq, exp_data=0x1, call_count=5)
  UVM_INFO @ 27069287998 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (entropy_src_scoreboard.sv:2031) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.alert_summary_fail_counts has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 295.entropy_src_rng_max_rate.93341288924969215712264255189717874249155518731459177566121031276507450359932
    Line 846, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/295.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 679924328 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (2 [0x2] vs 1 [0x1]) reg name: entropy_src_reg_block.alert_summary_fail_counts
  UVM_INFO @ 679924328 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```