ENTROPY_SRC Simulation Results

Sunday July 07 2024 23:02:38 UTC

GitHub Revision: `2e5d86c9b5`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 75221189197949424635294305394615322888112457483844341597147780944629972574676

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	18.000s	30.613us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	3.000s	115.327us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	8.000s	16.442us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	13.000s	2.142ms	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	8.000s	915.195us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	5.000s	164.056us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	8.000s	16.442us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	915.195us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	18.000s	30.613us	50	50	100.00
		entropy_src_rng	4.633m	10.016ms	300	300	100.00
		entropy_src_fw_ov	2.383m	5.036ms	289	300	96.33
V2	firmware_mode	entropy_src_fw_ov	2.383m	5.036ms	289	300	96.33
V2	rng_mode	entropy_src_rng	4.633m	10.016ms	300	300	100.00
V2	rng_max_rate	entropy_src_rng_max_rate	8.617m	10.060ms	397	400	99.25
V2	health_checks	entropy_src_rng	4.633m	10.016ms	300	300	100.00
V2	conditioning	entropy_src_rng	4.633m	10.016ms	300	300	100.00
V2	interrupts	entropy_src_rng	4.633m	10.016ms	300	300	100.00
		entropy_src_intr	22.000s	2.330ms	50	50	100.00
V2	alerts	entropy_src_rng	4.633m	10.016ms	300	300	100.00
		entropy_src_functional_alerts	19.000s	257.366us	50	50	100.00
V2	stress_all	entropy_src_stress_all	16.000s	144.226us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	9.767m	10.012ms	960	1000	96.00
V2	firmware_ov_read_contiguous_data	entropy_src_fw_ov_contiguous	25.000s	643.041us	50	50	100.00
V2	intr_test	entropy_src_intr_test	12.000s	18.597us	50	50	100.00
V2	alert_test	entropy_src_alert_test	18.000s	25.662us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	7.000s	138.759us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	7.000s	138.759us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	3.000s	115.327us	5	5	100.00
		entropy_src_csr_rw	8.000s	16.442us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	915.195us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	112.332us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	3.000s	115.327us	5	5	100.00
		entropy_src_csr_rw	8.000s	16.442us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	915.195us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	112.332us	20	20	100.00
V2		TOTAL			2286	2340	97.69
V2S	tl_intg_err	entropy_src_sec_cm	5.000s	120.183us	5	5	100.00
		entropy_src_tl_intg_err	7.000s	179.986us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	4.633m	10.016ms	300	300	100.00
		entropy_src_cfg_regwen	18.000s	17.485us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	4.633m	10.016ms	300	300	100.00
V2S	sec_cm_config_redun	entropy_src_rng	4.633m	10.016ms	300	300	100.00
V2S	sec_cm_intersig_mubi	entropy_src_rng	4.633m	10.016ms	300	300	100.00
		entropy_src_fw_ov	2.383m	5.036ms	289	300	96.33
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	9.767m	10.012ms	960	1000	96.00
		entropy_src_sec_cm	5.000s	120.183us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	9.767m	10.012ms	960	1000	96.00
		entropy_src_sec_cm	5.000s	120.183us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	4.633m	10.016ms	300	300	100.00
V2S	sec_cm_fifo_ctr_redun	entropy_src_functional_errors	9.767m	10.012ms	960	1000	96.00
		entropy_src_sec_cm	5.000s	120.183us	5	5	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	9.767m	10.012ms	960	1000	96.00
		entropy_src_sec_cm	5.000s	120.183us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	9.767m	10.012ms	960	1000	96.00
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	19.000s	257.366us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	7.000s	179.986us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	4.433m	10.074ms	49	50	98.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			49	50	98.00
		TOTAL			2515	2570	97.86

Testplan Progress

Items	Total	Written	Passing	Progress
V1	6	6	6	100.00
V2	12	12	9	75.00
V2S	3	3	3	100.00
V3	2	1	0	0.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
97.13	98.15	95.32	98.36	95.79	96.68	96.88	90.48	95.73

Failure Buckets

UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 13 failures:
- Test entropy_src_functional_errors has 13 failures.
  - 51.entropy_src_functional_errors.6222934711675740927138753099987214599156309376155411055064589964161072458456
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/51.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10018923074 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xad2ffd8) == 0x1
  UVM_INFO @ 10018923074 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 99.entropy_src_functional_errors.73411466394938531334641200998494058000717884654203754485943046082099384456291
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/99.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10032839909 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x1e19a1d8) == 0x1
  UVM_INFO @ 10032839909 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 11 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 11 failures:
- Test entropy_src_functional_errors has 11 failures.
  - 59.entropy_src_functional_errors.29749901774027236865405003766885837431942808544194454479573324858829990526048
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/59.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10034457438 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x3d818fd8) == 0x1
  UVM_INFO @ 10034457438 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 110.entropy_src_functional_errors.29571675243142661989702497211165633821209935033162478745210662065880430691390
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/110.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10029672092 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x16cbf9d8) == 0x1
  UVM_INFO @ 10029672092 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 9 more failures.
UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 8 failures:
- Test entropy_src_fw_ov has 8 failures.
  - 14.entropy_src_fw_ov.115567796982650017753449594005909512107482961053294414021404442976186792414593
    Line 483, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/14.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 2992657982 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 2992657982 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 63.entropy_src_fw_ov.57238773236779592016544421223410291604882990622948670430113525395433703984050
    Line 481, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/63.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 1619315310 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 1619315310 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 6 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 7 failures:
- Test entropy_src_functional_errors has 7 failures.
  - 58.entropy_src_functional_errors.91147816790998947019336915270125028401325770939987354864264880079734215313688
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/58.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10012247319 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xd14a3dd8) == 0x1
  UVM_INFO @ 10012247319 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 73.entropy_src_functional_errors.67923909655084758286915770419211564782235677560879027004948030476776453896045
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/73.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10154495851 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xe37c3d8) == 0x1
  UVM_INFO @ 10154495851 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 5 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 7 failures:
- Test entropy_src_functional_errors has 7 failures.
  - 217.entropy_src_functional_errors.7330789241458555673341341740283340083117338557548857940085768625101561176626
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/217.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10024526101 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xe7ba04d8) == 0x1
  UVM_INFO @ 10024526101 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 245.entropy_src_functional_errors.114783789665153048874822872189929316749719233206280453895417085419705545992390
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/245.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10017289712 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x1ba996d8) == 0x1
  UVM_INFO @ 10017289712 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 5 more failures.

UVM_ERROR (entropy_src_scoreboard.sv:1905) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.err_code has 2 failures:

Test entropy_src_fw_ov has 2 failures.

80.entropy_src_fw_ov.54275945736726506494306807527459849063550747114648839802757225777276353058415
Line 584, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/80.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 3261503021 ps: (entropy_src_scoreboard.sv:1905) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 3261503021 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

226.entropy_src_fw_ov.82874448571094387657777141396848003602604964871020619821026291942579573137387
Line 786, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/226.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 3832128299 ps: (entropy_src_scoreboard.sv:1905) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 3832128299 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 2 failures:
- Test entropy_src_functional_errors has 2 failures.
  - 116.entropy_src_functional_errors.96164153333529275679553759759706842931952185015225504537760898202717438929278
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/116.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10018152102 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x28443dd8) == 0x1
  UVM_INFO @ 10018152102 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 828.entropy_src_functional_errors.32417058417416201751194450021036739588691894128888799671547341559880159407305
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/828.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10018508609 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x595b67d8) == 0x1
  UVM_INFO @ 10018508609 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (entropy_src_scoreboard.sv:1905) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.alert_summary_fail_counts has 1 failures:
- Test entropy_src_rng_with_xht_rsps has 1 failures.
  - 12.entropy_src_rng_with_xht_rsps.40963542854912823907751957169869695390816031070920652648417692851653839657273
    Line 485, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/12.entropy_src_rng_with_xht_rsps/latest/run.log
```
  UVM_ERROR @ 263306980 ps: (entropy_src_scoreboard.sv:1905) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (0 [0x0] vs 1 [0x1]) reg name: entropy_src_reg_block.alert_summary_fail_counts
  UVM_INFO @ 263306980 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 22.entropy_src_rng_max_rate.94003013283746183615992047607045040889981318599723303930029008225627587844447
    Line 1701, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/22.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 7982726939 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 7982726939 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (cip_base_scoreboard.sv:302) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 126.entropy_src_rng_max_rate.72136798574016711730061330352459232444949676334531576177482649796378055077190
    Line 1459, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/126.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 9454585823 ps: (cip_base_scoreboard.sv:302) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 9454585823 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 1 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 264.entropy_src_fw_ov.50183084037619146603779481599534212818296305215686901142918495700913424045088
    Line 379, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/264.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 1648115257 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 1648115257 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3400): Assertion AtReset_EsfinalFifoPushedPostStartup_A has failed has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 383.entropy_src_rng_max_rate.39333619860744583795335596878154326554768697158762835129684275210838636514189
    Line 1658, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/383.entropy_src_rng_max_rate/latest/run.log
```
  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3400): (time 5065238711 PS) Assertion tb.dut.u_entropy_src_core.AtReset_EsfinalFifoPushedPostStartup_A has failed
  UVM_ERROR @ 5065238711 ps: (entropy_src_core.sv:3400) [ASSERT FAILED] AtReset_EsfinalFifoPushedPostStartup_A
  UVM_INFO @ 5065238711 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```