ENTROPY_SRC Simulation Results

Wednesday January 17 2024 20:02:30 UTC

GitHub Revision: `4d88b9516c`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 3635458896929517279689574864899235923834879224879080668186365324190153451241

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	4.000s	52.242us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	3.000s	82.565us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	3.000s	77.231us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	16.000s	156.810us	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	10.000s	118.489us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	4.000s	36.016us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	3.000s	77.231us	20	20	100.00
		entropy_src_csr_aliasing	10.000s	118.489us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	4.000s	52.242us	50	50	100.00
		entropy_src_rng	11.267m	10.014ms	299	300	99.67
		entropy_src_fw_ov	2.083m	5.032ms	298	300	99.33
V2	firmware_mode	entropy_src_fw_ov	2.083m	5.032ms	298	300	99.33
V2	rng_mode	entropy_src_rng	11.267m	10.014ms	299	300	99.67
V2	rng_max_rate	entropy_src_rng_max_rate	11.250m	10.014ms	399	400	99.75
V2	health_checks	entropy_src_rng	11.267m	10.014ms	299	300	99.67
V2	conditioning	entropy_src_rng	11.267m	10.014ms	299	300	99.67
V2	interrupts	entropy_src_rng	11.267m	10.014ms	299	300	99.67
V2	alerts	entropy_src_rng	11.267m	10.014ms	299	300	99.67
		entropy_src_functional_alerts	5.000s	60.620us	50	50	100.00
V2	stress_all	entropy_src_stress_all	10.000s	247.810us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	5.000s	53.778us	1000	1000	100.00
V2	intr_test	entropy_src_intr_test	8.000s	15.350us	50	50	100.00
V2	alert_test	entropy_src_alert_test	4.000s	66.478us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	10.000s	65.683us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	10.000s	65.683us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	3.000s	82.565us	5	5	100.00
		entropy_src_csr_rw	3.000s	77.231us	20	20	100.00
		entropy_src_csr_aliasing	10.000s	118.489us	5	5	100.00
		entropy_src_same_csr_outstanding	9.000s	50.889us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	3.000s	82.565us	5	5	100.00
		entropy_src_csr_rw	3.000s	77.231us	20	20	100.00
		entropy_src_csr_aliasing	10.000s	118.489us	5	5	100.00
		entropy_src_same_csr_outstanding	9.000s	50.889us	20	20	100.00
V2		TOTAL			2236	2240	99.82
V2S	tl_intg_err	entropy_src_sec_cm	4.000s	350.833us	5	5	100.00
		entropy_src_tl_intg_err	6.000s	193.632us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	11.267m	10.014ms	299	300	99.67
		entropy_src_cfg_regwen	4.000s	37.115us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	11.267m	10.014ms	299	300	99.67
V2S	sec_cm_config_redun	entropy_src_rng	11.267m	10.014ms	299	300	99.67
V2S	sec_cm_intersig_mubi	entropy_src_rng	11.267m	10.014ms	299	300	99.67
		entropy_src_fw_ov	2.083m	5.032ms	298	300	99.33
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	5.000s	53.778us	1000	1000	100.00
		entropy_src_sec_cm	4.000s	350.833us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	5.000s	53.778us	1000	1000	100.00
		entropy_src_sec_cm	4.000s	350.833us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	11.267m	10.014ms	299	300	99.67
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	5.000s	53.778us	1000	1000	100.00
		entropy_src_sec_cm	4.000s	350.833us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	5.000s	53.778us	1000	1000	100.00
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	5.000s	60.620us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	6.000s	193.632us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	8.833m	10.016ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
	Unmapped tests	entropy_src_intr	19.000s	529.939us	40	50	80.00
		TOTAL			2506	2520	99.44

Testplan Progress

Items	Total	Written	Passing	Progress
N.A.	1	1	0	0.00
V1	6	6	6	100.00
V2	10	10	7	70.00
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
98.26	98.88	97.22	99.70	96.27	99.40	97.00	91.61	95.99

Failure Buckets

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3194): Assertion Final_PreconFifoPushedPostStartup_A has failed has 10 failures:

Test entropy_src_intr has 10 failures.

1.entropy_src_intr.102660123468593292416248299275399828979737827354445378248832368673687254714436
Line 369, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/1.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3194): (time 84332259 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

11.entropy_src_intr.44779766265858773555540761864214372903664886715678879622087547462919590322425
Line 369, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/11.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3194): (time 148326683 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

... and 8 more failures.

UVM_ERROR (cip_base_scoreboard.sv:288) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 3 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 94.entropy_src_rng_max_rate.83860141628600281305004862912206039065461902433996774331024709299814285115170
    Line 771, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/94.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 3710816516 ps: (cip_base_scoreboard.sv:288) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 3710816516 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
- Test entropy_src_rng has 1 failures.
  - 95.entropy_src_rng.105480853813530108766470721152254348722262378422374962635859153382944337862999
    Line 926, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/95.entropy_src_rng/latest/run.log
```
  UVM_ERROR @ 7960129605 ps: (cip_base_scoreboard.sv:288) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 7960129605 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
- Test entropy_src_fw_ov has 1 failures.
  - 172.entropy_src_fw_ov.10072101972946198407202412291064695092306459948993644458485828934405623035615
    Line 468, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/172.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 2466728883 ps: (cip_base_scoreboard.sv:288) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 2466728883 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,2990): Assertion AtReset_EsbitFifoPushedIntoPosthtFifo_A has failed has 1 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 210.entropy_src_fw_ov.2495120884277155720898497073292451512736026879924705544978290474115822096704
    Line 573, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/210.entropy_src_fw_ov/latest/run.log
```
  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,2990): (time 1748690752 PS) Assertion tb.dut.u_entropy_src_core.AtReset_EsbitFifoPushedIntoPosthtFifo_A has failed
  UVM_ERROR @ 1748690752 ps: (entropy_src_core.sv:2990) [ASSERT FAILED] AtReset_EsbitFifoPushedIntoPosthtFifo_A
  UVM_INFO @ 1748690752 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```