ENTROPY_SRC Simulation Results

Sunday March 03 2024 20:02:47 UTC

GitHub Revision: `0cdf265eaa`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 82530437672810453765703374940713112405319051694331588453064008042331386550559

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	4.000s	93.487us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	4.000s	213.767us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	3.000s	51.526us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	11.000s	307.266us	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	6.000s	205.262us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	4.000s	572.299us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	3.000s	51.526us	20	20	100.00
		entropy_src_csr_aliasing	6.000s	205.262us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	4.000s	93.487us	50	50	100.00
		entropy_src_rng	4.800m	10.016ms	300	300	100.00
		entropy_src_fw_ov	2.317m	5.071ms	299	300	99.67
V2	firmware_mode	entropy_src_fw_ov	2.317m	5.071ms	299	300	99.67
V2	rng_mode	entropy_src_rng	4.800m	10.016ms	300	300	100.00
V2	rng_max_rate	entropy_src_rng_max_rate	4.917m	8.574ms	25	400	6.25
V2	health_checks	entropy_src_rng	4.800m	10.016ms	300	300	100.00
V2	conditioning	entropy_src_rng	4.800m	10.016ms	300	300	100.00
V2	interrupts	entropy_src_rng	4.800m	10.016ms	300	300	100.00
V2	alerts	entropy_src_rng	4.800m	10.016ms	300	300	100.00
		entropy_src_functional_alerts	5.000s	873.412us	50	50	100.00
V2	stress_all	entropy_src_stress_all	10.000s	873.957us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	13.000s	283.402us	1000	1000	100.00
V2	intr_test	entropy_src_intr_test	3.000s	21.175us	50	50	100.00
V2	alert_test	entropy_src_alert_test	3.000s	20.873us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	7.000s	128.410us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	7.000s	128.410us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	4.000s	213.767us	5	5	100.00
		entropy_src_csr_rw	3.000s	51.526us	20	20	100.00
		entropy_src_csr_aliasing	6.000s	205.262us	5	5	100.00
		entropy_src_same_csr_outstanding	4.000s	148.186us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	4.000s	213.767us	5	5	100.00
		entropy_src_csr_rw	3.000s	51.526us	20	20	100.00
		entropy_src_csr_aliasing	6.000s	205.262us	5	5	100.00
		entropy_src_same_csr_outstanding	4.000s	148.186us	20	20	100.00
V2		TOTAL			1864	2240	83.21
V2S	tl_intg_err	entropy_src_sec_cm	4.000s	262.722us	5	5	100.00
		entropy_src_tl_intg_err	6.000s	149.084us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	4.800m	10.016ms	300	300	100.00
		entropy_src_cfg_regwen	4.000s	22.761us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	4.800m	10.016ms	300	300	100.00
V2S	sec_cm_config_redun	entropy_src_rng	4.800m	10.016ms	300	300	100.00
V2S	sec_cm_intersig_mubi	entropy_src_rng	4.800m	10.016ms	300	300	100.00
		entropy_src_fw_ov	2.317m	5.071ms	299	300	99.67
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	13.000s	283.402us	1000	1000	100.00
		entropy_src_sec_cm	4.000s	262.722us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	13.000s	283.402us	1000	1000	100.00
		entropy_src_sec_cm	4.000s	262.722us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	4.800m	10.016ms	300	300	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	13.000s	283.402us	1000	1000	100.00
		entropy_src_sec_cm	4.000s	262.722us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	13.000s	283.402us	1000	1000	100.00
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	5.000s	873.412us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	6.000s	149.084us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	4.633m	10.024ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
	Unmapped tests	entropy_src_intr	17.000s	1.106ms	46	50	92.00
		TOTAL			2140	2520	84.92

Testplan Progress

Items	Total	Written	Passing	Progress
N.A.	1	1	0	0.00
V1	6	6	6	100.00
V2	10	10	8	80.00
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
83.70	98.35	95.88	98.33	95.79	89.36	96.94	91.62	45.88

Failure Buckets

Exit reason: Error: User command failed UVM_ERROR (entropy_src_scoreboard.sv:2339) [scoreboard] Check failed (health_test_data_q.size() > *) has 275 failures:
- Test entropy_src_rng_max_rate has 275 failures.
  - 0.entropy_src_rng_max_rate.94513459136396576681042353922692350254627350187944295563867200560063019833682
    Line 535, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/0.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 132197840 ps: (entropy_src_scoreboard.sv:2339) [uvm_test_top.env.scoreboard] Check failed (health_test_data_q.size() > 0)
  UVM_INFO @ 132197840 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 1.entropy_src_rng_max_rate.66183864690774424516593046444923427094493757117524026667958611893770657517323
    Line 738, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/1.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 974855712 ps: (entropy_src_scoreboard.sv:2339) [uvm_test_top.env.scoreboard] Check failed (health_test_data_q.size() > 0)
  UVM_INFO @ 974855712 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 273 more failures.
UVM_ERROR (entropy_src_scoreboard.sv:2339) [scoreboard] Check failed (health_test_data_q.size() > *) has 99 failures:
- Test entropy_src_rng_max_rate has 99 failures.
  - 2.entropy_src_rng_max_rate.40612154509250192743685641589143968193109589654253779703467808608303029519704
    Line 936, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/2.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 1046054288 ps: (entropy_src_scoreboard.sv:2339) [uvm_test_top.env.scoreboard] Check failed (health_test_data_q.size() > 0)
  UVM_INFO @ 1046054288 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 6.entropy_src_rng_max_rate.12832851714790947952148828473438043490224059608024905325761229574347779796188
    Line 1553, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/6.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 2012009527 ps: (entropy_src_scoreboard.sv:2339) [uvm_test_top.env.scoreboard] Check failed (health_test_data_q.size() > 0)
  UVM_INFO @ 2012009527 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 97 more failures.

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3213): Assertion Final_PreconFifoPushedPostStartup_A has failed has 4 failures:

Test entropy_src_intr has 4 failures.

6.entropy_src_intr.66705634414145499346853079509827261749506160876357361179653970401719648561300
Line 375, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/6.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3213): (time 170622643 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

9.entropy_src_intr.14709958041866097090947173290531161175817907083669185967982692092856905686914
Line 375, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/9.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3213): (time 1212168510 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

... and 2 more failures.

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3009): Assertion AtReset_EsbitFifoPushedIntoPosthtFifo_A has failed has 1 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 62.entropy_src_fw_ov.12783460937170711030656371361553854525128551265634319673575664327527893694101
    Line 945, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/62.entropy_src_fw_ov/latest/run.log
```
  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3009): (time 1504079183 PS) Assertion tb.dut.u_entropy_src_core.AtReset_EsbitFifoPushedIntoPosthtFifo_A has failed
  UVM_ERROR @ 1504079183 ps: (entropy_src_core.sv:3009) [ASSERT FAILED] AtReset_EsbitFifoPushedIntoPosthtFifo_A
  UVM_INFO @ 1504079183 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (entropy_src_base_vseq.sv:430) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 230.entropy_src_rng_max_rate.60938699207367968423104430717788887626654018495716535885394695130502684480862
    Line 535, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/230.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 801355021 ps: (entropy_src_base_vseq.sv:430) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 801355021 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```