ENTROPY_SRC Simulation Results

Tuesday March 05 2024 20:02:48 UTC

GitHub Revision: `c30684b3ca`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 61875946985821051720030118255902427822651914203242934898647746371735217685454

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	16.000s	26.049us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	4.000s	160.024us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	8.000s	89.195us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	17.000s	15.395ms	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	8.000s	239.235us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	4.000s	55.652us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	8.000s	89.195us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	239.235us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	16.000s	26.049us	50	50	100.00
		entropy_src_rng	4.817m	10.023ms	299	300	99.67
		entropy_src_fw_ov	2.283m	5.097ms	298	300	99.33
V2	firmware_mode	entropy_src_fw_ov	2.283m	5.097ms	298	300	99.33
V2	rng_mode	entropy_src_rng	4.817m	10.023ms	299	300	99.67
V2	rng_max_rate	entropy_src_rng_max_rate	6.333m	8.719ms	31	400	7.75
V2	health_checks	entropy_src_rng	4.817m	10.023ms	299	300	99.67
V2	conditioning	entropy_src_rng	4.817m	10.023ms	299	300	99.67
V2	interrupts	entropy_src_rng	4.817m	10.023ms	299	300	99.67
V2	alerts	entropy_src_rng	4.817m	10.023ms	299	300	99.67
		entropy_src_functional_alerts	14.000s	75.293us	50	50	100.00
V2	stress_all	entropy_src_stress_all	22.000s	250.177us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	21.000s	71.317us	1000	1000	100.00
V2	intr_test	entropy_src_intr_test	8.000s	18.569us	50	50	100.00
V2	alert_test	entropy_src_alert_test	15.000s	25.996us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	7.000s	256.965us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	7.000s	256.965us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	4.000s	160.024us	5	5	100.00
		entropy_src_csr_rw	8.000s	89.195us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	239.235us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	80.671us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	4.000s	160.024us	5	5	100.00
		entropy_src_csr_rw	8.000s	89.195us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	239.235us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	80.671us	20	20	100.00
V2		TOTAL			1868	2240	83.39
V2S	tl_intg_err	entropy_src_sec_cm	9.000s	163.821us	5	5	100.00
		entropy_src_tl_intg_err	7.000s	177.478us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	4.817m	10.023ms	299	300	99.67
		entropy_src_cfg_regwen	11.000s	270.883us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	4.817m	10.023ms	299	300	99.67
V2S	sec_cm_config_redun	entropy_src_rng	4.817m	10.023ms	299	300	99.67
V2S	sec_cm_intersig_mubi	entropy_src_rng	4.817m	10.023ms	299	300	99.67
		entropy_src_fw_ov	2.283m	5.097ms	298	300	99.33
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	21.000s	71.317us	1000	1000	100.00
		entropy_src_sec_cm	9.000s	163.821us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	21.000s	71.317us	1000	1000	100.00
		entropy_src_sec_cm	9.000s	163.821us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	4.817m	10.023ms	299	300	99.67
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	21.000s	71.317us	1000	1000	100.00
		entropy_src_sec_cm	9.000s	163.821us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	21.000s	71.317us	1000	1000	100.00
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	14.000s	75.293us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	7.000s	177.478us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	4.583m	10.061ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
	Unmapped tests	entropy_src_intr	27.000s	4.039ms	47	50	94.00
		TOTAL			2145	2520	85.12

Testplan Progress

Items	Total	Written	Passing	Progress
N.A.	1	1	0	0.00
V1	6	6	6	100.00
V2	10	10	7	70.00
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
83.89	98.35	95.88	98.33	95.79	89.39	96.94	91.62	46.65

Failure Buckets

Exit reason: Error: User command failed UVM_ERROR (entropy_src_scoreboard.sv:2339) [scoreboard] Check failed (health_test_data_q.size() > *) has 272 failures:
- Test entropy_src_rng_max_rate has 272 failures.
  - 0.entropy_src_rng_max_rate.65489109588173466077531408804937500466481239320884924841685169850629422164473
    Line 1507, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/0.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 3092891937 ps: (entropy_src_scoreboard.sv:2339) [uvm_test_top.env.scoreboard] Check failed (health_test_data_q.size() > 0)
  UVM_INFO @ 3092891937 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 2.entropy_src_rng_max_rate.86456228393673140946086247475623831539257001696442695316465433611909260823979
    Line 1039, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/2.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 3692768069 ps: (entropy_src_scoreboard.sv:2339) [uvm_test_top.env.scoreboard] Check failed (health_test_data_q.size() > 0)
  UVM_INFO @ 3692768069 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 270 more failures.
UVM_ERROR (entropy_src_scoreboard.sv:2339) [scoreboard] Check failed (health_test_data_q.size() > *) has 96 failures:
- Test entropy_src_rng_max_rate has 96 failures.
  - 1.entropy_src_rng_max_rate.40474336706058072564786328881129175175129149450259980419282417781867722224447
    Line 742, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/1.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 674971703 ps: (entropy_src_scoreboard.sv:2339) [uvm_test_top.env.scoreboard] Check failed (health_test_data_q.size() > 0)
  UVM_INFO @ 674971703 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 3.entropy_src_rng_max_rate.94495084756574755738877410712972695723620123984586371577321837802710448706880
    Line 937, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/3.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 1568262809 ps: (entropy_src_scoreboard.sv:2339) [uvm_test_top.env.scoreboard] Check failed (health_test_data_q.size() > 0)
  UVM_INFO @ 1568262809 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 94 more failures.

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3213): Assertion Final_PreconFifoPushedPostStartup_A has failed has 3 failures:

Test entropy_src_intr has 3 failures.

20.entropy_src_intr.37406330976008720424100671267830727435107088085911303353239538143173568083973
Line 375, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/20.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3213): (time 524607184 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

21.entropy_src_intr.7377954880072288719856948410331433185402853281082891820226794026868066144752
Line 375, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/21.entropy_src_intr/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3213): (time 2093413629 PS) Assertion tb.dut.u_entropy_src_core.Final_PreconFifoPushedPostStartup_A has failed
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.
  xmsim: *W,SLFINV: Call to process::self() from invalid process; returning null.

... and 1 more failures.

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3009): Assertion AtReset_EsbitFifoPushedIntoPosthtFifo_A has failed has 1 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 51.entropy_src_fw_ov.31112660189730717132211275356869441374052741832540727700183468441514215005257
    Line 384, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/51.entropy_src_fw_ov/latest/run.log
```
  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3009): (time 2797832566 PS) Assertion tb.dut.u_entropy_src_core.AtReset_EsbitFifoPushedIntoPosthtFifo_A has failed
  UVM_ERROR @ 2797832566 ps: (entropy_src_core.sv:3009) [ASSERT FAILED] AtReset_EsbitFifoPushedIntoPosthtFifo_A
  UVM_INFO @ 2797832566 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_*/rtl/sha*.sv,505): Assertion KeccakIdleWhenNoRunHs_A has failed has 1 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 192.entropy_src_fw_ov.92495101503563164614625999125905251547572038633089752359383965930363249954057
    Line 1266, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/192.entropy_src_fw_ov/latest/run.log
```
  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_sha3_0.1/rtl/sha3.sv,505): (time 5001508722 PS) Assertion tb.dut.u_entropy_src_core.u_sha3.KeccakIdleWhenNoRunHs_A has failed
  UVM_ERROR @ 5001508722 ps: (sha3.sv:505) [ASSERT FAILED] KeccakIdleWhenNoRunHs_A
  UVM_INFO @ 5001508722 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (cip_base_scoreboard.sv:288) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 1 failures:
- Test entropy_src_rng has 1 failures.
  - 272.entropy_src_rng.105552222349253002845925595790413097478171627475461935431218610798042498945072
    Line 912, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/272.entropy_src_rng/latest/run.log
```
  UVM_ERROR @ 1557116904 ps: (cip_base_scoreboard.sv:288) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 1557116904 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (entropy_src_base_vseq.sv:430) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 319.entropy_src_rng_max_rate.86115474086603129997878092691685172058541797037089858841906202503313424106762
    Line 587, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/319.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 2532864754 ps: (entropy_src_base_vseq.sv:430) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 2532864754 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```