ENTROPY_SRC Simulation Results

Friday May 26 2023 07:06:59 UTC

GitHub Revision: `213e792ea`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 2340441291

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	4.000s	27.191us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	3.000s	49.417us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	6.000s	74.911us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	16.000s	3.490ms	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	8.000s	970.404us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	4.000s	56.223us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	6.000s	74.911us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	970.404us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	4.000s	27.191us	50	50	100.00
		entropy_src_rng	10.600m	10.013ms	299	300	99.67
		entropy_src_fw_ov	1.967m	5.020ms	299	300	99.67
V2	firmware_mode	entropy_src_fw_ov	1.967m	5.020ms	299	300	99.67
V2	rng_mode	entropy_src_rng	10.600m	10.013ms	299	300	99.67
V2	rng_max_rate	entropy_src_rng_max_rate	11.100m	10.014ms	398	400	99.50
V2	health_checks	entropy_src_rng	10.600m	10.013ms	299	300	99.67
V2	conditioning	entropy_src_rng	10.600m	10.013ms	299	300	99.67
V2	interrupts	entropy_src_rng	10.600m	10.013ms	299	300	99.67
V2	alerts	entropy_src_rng	10.600m	10.013ms	299	300	99.67
		entropy_src_functional_alerts	5.000s	119.401us	50	50	100.00
V2	stress_all	entropy_src_stress_all	11.000s	255.353us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	5.000s	41.505us	1000	1000	100.00
V2	intr_test	entropy_src_intr_test	4.000s	17.490us	50	50	100.00
V2	alert_test	entropy_src_alert_test	4.000s	28.804us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	7.000s	216.302us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	7.000s	216.302us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	3.000s	49.417us	5	5	100.00
		entropy_src_csr_rw	6.000s	74.911us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	970.404us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	217.283us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	3.000s	49.417us	5	5	100.00
		entropy_src_csr_rw	6.000s	74.911us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	970.404us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	217.283us	20	20	100.00
V2		TOTAL			2236	2240	99.82
V2S	tl_intg_err	entropy_src_sec_cm	5.000s	1.497ms	5	5	100.00
		entropy_src_tl_intg_err	7.000s	200.696us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	10.600m	10.013ms	299	300	99.67
		entropy_src_cfg_regwen	4.000s	71.361us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	10.600m	10.013ms	299	300	99.67
V2S	sec_cm_config_redun	entropy_src_rng	10.600m	10.013ms	299	300	99.67
V2S	sec_cm_intersig_mubi	entropy_src_rng	10.600m	10.013ms	299	300	99.67
		entropy_src_fw_ov	1.967m	5.020ms	299	300	99.67
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	5.000s	41.505us	1000	1000	100.00
		entropy_src_sec_cm	5.000s	1.497ms	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	5.000s	41.505us	1000	1000	100.00
		entropy_src_sec_cm	5.000s	1.497ms	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	10.600m	10.013ms	299	300	99.67
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	5.000s	41.505us	1000	1000	100.00
		entropy_src_sec_cm	5.000s	1.497ms	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	5.000s	41.505us	1000	1000	100.00
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	5.000s	119.401us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	7.000s	200.696us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	4.917m	10.022ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
		TOTAL			2466	2470	99.84

Testplan Progress

Items	Total	Written	Passing	Progress
V1	6	6	6	100.00
V2	10	10	7	70.00
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
98.48	99.04	97.60	99.68	96.93	99.40	87.39	91.61	97.00

Failure Buckets

UVM_ERROR (entropy_src_scoreboard.sv:1804) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.recov_alert_sts has 2 failures:

Test entropy_src_rng has 1 failures.

86.entropy_src_rng.1114066672
Line 427, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/86.entropy_src_rng/latest/run.log

  UVM_ERROR @ 613895499 ps: (entropy_src_scoreboard.sv:1804) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (4096 [0x1000] vs 0 [0x0]) reg name: entropy_src_reg_block.recov_alert_sts
  UVM_INFO @ 613895499 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Test entropy_src_rng_max_rate has 1 failures.

175.entropy_src_rng_max_rate.3172800888
Line 1019, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/175.entropy_src_rng_max_rate/latest/run.log

  UVM_ERROR @ 2964061813 ps: (entropy_src_scoreboard.sv:1804) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (4096 [0x1000] vs 0 [0x0]) reg name: entropy_src_reg_block.recov_alert_sts
  UVM_INFO @ 2964061813 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

UVM_ERROR (cip_base_scoreboard.sv:282) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 104.entropy_src_rng_max_rate.3549464994
    Line 1716, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/104.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 5626842855 ps: (cip_base_scoreboard.sv:282) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 5626842855 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,2990): Assertion AtReset_EsbitFifoPushedIntoPosthtFifo_A has failed has 1 failures:

Test entropy_src_fw_ov has 1 failures.

143.entropy_src_fw_ov.2761628037
Line 467, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/143.entropy_src_fw_ov/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,2990): (time 1578244269 PS) Assertion tb.dut.u_entropy_src_core.AtReset_EsbitFifoPushedIntoPosthtFifo_A has failed
  UVM_ERROR @ 1578244269 ps: (entropy_src_core.sv:2990) [ASSERT FAILED] AtReset_EsbitFifoPushedIntoPosthtFifo_A
  UVM_INFO @ 1578244269 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---