ENTROPY_SRC Simulation Results

Tuesday May 16 2023 07:02:31 UTC

GitHub Revision: `50278df8b`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 1341560578

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	4.000s	86.158us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	4.000s	32.541us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	4.000s	14.739us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	16.000s	9.519ms	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	8.000s	510.255us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	5.000s	36.671us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	4.000s	14.739us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	510.255us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	4.000s	86.158us	50	50	100.00
		entropy_src_rng	10.217m	10.015ms	299	300	99.67
		entropy_src_fw_ov	1.933m	5.059ms	300	300	100.00
V2	firmware_mode	entropy_src_fw_ov	1.933m	5.059ms	300	300	100.00
V2	rng_mode	entropy_src_rng	10.217m	10.015ms	299	300	99.67
V2	rng_max_rate	entropy_src_rng_max_rate	11.283m	10.013ms	399	400	99.75
V2	health_checks	entropy_src_rng	10.217m	10.015ms	299	300	99.67
V2	conditioning	entropy_src_rng	10.217m	10.015ms	299	300	99.67
V2	interrupts	entropy_src_rng	10.217m	10.015ms	299	300	99.67
V2	alerts	entropy_src_rng	10.217m	10.015ms	299	300	99.67
		entropy_src_functional_alerts	5.000s	327.153us	50	50	100.00
V2	stress_all	entropy_src_stress_all	10.000s	343.580us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	5.000s	49.839us	1000	1000	100.00
V2	intr_test	entropy_src_intr_test	4.000s	14.204us	50	50	100.00
V2	alert_test	entropy_src_alert_test	4.000s	27.047us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	8.000s	612.524us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	8.000s	612.524us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	4.000s	32.541us	5	5	100.00
		entropy_src_csr_rw	4.000s	14.739us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	510.255us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	84.272us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	4.000s	32.541us	5	5	100.00
		entropy_src_csr_rw	4.000s	14.739us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	510.255us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	84.272us	20	20	100.00
V2		TOTAL			2238	2240	99.91
V2S	tl_intg_err	entropy_src_sec_cm	4.000s	155.334us	5	5	100.00
		entropy_src_tl_intg_err	6.000s	211.043us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	10.217m	10.015ms	299	300	99.67
		entropy_src_cfg_regwen	4.000s	17.740us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	10.217m	10.015ms	299	300	99.67
V2S	sec_cm_config_redun	entropy_src_rng	10.217m	10.015ms	299	300	99.67
V2S	sec_cm_intersig_mubi	entropy_src_rng	10.217m	10.015ms	299	300	99.67
		entropy_src_fw_ov	1.933m	5.059ms	300	300	100.00
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	5.000s	49.839us	1000	1000	100.00
		entropy_src_sec_cm	4.000s	155.334us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	5.000s	49.839us	1000	1000	100.00
		entropy_src_sec_cm	4.000s	155.334us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	10.217m	10.015ms	299	300	99.67
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	5.000s	49.839us	1000	1000	100.00
		entropy_src_sec_cm	4.000s	155.334us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	5.000s	49.839us	1000	1000	100.00
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	5.000s	327.153us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	6.000s	211.043us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	5.233m	10.023ms	49	50	98.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			49	50	98.00
		TOTAL			2467	2470	99.88

Testplan Progress

Items	Total	Written	Passing	Progress
V1	6	6	6	100.00
V2	10	10	8	80.00
V2S	3	3	3	100.00
V3	2	1	0	0.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
98.41	99.06	97.65	99.71	96.84	99.40	87.39	91.61	96.39

Failure Buckets

Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3194): Assertion AtReset_PreconFifoPushedPostStartup_A has failed has 2 failures:

Test entropy_src_rng_max_rate has 1 failures.

62.entropy_src_rng_max_rate.2362355009
Line 1522, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/62.entropy_src_rng_max_rate/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3194): (time 4658968699 PS) Assertion tb.dut.u_entropy_src_core.AtReset_PreconFifoPushedPostStartup_A has failed
  UVM_ERROR @ 4658968699 ps: (entropy_src_core.sv:3194) [ASSERT FAILED] AtReset_PreconFifoPushedPostStartup_A
  UVM_INFO @ 4658968699 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

Test entropy_src_rng has 1 failures.

78.entropy_src_rng.2597573505
Line 1819, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/78.entropy_src_rng/latest/run.log

  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3194): (time 9900559265 PS) Assertion tb.dut.u_entropy_src_core.AtReset_PreconFifoPushedPostStartup_A has failed
  UVM_ERROR @ 9900559265 ps: (entropy_src_core.sv:3194) [ASSERT FAILED] AtReset_PreconFifoPushedPostStartup_A
  UVM_INFO @ 9900559265 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

UVM_ERROR (cip_base_scoreboard.sv:282) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 1 failures:
- Test entropy_src_rng_with_xht_rsps has 1 failures.
  - 34.entropy_src_rng_with_xht_rsps.117249008
    Line 619, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/34.entropy_src_rng_with_xht_rsps/latest/run.log
```
  UVM_ERROR @ 9564127125 ps: (cip_base_scoreboard.sv:282) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 9564127125 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```