SYSRST_CTRL Simulation Results

Sunday October 29 2023 19:02:47 UTC

GitHub Revision: `930d36186`

Branch: os_regression

Simulator: VCS

Build randomization enabled with --build-seed 53246679791135725850786299077577956156654225596082308096128637295153525531577

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	sysrst_ctrl_smoke	4.040s	2.117ms	50	50	100.00
V1	input_output_inverted	sysrst_ctrl_in_out_inverted	5.050s	2.470ms	50	50	100.00
V1	combo_detect_ec_rst	sysrst_ctrl_combo_detect_ec_rst	4.390s	2.399ms	5	5	100.00
V1	combo_detect_ec_rst_with_pre_cond	sysrst_ctrl_combo_detect_ec_rst_with_pre_cond	4.600s	2.535ms	5	5	100.00
V1	csr_hw_reset	sysrst_ctrl_csr_hw_reset	10.420s	6.031ms	5	5	100.00
V1	csr_rw	sysrst_ctrl_csr_rw	4.340s	2.075ms	20	20	100.00
V1	csr_bit_bash	sysrst_ctrl_csr_bit_bash	1.938m	41.048ms	5	5	100.00
V1	csr_aliasing	sysrst_ctrl_csr_aliasing	8.940s	2.891ms	5	5	100.00
V1	csr_mem_rw_with_rand_reset	sysrst_ctrl_csr_mem_rw_with_rand_reset	4.720s	2.142ms	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	sysrst_ctrl_csr_rw	4.340s	2.075ms	20	20	100.00
		sysrst_ctrl_csr_aliasing	8.940s	2.891ms	5	5	100.00
V1		TOTAL			165	165	100.00
V2	combo_detect	sysrst_ctrl_combo_detect	3.109m	118.289ms	50	50	100.00
V2	combo_detect_with_pre_cond	sysrst_ctrl_combo_detect_with_pre_cond	1.324m	49.085ms	0	100	0.00
V2	auto_block_key_outputs	sysrst_ctrl_auto_blk_key_output	5.780s	3.139ms	50	50	100.00
V2	keyboard_input_triggered_interrupt	sysrst_ctrl_edge_detect	6.700s	4.089ms	50	50	100.00
V2	pin_output_keyboard_inversion_control	sysrst_ctrl_pin_override_test	5.030s	2.515ms	50	50	100.00
V2	pin_input_value_accessibility	sysrst_ctrl_pin_access_test	4.050s	2.075ms	50	50	100.00
V2	ec_power_on_reset	sysrst_ctrl_ec_pwr_on_rst	7.870s	4.425ms	50	50	100.00
V2	flash_write_protect_output	sysrst_ctrl_flash_wr_prot_out	5.030s	2.620ms	50	50	100.00
V2	ultra_low_power_test	sysrst_ctrl_ultra_low_pwr	5.140s	5.189ms	50	50	100.00
V2	sysrst_ctrl_feature_disable	sysrst_ctrl_feature_disable	1.011m	38.606ms	2	2	100.00
V2	stress_all	sysrst_ctrl_stress_all	2.305m	87.229ms	50	50	100.00
V2	alert_test	sysrst_ctrl_alert_test	3.890s	2.015ms	50	50	100.00
V2	intr_test	sysrst_ctrl_intr_test	3.960s	2.023ms	50	50	100.00
V2	tl_d_oob_addr_access	sysrst_ctrl_tl_errors	6.010s	2.187ms	20	20	100.00
V2	tl_d_illegal_access	sysrst_ctrl_tl_errors	6.010s	2.187ms	20	20	100.00
V2	tl_d_outstanding_access	sysrst_ctrl_csr_hw_reset	10.420s	6.031ms	5	5	100.00
		sysrst_ctrl_csr_rw	4.340s	2.075ms	20	20	100.00
		sysrst_ctrl_csr_aliasing	8.940s	2.891ms	5	5	100.00
		sysrst_ctrl_same_csr_outstanding	26.740s	9.477ms	20	20	100.00
V2	tl_d_partial_access	sysrst_ctrl_csr_hw_reset	10.420s	6.031ms	5	5	100.00
		sysrst_ctrl_csr_rw	4.340s	2.075ms	20	20	100.00
		sysrst_ctrl_csr_aliasing	8.940s	2.891ms	5	5	100.00
		sysrst_ctrl_same_csr_outstanding	26.740s	9.477ms	20	20	100.00
V2		TOTAL			592	692	85.55
V2S	tl_intg_err	sysrst_ctrl_sec_cm	1.108m	42.019ms	5	5	100.00
		sysrst_ctrl_tl_intg_err	1.193m	42.511ms	20	20	100.00
V2S	sec_cm_bus_integrity	sysrst_ctrl_tl_intg_err	1.193m	42.511ms	20	20	100.00
V2S		TOTAL			25	25	100.00
V3	stress_all_with_rand_reset	sysrst_ctrl_stress_all_with_rand_reset	7.520s	6.010ms	0	50	0.00
V3		TOTAL			0	50	0.00
		TOTAL			782	932	83.91

Testplan Progress

Items	Total	Written	Passing	Progress
V1	9	9	9	100.00
V2	15	15	14	93.33
V2S	2	2	2	100.00
V3	1	1	0	0.00

Coverage Results

Coverage Dashboard

SCORE	LINE	COND	TOGGLE	FSM	BRANCH	ASSERT	GROUP
89.95	97.93	94.86	100.00	79.49	97.01	94.01	66.35

Failure Buckets

UVM_ERROR (sysrst_ctrl_combo_detect_with_pre_cond_vseq.sv:266) [sysrst_ctrl_combo_detect_with_pre_cond_vseq] Check failed (inactive_cycles inside {[exp_cycles - EXP_CYCLE_TOLERANCE : exp_cycles + EXP_CYCLE_TOLERANCE]}) rst_req_check: inact(9) vs exp(5) +/-*

has 100 failures:

Test sysrst_ctrl_combo_detect_with_pre_cond has 100 failures.

0.sysrst_ctrl_combo_detect_with_pre_cond.28342415734408680443577145195213325586425130909440266514317645709958840429
Line 544, in log /container/opentitan-public/scratch/os_regression/sysrst_ctrl-sim-vcs/0.sysrst_ctrl_combo_detect_with_pre_cond/latest/run.log

  UVM_ERROR @ 49085268838 ps: (sysrst_ctrl_combo_detect_with_pre_cond_vseq.sv:266) [uvm_test_top.env.virtual_sequencer.sysrst_ctrl_combo_detect_with_pre_cond_vseq] Check failed (inactive_cycles inside {[exp_cycles - EXP_CYCLE_TOLERANCE :                                       exp_cycles + EXP_CYCLE_TOLERANCE]}) rst_req_check: inact(9) vs exp(5) +/-4
  UVM_ERROR @ 49085268838 ps: (sysrst_ctrl_combo_detect_with_pre_cond_vseq.sv:280) [uvm_test_top.env.virtual_sequencer.sysrst_ctrl_combo_detect_with_pre_cond_vseq] Check failed (inactive_cycles inside {[exp_cycles - EXP_CYCLE_TOLERANCE :                                       exp_cycles + EXP_CYCLE_TOLERANCE]}) wkup_req_check: inact(9) vs exp(5) +/-4
  UVM_INFO @ 49085268838 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

1.sysrst_ctrl_combo_detect_with_pre_cond.91158486645064746355957699454913284948695802424341889197089767742634629709411
Line 544, in log /container/opentitan-public/scratch/os_regression/sysrst_ctrl-sim-vcs/1.sysrst_ctrl_combo_detect_with_pre_cond/latest/run.log

  UVM_ERROR @ 49085268838 ps: (sysrst_ctrl_combo_detect_with_pre_cond_vseq.sv:266) [uvm_test_top.env.virtual_sequencer.sysrst_ctrl_combo_detect_with_pre_cond_vseq] Check failed (inactive_cycles inside {[exp_cycles - EXP_CYCLE_TOLERANCE :                                       exp_cycles + EXP_CYCLE_TOLERANCE]}) rst_req_check: inact(9) vs exp(5) +/-4
  UVM_ERROR @ 49085268838 ps: (sysrst_ctrl_combo_detect_with_pre_cond_vseq.sv:280) [uvm_test_top.env.virtual_sequencer.sysrst_ctrl_combo_detect_with_pre_cond_vseq] Check failed (inactive_cycles inside {[exp_cycles - EXP_CYCLE_TOLERANCE :                                       exp_cycles + EXP_CYCLE_TOLERANCE]}) wkup_req_check: inact(9) vs exp(5) +/-4
  UVM_INFO @ 49085268838 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 98 more failures.

UVM_ERROR (sysrst_ctrl_ultra_low_pwr_vseq.sv:113) [sysrst_ctrl_ultra_low_pwr_vseq] Check failed (exp_z3_wakeup) has 50 failures:

Test sysrst_ctrl_stress_all_with_rand_reset has 50 failures.

0.sysrst_ctrl_stress_all_with_rand_reset.370966258887675107369543125677803316784481710457397398636511676594342135136
Line 516, in log /container/opentitan-public/scratch/os_regression/sysrst_ctrl-sim-vcs/0.sysrst_ctrl_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @ 5367768838 ps: (sysrst_ctrl_ultra_low_pwr_vseq.sv:113) [uvm_test_top.env.virtual_sequencer.sysrst_ctrl_ultra_low_pwr_vseq] Check failed (exp_z3_wakeup)    
  UVM_ERROR @ 6010268838 ps: (sysrst_ctrl_ultra_low_pwr_vseq.sv:214) [uvm_test_top.env.virtual_sequencer.sysrst_ctrl_ultra_low_pwr_vseq] Check failed cfg.vif.z3_wakeup == 0 (1 [0x1] vs 0 [0x0])
  UVM_INFO @ 6010268838 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

1.sysrst_ctrl_stress_all_with_rand_reset.42978384905462570816245440617627424487498032625382490728503924125811777984235
Line 516, in log /container/opentitan-public/scratch/os_regression/sysrst_ctrl-sim-vcs/1.sysrst_ctrl_stress_all_with_rand_reset/latest/run.log

  UVM_ERROR @ 5367768838 ps: (sysrst_ctrl_ultra_low_pwr_vseq.sv:113) [uvm_test_top.env.virtual_sequencer.sysrst_ctrl_ultra_low_pwr_vseq] Check failed (exp_z3_wakeup)    
  UVM_ERROR @ 6010268838 ps: (sysrst_ctrl_ultra_low_pwr_vseq.sv:214) [uvm_test_top.env.virtual_sequencer.sysrst_ctrl_ultra_low_pwr_vseq] Check failed cfg.vif.z3_wakeup == 0 (1 [0x1] vs 0 [0x0])
  UVM_INFO @ 6010268838 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 48 more failures.