USBDEV Simulation Results

Sunday July 21 2024 23:02:06 UTC

GitHub Revision: `e971cd9798`

Branch: os_regression

Simulator: VCS

Build randomization enabled with --build-seed 60538554475599760039478308558126864941531727393021608909386829062452482962039

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	usbdev_smoke	1.050s	242.467us	50	50	100.00
V1	csr_hw_reset	usbdev_csr_hw_reset	0.960s	137.788us	5	5	100.00
V1	csr_rw	usbdev_csr_rw	1.100s	100.134us	20	20	100.00
V1	csr_bit_bash	usbdev_csr_bit_bash	9.830s	1.059ms	5	5	100.00
V1	csr_aliasing	usbdev_csr_aliasing	3.630s	342.216us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	usbdev_csr_mem_rw_with_rand_reset	2.660s	102.955us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	usbdev_csr_rw	1.100s	100.134us	20	20	100.00
		usbdev_csr_aliasing	3.630s	342.216us	5	5	100.00
V1	mem_walk	usbdev_mem_walk	5.050s	748.819us	5	5	100.00
V1	mem_partial_access	usbdev_mem_partial_access	2.480s	200.023us	5	5	100.00
V1		TOTAL			115	115	100.00
V2	in_trans	usbdev_in_trans	1.040s	243.015us	50	50	100.00
V2	data_toggle_clear	usbdev_data_toggle_clear	1.990s	615.389us	50	50	100.00
V2	phy_pins_sense	usbdev_phy_pins_sense	0.740s	129.007us	50	50	100.00
V2	av_buffer	usbdev_av_buffer	0.930s	252.165us	50	50	100.00
V2	rx_fifo	usbdev_pkt_buffer	52.200s	21.785ms	50	50	100.00
V2	phy_config_tx_osc_test_mode	usbdev_phy_config_tx_osc_test_mode	1.020s	303.993us	1	1	100.00
V2	phy_config_eop_single_bit_handling	usbdev_phy_config_eop_single_bit_handling	0.890s	196.737us	1	1	100.00
V2	phy_config_pinflip	usbdev_phy_config_pinflip	1.140s	246.845us	50	50	100.00
V2	phy_config_rand_bus_type	usbdev_phy_config_rand_bus_type	1.040s	238.550us	5	5	100.00
V2	phy_config_rx_dp_dn	usbdev_phy_config_rx_dp_dn	0.890s	203.090us	1	1	100.00
V2	phy_config_tx_use_d_se0	usbdev_phy_config_tx_use_d_se0	0.910s	234.420us	1	1	100.00
V2	phy_config_usb_ref_disable	usbdev_phy_config_usb_ref_disable	0.950s	173.404us	50	50	100.00
V2	max_length_out_transaction	usbdev_max_length_out_transaction	0.980s	195.825us	50	50	100.00
		usbdev_stream_len_max	3.120s	1.398ms	50	50	100.00
V2	max_length_in_transaction	usbdev_max_length_in_transaction	1.080s	262.526us	50	50	100.00
V2	min_length_out_transaction	usbdev_min_length_out_transaction	0.880s	207.603us	50	50	100.00
V2	min_length_in_transaction	usbdev_min_length_in_transaction	0.890s	158.800us	50	50	100.00
V2	random_length_out_transaction	usbdev_random_length_out_transaction	0.940s	220.413us	50	50	100.00
V2	random_length_in_transaction	usbdev_random_length_in_transaction	1.010s	291.837us	50	50	100.00
V2	out_stall	usbdev_out_stall	0.920s	240.220us	50	50	100.00
V2	in_stall	usbdev_in_stall	0.840s	182.440us	50	50	100.00
V2	out_iso	usbdev_out_iso	0.980s	226.252us	50	50	100.00
V2	in_iso	usbdev_in_iso	1.030s	294.179us	50	50	100.00
V2	pkt_received	usbdev_pkt_received	0.960s	232.953us	50	50	100.00
V2	pkt_sent	usbdev_pkt_sent	0.990s	293.454us	50	50	100.00
V2	disconnected	usbdev_disconnected	0.850s	169.417us	50	50	100.00
V2	host_lost	usbdev_host_lost	8.800s	4.168ms	1	1	100.00
V2	link_reset	usbdev_link_reset	0.770s	183.557us	1	1	100.00
V2	link_suspend	usbdev_link_suspend	4.710s	3.271ms	50	50	100.00
V2	link_resume	usbdev_link_resume	27.890s	23.396ms	50	50	100.00
V2	av_empty	usbdev_av_empty	0.860s	173.049us	5	5	100.00
V2	rx_full	usbdev_rx_full	1.010s	275.628us	1	1	100.00
V2	av_overflow	usbdev_av_overflow	0.840s	201.565us	5	5	100.00
V2	link_in_err	usbdev_link_in_err	1.030s	236.037us	50	50	100.00
V2	rx_crc_err	usbdev_rx_crc_err	0.950s	211.728us	50	50	100.00
V2	rx_pid_err	usbdev_rx_pid_err	0.910s	199.690us	5	5	100.00
V2	rx_bitstuff_err	usbdev_bitstuff_err	0.940s	158.182us	50	50	100.00
V2	link_out_err	usbdev_link_out_err	1.500s	489.615us	1	1	100.00
V2	enable	usbdev_enable	0.770s	74.016us	50	50	100.00
V2	resume_link_active	usbdev_resume_link_active	21.230s	20.191ms	1	1	100.00
V2	device_address	usbdev_device_address	51.880s	23.274ms	50	50	100.00
V2	invalid_data1_data0_toggle_test	usbdev_invalid_data1_data0_toggle_test	1.410s	464.958us	1	1	100.00
V2	setup_stage	usbdev_setup_stage	0.880s	175.990us	50	50	100.00
V2	endpoint_access	usbdev_endpoint_access	2.440s	990.032us	50	50	100.00
V2	disable_endpoint	usbdev_disable_endpoint	1.580s	592.563us	50	50	100.00
V2	out_trans_nak	usbdev_out_trans_nak	0.900s	186.823us	50	50	100.00
V2	setup_trans_ignored	usbdev_setup_trans_ignored	0.890s	169.416us	50	50	100.00
V2	nak_trans	usbdev_nak_trans	0.990s	226.596us	50	50	100.00
V2	stall_trans	usbdev_stall_trans	0.920s	186.047us	50	50	100.00
V2	setup_priority_over_stall_response	usbdev_setup_priority_over_stall_response	1.000s	379.970us	5	5	100.00
V2	stall_priority_over_nak	usbdev_stall_priority_over_nak	0.940s	178.338us	50	50	100.00
V2	pending_in_trans	usbdev_pending_in_trans	0.910s	175.269us	50	50	100.00
V2	streaming_test	usbdev_streaming_out	3.660m	7.872ms	50	50	100.00
V2	max_clock_error_untracked	usbdev_freq_hiclk	2.615m	114.182ms	5	5	100.00
		usbdev_freq_loclk	2.428m	92.108ms	5	5	100.00
V2	max_clock_error_tracking	usbdev_freq_hiclk_max	2.337m	91.346ms	5	5	100.00
		usbdev_freq_loclk_max	2.708m	120.176ms	5	5	100.00
V2	max_phase_error	usbdev_freq_phase	2.650m	109.137ms	5	5	100.00
V2	min_inter_pkt_delay	usbdev_min_inter_pkt_delay	3.452m	7.404ms	50	50	100.00
V2	max_inter_pkt_delay	usbdev_max_inter_pkt_delay	3.700m	8.042ms	50	50	100.00
V2	device_timeout_missing_host_handshake	usbdev_timeout_missing_host_handshake	5.020s	828.217us	0	50	0.00
V2	device_timeout	usbdev_device_timeout	5.440s	833.899us	0	50	0.00
V2	packet_buffer	usbdev_pkt_buffer	52.200s	21.785ms	50	50	100.00
V2	nak_to_out_trans_when_avbuffer_empty_rxfifo_full	usbdev_nak_to_out_trans_when_avbuffer_empty_rxfifo_full	1.240s	474.434us	1	1	100.00
V2	aon_wake_resume	usbdev_aon_wake_resume	30.910s	23.336ms	50	50	100.00
V2	aon_wake_reset	usbdev_aon_wake_reset	16.220s	13.384ms	50	50	100.00
V2	aon_wake_disconnect	usbdev_aon_wake_disconnect	6.280s	4.393ms	50	50	100.00
V2	invalid_sync	usbdev_invalid_sync	4.735m	10.026ms	38	50	76.00
V2	spurious_pids_ignored	usbdev_spurious_pids_ignored	3.361m	7.094ms	50	50	100.00
V2	low_speed_traffic	usbdev_low_speed_traffic	5.883m	12.972ms	50	50	100.00
V2	rand_bus_resets	usbdev_rand_bus_resets	6.744m	15.952ms	10	10	100.00
V2	rand_disconnects	usbdev_rand_bus_disconnects	4.223m	9.692ms	10	10	100.00
V2	rand_suspends	usbdev_rand_suspends	6.126m	17.106ms	10	10	100.00
V2	max_usb_traffic	usbdev_max_usb_traffic	3.202m	7.211ms	50	50	100.00
V2	stress_usb_traffic	usbdev_stress_usb_traffic	5.530m	12.523ms	5	5	100.00
V2	in_packet_retraction	usbdev_iso_retraction	1.915m	12.940ms	42	50	84.00
V2	data_toggle_restore	usbdev_data_toggle_restore	3.610s	1.503ms	50	50	100.00
V2	setup_priority	usbdev_setup_priority	1.480s	451.236us	5	5	100.00
V2	fifo_resets	usbdev_fifo_rst	2.670s	430.298us	50	50	100.00
V2	intr_test	usbdev_intr_test	0.760s	108.353us	50	50	100.00
V2	alert_test	usbdev_alert_test	0.760s	100.732us	50	50	100.00
V2	tl_d_oob_addr_access	usbdev_tl_errors	3.430s	278.373us	20	20	100.00
V2	tl_d_illegal_access	usbdev_tl_errors	3.430s	278.373us	20	20	100.00
V2	tl_d_outstanding_access	usbdev_csr_hw_reset	0.960s	137.788us	5	5	100.00
		usbdev_csr_rw	1.100s	100.134us	20	20	100.00
		usbdev_csr_aliasing	3.630s	342.216us	5	5	100.00
		usbdev_same_csr_outstanding	2.230s	415.405us	20	20	100.00
V2	tl_d_partial_access	usbdev_csr_hw_reset	0.960s	137.788us	5	5	100.00
		usbdev_csr_rw	1.100s	100.134us	20	20	100.00
		usbdev_csr_aliasing	3.630s	342.216us	5	5	100.00
		usbdev_same_csr_outstanding	2.230s	415.405us	20	20	100.00
V2		TOTAL			2721	2841	95.78
V2S	tl_intg_err	usbdev_sec_cm	1.950s	1.295ms	5	5	100.00
		usbdev_tl_intg_err	5.910s	1.346ms	20	20	100.00
V2S	sec_cm_bus_integrity	usbdev_tl_intg_err	5.910s	1.346ms	20	20	100.00
V2S		TOTAL			25	25	100.00
V3	dpi_config_host	usbdev_dpi_config_host	2.104m	5.123ms	1	1	100.00
V3		TOTAL			1	1	100.00
	Unmapped tests	usbdev_stress_all_with_rand_reset	0.690s	43.639us	0	10	0.00
		usbdev_stress_all	0.620s		0	50	0.00
		TOTAL			2862	3042	94.08

Testplan Progress

Items	Total	Written	Passing	Progress
N.A.	2	2	0	0.00
V1	8	8	8	100.00
V2	82	82	78	95.12
V2S	2	2	2	100.00
V3	1	1	1	100.00

Coverage Results

Coverage Dashboard

SCORE	LINE	COND	TOGGLE	FSM	BRANCH	ASSERT	GROUP
93.36	97.82	93.83	97.44	73.44	96.21	98.17	96.58

Failure Buckets

UVM_ERROR (usbdev_device_timeout_vseq.sv:31) [usbdev_device_timeout_vseq] Check failed get_field_val(ral.configin[*].sending, configin) == exp_sending (* [*] vs * [*]) sending not as expected

has 68 failures:

Test usbdev_timeout_missing_host_handshake has 32 failures.

0.usbdev_timeout_missing_host_handshake.28949350110938996233391075457323885946421452099108058486407826862972847542220
Line 290, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_timeout_missing_host_handshake/latest/run.log

  UVM_ERROR @ 177173296 ps: (usbdev_device_timeout_vseq.sv:31) [uvm_test_top.env.virtual_sequencer.usbdev_device_timeout_vseq] Check failed get_field_val(ral.configin[0].sending, configin) == exp_sending (1 [0x1] vs 0 [0x0]) sending not as expected
  UVM_INFO @ 177173296 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

3.usbdev_timeout_missing_host_handshake.32585057870152376259126644141226686834773408491289842189995954734395690301234
Line 276, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/3.usbdev_timeout_missing_host_handshake/latest/run.log

  UVM_ERROR @ 143575099 ps: (usbdev_device_timeout_vseq.sv:31) [uvm_test_top.env.virtual_sequencer.usbdev_device_timeout_vseq] Check failed get_field_val(ral.configin[0].sending, configin) == exp_sending (1 [0x1] vs 0 [0x0]) sending not as expected
  UVM_INFO @ 143575099 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 30 more failures.

Test usbdev_device_timeout has 36 failures.

2.usbdev_device_timeout.34837969661415308548369721938667867894301319521407685007413362508212070338053
Line 290, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_device_timeout/latest/run.log

  UVM_ERROR @ 205431546 ps: (usbdev_device_timeout_vseq.sv:31) [uvm_test_top.env.virtual_sequencer.usbdev_device_timeout_vseq] Check failed get_field_val(ral.configin[0].sending, configin) == exp_sending (1 [0x1] vs 0 [0x0]) sending not as expected
  UVM_INFO @ 205431546 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

3.usbdev_device_timeout.19415921789661031339277617043985867789901604085734525676763343582403606549815
Line 276, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/3.usbdev_device_timeout/latest/run.log

  UVM_ERROR @ 165779254 ps: (usbdev_device_timeout_vseq.sv:31) [uvm_test_top.env.virtual_sequencer.usbdev_device_timeout_vseq] Check failed get_field_val(ral.configin[0].sending, configin) == exp_sending (1 [0x1] vs 0 [0x0]) sending not as expected
  UVM_INFO @ 165779254 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 34 more failures.

UVM_WARNING [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.

has 60 failures:

Test usbdev_stress_all_with_rand_reset has 10 failures.

0.usbdev_stress_all_with_rand_reset.110655206931954840146550835081001852088495032169802050014559892084576078543975
Line 251, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all_with_rand_reset/latest/run.log

  UVM_WARNING @  22347834 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
  UVM_INFO @  22347834 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
  #### Factory Configuration (*)
  
  No instance overrides are registered with this factory

1.usbdev_stress_all_with_rand_reset.103271236444647862152576929298859561905720375461346429798214645384410275591658
Line 251, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all_with_rand_reset/latest/run.log

  UVM_WARNING @  44720290 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
  UVM_INFO @  44720290 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
  #### Factory Configuration (*)
  
  No instance overrides are registered with this factory

... and 8 more failures.

Test usbdev_stress_all has 50 failures.

0.usbdev_stress_all.112305607668551514003301006249220207229869290798639948007145118808430614854099
Line 251, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all/latest/run.log

  UVM_WARNING @         0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
  UVM_INFO @         0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
  #### Factory Configuration (*)
  
  No instance overrides are registered with this factory

1.usbdev_stress_all.79611877918353411225651742079399205316384227822207623693375833918828077998675
Line 251, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all/latest/run.log

  UVM_WARNING @         0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
  UVM_INFO @         0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
  #### Factory Configuration (*)
  
  No instance overrides are registered with this factory

... and 48 more failures.

UVM_ERROR (usbdev_base_vseq.sv:645) [usbdev_device_timeout_vseq] Check failed sending == * (* [*] vs * [*]) Packet was neither collected nor retracted

has 32 failures:

Test usbdev_device_timeout has 14 failures.

0.usbdev_device_timeout.9615345677841317828039886473310750351191465297235842553753902047216539584013
Line 266, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_device_timeout/latest/run.log

  UVM_ERROR @ 291410668 ps: (usbdev_base_vseq.sv:645) [uvm_test_top.env.virtual_sequencer.usbdev_device_timeout_vseq] Check failed sending == 0 (1 [0x1] vs 0 [0x0]) Packet was neither collected nor retracted
  UVM_INFO @ 291410668 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

1.usbdev_device_timeout.73105736761839519209731723620545811043589301615168210067289709989613414955302
Line 266, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_device_timeout/latest/run.log

  UVM_ERROR @ 578455820 ps: (usbdev_base_vseq.sv:645) [uvm_test_top.env.virtual_sequencer.usbdev_device_timeout_vseq] Check failed sending == 0 (1 [0x1] vs 0 [0x0]) Packet was neither collected nor retracted
  UVM_INFO @ 578455820 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 12 more failures.

Test usbdev_timeout_missing_host_handshake has 18 failures.

1.usbdev_timeout_missing_host_handshake.3190583919339189661009965530605240056584338294995512476361815346023990144664
Line 266, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_timeout_missing_host_handshake/latest/run.log

  UVM_ERROR @ 263093372 ps: (usbdev_base_vseq.sv:645) [uvm_test_top.env.virtual_sequencer.usbdev_device_timeout_vseq] Check failed sending == 0 (1 [0x1] vs 0 [0x0]) Packet was neither collected nor retracted
  UVM_INFO @ 263093372 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

2.usbdev_timeout_missing_host_handshake.52929041712692196597443208636686237507303473453679735001338935277480452566893
Line 266, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_timeout_missing_host_handshake/latest/run.log

  UVM_ERROR @ 580335053 ps: (usbdev_base_vseq.sv:645) [uvm_test_top.env.virtual_sequencer.usbdev_device_timeout_vseq] Check failed sending == 0 (1 [0x1] vs 0 [0x0]) Packet was neither collected nor retracted
  UVM_INFO @ 580335053 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 16 more failures.

UVM_FATAL (usb20_item.sv:96) [m_data_pkt] Check failed m_pid_type == expected (* [*] vs * [*]) has 12 failures:
- Test usbdev_invalid_sync has 12 failures.
  - 7.usbdev_invalid_sync.73867795493667567258204645717870757202451285268017696331750129739563034166329
    Line 1579, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/7.usbdev_invalid_sync/latest/run.log
```
  UVM_FATAL @ 1551349226 ps: (usb20_item.sv:96) [m_data_pkt] Check failed m_pid_type == expected (195 [0xc3] vs 210 [0xd2])
  UVM_INFO @ 1551349226 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 9.usbdev_invalid_sync.26074957571994677840343266703708827667310848851449066661533257155550159124793
    Line 4881, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/9.usbdev_invalid_sync/latest/run.log
```
  UVM_FATAL @ 5371886716 ps: (usb20_item.sv:96) [m_data_pkt] Check failed m_pid_type == expected (195 [0xc3] vs 210 [0xd2])
  UVM_INFO @ 5371886716 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 10 more failures.

UVM_ERROR (usbdev_base_vseq.sv:645) [usbdev_iso_retraction_vseq] Check failed sending == * (* [*] vs * [*]) Packet was neither collected nor retracted

has 8 failures:

Test usbdev_iso_retraction has 8 failures.

6.usbdev_iso_retraction.1504987517198800028539175056028139681442447644765194031923157873430439512203
Line 738, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/6.usbdev_iso_retraction/latest/run.log

  UVM_ERROR @ 1862853519 ps: (usbdev_base_vseq.sv:645) [uvm_test_top.env.virtual_sequencer.usbdev_iso_retraction_vseq] Check failed sending == 0 (1 [0x1] vs 0 [0x0]) Packet was neither collected nor retracted
  UVM_INFO @ 1862853519 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

18.usbdev_iso_retraction.98030698925715441871772789031857846922611379217979575375447679640151422186485
Line 714, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/18.usbdev_iso_retraction/latest/run.log

  UVM_ERROR @ 2129680080 ps: (usbdev_base_vseq.sv:645) [uvm_test_top.env.virtual_sequencer.usbdev_iso_retraction_vseq] Check failed sending == 0 (1 [0x1] vs 0 [0x0]) Packet was neither collected nor retracted
  UVM_INFO @ 2129680080 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 6 more failures.