USBDEV Simulation Results

Friday July 12 2024 23:02:19 UTC

GitHub Revision: 5967df933a

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 46476530947956470787268850137993439884379231200278174763551439909664842175844

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke usbdev_smoke 1.110s 256.776us 50 50 100.00
V1 csr_hw_reset usbdev_csr_hw_reset 1.090s 177.622us 5 5 100.00
V1 csr_rw usbdev_csr_rw 1.070s 86.185us 20 20 100.00
V1 csr_bit_bash usbdev_csr_bit_bash 11.400s 1.770ms 5 5 100.00
V1 csr_aliasing usbdev_csr_aliasing 3.440s 330.014us 5 5 100.00
V1 csr_mem_rw_with_rand_reset usbdev_csr_mem_rw_with_rand_reset 2.550s 92.809us 20 20 100.00
V1 regwen_csr_and_corresponding_lockable_csr usbdev_csr_rw 1.070s 86.185us 20 20 100.00
usbdev_csr_aliasing 3.440s 330.014us 5 5 100.00
V1 mem_walk usbdev_mem_walk 4.610s 538.638us 5 5 100.00
V1 mem_partial_access usbdev_mem_partial_access 2.470s 206.596us 5 5 100.00
V1 TOTAL 115 115 100.00
V2 in_trans usbdev_in_trans 1.010s 250.430us 50 50 100.00
V2 data_toggle_clear usbdev_data_toggle_clear 1.850s 598.172us 50 50 100.00
V2 phy_pins_sense usbdev_phy_pins_sense 0.730s 65.263us 50 50 100.00
V2 av_buffer usbdev_av_buffer 0.940s 206.241us 50 50 100.00
V2 rx_fifo usbdev_pkt_buffer 59.830s 22.418ms 50 50 100.00
V2 phy_config_tx_osc_test_mode usbdev_phy_config_tx_osc_test_mode 1.040s 301.467us 1 1 100.00
V2 phy_config_eop_single_bit_handling usbdev_phy_config_eop_single_bit_handling 0.820s 151.712us 1 1 100.00
V2 phy_config_pinflip usbdev_phy_config_pinflip 1.030s 243.556us 50 50 100.00
V2 phy_config_rand_bus_type usbdev_phy_config_rand_bus_type 1.090s 252.883us 5 5 100.00
V2 phy_config_rx_dp_dn usbdev_phy_config_rx_dp_dn 1.040s 279.448us 1 1 100.00
V2 phy_config_tx_use_d_se0 usbdev_phy_config_tx_use_d_se0 0.960s 234.553us 1 1 100.00
V2 phy_config_usb_ref_disable usbdev_phy_config_usb_ref_disable 0.890s 189.063us 50 50 100.00
V2 max_length_out_transaction usbdev_max_length_out_transaction 1.010s 217.034us 50 50 100.00
usbdev_stream_len_max 3.090s 1.198ms 50 50 100.00
V2 max_length_in_transaction usbdev_max_length_in_transaction 1.080s 317.642us 50 50 100.00
V2 min_length_out_transaction usbdev_min_length_out_transaction 0.880s 206.713us 50 50 100.00
V2 min_length_in_transaction usbdev_min_length_in_transaction 0.970s 205.195us 50 50 100.00
V2 random_length_out_transaction usbdev_random_length_out_transaction 1.010s 227.687us 50 50 100.00
V2 random_length_in_transaction usbdev_random_length_in_transaction 1.010s 285.881us 50 50 100.00
V2 out_stall usbdev_out_stall 0.960s 251.713us 50 50 100.00
V2 in_stall usbdev_in_stall 0.850s 184.621us 50 50 100.00
V2 out_iso usbdev_out_iso 1.020s 244.339us 50 50 100.00
V2 in_iso usbdev_in_iso 0.980s 225.643us 50 50 100.00
V2 pkt_received usbdev_pkt_received 0.980s 201.921us 50 50 100.00
V2 pkt_sent usbdev_pkt_sent 1.030s 262.288us 50 50 100.00
V2 disconnected usbdev_disconnected 0.970s 167.324us 50 50 100.00
V2 host_lost usbdev_host_lost 10.350s 4.169ms 1 1 100.00
V2 link_reset usbdev_link_reset 0.830s 184.781us 1 1 100.00
V2 link_suspend usbdev_link_suspend 4.560s 3.295ms 50 50 100.00
V2 link_resume usbdev_link_resume 30.300s 23.322ms 50 50 100.00
V2 av_empty usbdev_av_empty 0.890s 235.439us 5 5 100.00
V2 rx_full usbdev_rx_full 0.970s 252.936us 1 1 100.00
V2 av_overflow usbdev_av_overflow 0.830s 206.858us 5 5 100.00
V2 link_in_err usbdev_link_in_err 1.000s 291.424us 50 50 100.00
V2 rx_crc_err usbdev_rx_crc_err 0.870s 166.817us 50 50 100.00
V2 rx_pid_err usbdev_rx_pid_err 0.920s 213.985us 5 5 100.00
V2 rx_bitstuff_err usbdev_bitstuff_err 0.890s 236.530us 50 50 100.00
V2 link_out_err usbdev_link_out_err 1.340s 499.006us 1 1 100.00
V2 enable usbdev_enable 0.740s 39.795us 50 50 100.00
V2 resume_link_active usbdev_resume_link_active 23.750s 20.175ms 1 1 100.00
V2 device_address usbdev_device_address 41.570s 21.635ms 50 50 100.00
V2 invalid_data1_data0_toggle_test usbdev_invalid_data1_data0_toggle_test 1.420s 590.176us 1 1 100.00
V2 setup_stage usbdev_setup_stage 0.880s 155.114us 50 50 100.00
V2 endpoint_access usbdev_endpoint_access 2.590s 954.525us 50 50 100.00
V2 disable_endpoint usbdev_disable_endpoint 1.510s 452.717us 50 50 100.00
V2 out_trans_nak usbdev_out_trans_nak 0.920s 182.428us 50 50 100.00
V2 setup_trans_ignored usbdev_setup_trans_ignored 0.880s 176.692us 50 50 100.00
V2 nak_trans usbdev_nak_trans 1.000s 218.061us 50 50 100.00
V2 stall_trans usbdev_stall_trans 0.940s 198.659us 50 50 100.00
V2 setup_priority_over_stall_response usbdev_setup_priority_over_stall_response 1.050s 310.913us 5 5 100.00
V2 stall_priority_over_nak usbdev_stall_priority_over_nak 0.940s 216.699us 50 50 100.00
V2 pending_in_trans usbdev_pending_in_trans 0.880s 196.949us 50 50 100.00
V2 streaming_test usbdev_streaming_out 3.622m 7.688ms 50 50 100.00
V2 max_clock_error_untracked usbdev_freq_hiclk 2.827m 120.190ms 5 5 100.00
usbdev_freq_loclk 2.936m 121.116ms 5 5 100.00
V2 max_clock_error_tracking usbdev_freq_hiclk_max 2.813m 115.429ms 5 5 100.00
usbdev_freq_loclk_max 3.239m 120.235ms 5 5 100.00
V2 max_phase_error usbdev_freq_phase 2.732m 114.229ms 5 5 100.00
V2 min_inter_pkt_delay usbdev_min_inter_pkt_delay 3.374m 7.343ms 50 50 100.00
V2 max_inter_pkt_delay usbdev_max_inter_pkt_delay 3.605m 7.692ms 50 50 100.00
V2 device_timeout_missing_host_handshake usbdev_timeout_missing_host_handshake 5.020s 575.195us 2 50 4.00
V2 device_timeout usbdev_device_timeout 4.990s 810.447us 0 50 0.00
V2 packet_buffer usbdev_pkt_buffer 59.830s 22.418ms 50 50 100.00
V2 nak_to_out_trans_when_avbuffer_empty_rxfifo_full usbdev_nak_to_out_trans_when_avbuffer_empty_rxfifo_full 1.450s 480.386us 1 1 100.00
V2 aon_wake_resume usbdev_aon_wake_resume 30.240s 23.350ms 50 50 100.00
V2 aon_wake_reset usbdev_aon_wake_reset 15.780s 13.346ms 50 50 100.00
V2 aon_wake_disconnect usbdev_aon_wake_disconnect 6.410s 4.258ms 50 50 100.00
V2 invalid_sync usbdev_invalid_sync 5.016m 10.850ms 31 50 62.00
V2 spurious_pids_ignored usbdev_spurious_pids_ignored 3.093m 6.985ms 50 50 100.00
V2 low_speed_traffic usbdev_low_speed_traffic 5.982m 13.321ms 50 50 100.00
V2 rand_bus_resets usbdev_rand_bus_resets 4.689m 13.690ms 10 10 100.00
V2 rand_disconnects usbdev_rand_bus_disconnects 3.643m 11.087ms 10 10 100.00
V2 rand_suspends usbdev_rand_suspends 6.106m 16.508ms 10 10 100.00
V2 max_usb_traffic usbdev_max_usb_traffic 3.380m 7.246ms 50 50 100.00
V2 stress_usb_traffic usbdev_stress_usb_traffic 5.005m 11.545ms 4 5 80.00
V2 in_packet_retraction usbdev_iso_retraction 1.939m 13.574ms 39 50 78.00
V2 data_toggle_restore usbdev_data_toggle_restore 3.080s 1.327ms 50 50 100.00
V2 setup_priority usbdev_setup_priority 1.390s 461.004us 5 5 100.00
V2 fifo_resets usbdev_fifo_rst 2.490s 377.243us 50 50 100.00
V2 intr_test usbdev_intr_test 0.750s 46.178us 50 50 100.00
V2 alert_test usbdev_alert_test 0.790s 84.434us 50 50 100.00
V2 tl_d_oob_addr_access usbdev_tl_errors 3.410s 269.887us 20 20 100.00
V2 tl_d_illegal_access usbdev_tl_errors 3.410s 269.887us 20 20 100.00
V2 tl_d_outstanding_access usbdev_csr_hw_reset 1.090s 177.622us 5 5 100.00
usbdev_csr_rw 1.070s 86.185us 20 20 100.00
usbdev_csr_aliasing 3.440s 330.014us 5 5 100.00
usbdev_same_csr_outstanding 1.970s 255.343us 20 20 100.00
V2 tl_d_partial_access usbdev_csr_hw_reset 1.090s 177.622us 5 5 100.00
usbdev_csr_rw 1.070s 86.185us 20 20 100.00
usbdev_csr_aliasing 3.440s 330.014us 5 5 100.00
usbdev_same_csr_outstanding 1.970s 255.343us 20 20 100.00
V2 TOTAL 2712 2841 95.46
V2S tl_intg_err usbdev_sec_cm 2.610s 1.701ms 5 5 100.00
usbdev_tl_intg_err 6.130s 1.309ms 20 20 100.00
V2S sec_cm_bus_integrity usbdev_tl_intg_err 6.130s 1.309ms 20 20 100.00
V2S TOTAL 25 25 100.00
V3 dpi_config_host usbdev_dpi_config_host 2.246m 5.128ms 1 1 100.00
V3 TOTAL 1 1 100.00
Unmapped tests usbdev_stress_all_with_rand_reset 0.670s 64.031us 0 10 0.00
usbdev_stress_all 0.660s 0 50 0.00
TOTAL 2853 3042 93.79

Testplan Progress

Items Total Written Passing Progress
N.A. 2 2 0 0.00
V1 8 8 8 100.00
V2 82 82 77 93.90
V2S 2 2 2 100.00
V3 1 1 1 100.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
93.59 97.84 93.81 97.44 75.00 96.26 98.17 96.58

Failure Buckets

Past Results