USBDEV Simulation Results

Sunday July 14 2024 23:02:31 UTC

GitHub Revision: c04cc5d074

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 63544391231451201456762274895161998707503467555380647510071702152169450996489

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke usbdev_smoke 1.030s 252.104us 49 50 98.00
V1 csr_hw_reset usbdev_csr_hw_reset 1.070s 172.635us 5 5 100.00
V1 csr_rw usbdev_csr_rw 1.160s 97.115us 20 20 100.00
V1 csr_bit_bash usbdev_csr_bit_bash 9.120s 886.364us 5 5 100.00
V1 csr_aliasing usbdev_csr_aliasing 3.630s 372.412us 5 5 100.00
V1 csr_mem_rw_with_rand_reset usbdev_csr_mem_rw_with_rand_reset 2.350s 188.648us 20 20 100.00
V1 regwen_csr_and_corresponding_lockable_csr usbdev_csr_rw 1.160s 97.115us 20 20 100.00
usbdev_csr_aliasing 3.630s 372.412us 5 5 100.00
V1 mem_walk usbdev_mem_walk 4.650s 788.246us 5 5 100.00
V1 mem_partial_access usbdev_mem_partial_access 2.360s 203.048us 5 5 100.00
V1 TOTAL 114 115 99.13
V2 in_trans usbdev_in_trans 1.030s 262.364us 50 50 100.00
V2 data_toggle_clear usbdev_data_toggle_clear 1.670s 580.487us 50 50 100.00
V2 phy_pins_sense usbdev_phy_pins_sense 0.760s 84.064us 50 50 100.00
V2 av_buffer usbdev_av_buffer 1.000s 182.560us 50 50 100.00
V2 rx_fifo usbdev_pkt_buffer 55.760s 22.253ms 50 50 100.00
V2 phy_config_tx_osc_test_mode usbdev_phy_config_tx_osc_test_mode 0.960s 309.250us 1 1 100.00
V2 phy_config_eop_single_bit_handling usbdev_phy_config_eop_single_bit_handling 0.920s 210.782us 1 1 100.00
V2 phy_config_pinflip usbdev_phy_config_pinflip 1.120s 316.027us 50 50 100.00
V2 phy_config_rand_bus_type usbdev_phy_config_rand_bus_type 1.030s 260.699us 5 5 100.00
V2 phy_config_rx_dp_dn usbdev_phy_config_rx_dp_dn 0.900s 226.353us 1 1 100.00
V2 phy_config_tx_use_d_se0 usbdev_phy_config_tx_use_d_se0 0.850s 176.198us 1 1 100.00
V2 phy_config_usb_ref_disable usbdev_phy_config_usb_ref_disable 0.880s 145.228us 50 50 100.00
V2 max_length_out_transaction usbdev_max_length_out_transaction 0.960s 265.134us 50 50 100.00
usbdev_stream_len_max 3.120s 1.313ms 50 50 100.00
V2 max_length_in_transaction usbdev_max_length_in_transaction 1.030s 249.160us 50 50 100.00
V2 min_length_out_transaction usbdev_min_length_out_transaction 0.880s 209.761us 50 50 100.00
V2 min_length_in_transaction usbdev_min_length_in_transaction 0.950s 257.749us 50 50 100.00
V2 random_length_out_transaction usbdev_random_length_out_transaction 0.960s 192.751us 50 50 100.00
V2 random_length_in_transaction usbdev_random_length_in_transaction 1.030s 311.513us 50 50 100.00
V2 out_stall usbdev_out_stall 0.910s 176.663us 50 50 100.00
V2 in_stall usbdev_in_stall 0.860s 193.900us 50 50 100.00
V2 out_iso usbdev_out_iso 0.930s 198.299us 50 50 100.00
V2 in_iso usbdev_in_iso 0.960s 267.707us 50 50 100.00
V2 pkt_received usbdev_pkt_received 0.960s 200.876us 50 50 100.00
V2 pkt_sent usbdev_pkt_sent 1.000s 240.547us 50 50 100.00
V2 disconnected usbdev_disconnected 0.860s 187.139us 50 50 100.00
V2 host_lost usbdev_host_lost 9.400s 4.168ms 1 1 100.00
V2 link_reset usbdev_link_reset 0.850s 197.131us 1 1 100.00
V2 link_suspend usbdev_link_suspend 4.810s 3.303ms 50 50 100.00
V2 link_resume usbdev_link_resume 28.420s 23.307ms 50 50 100.00
V2 av_empty usbdev_av_empty 0.840s 149.204us 5 5 100.00
V2 rx_full usbdev_rx_full 0.980s 248.507us 1 1 100.00
V2 av_overflow usbdev_av_overflow 0.820s 169.282us 5 5 100.00
V2 link_in_err usbdev_link_in_err 0.990s 314.574us 50 50 100.00
V2 rx_crc_err usbdev_rx_crc_err 0.910s 207.558us 50 50 100.00
V2 rx_pid_err usbdev_rx_pid_err 0.870s 174.285us 5 5 100.00
V2 rx_bitstuff_err usbdev_bitstuff_err 0.900s 252.689us 50 50 100.00
V2 link_out_err usbdev_link_out_err 1.470s 476.650us 1 1 100.00
V2 enable usbdev_enable 0.750s 67.780us 50 50 100.00
V2 resume_link_active usbdev_resume_link_active 18.780s 20.171ms 1 1 100.00
V2 device_address usbdev_device_address 42.800s 21.847ms 50 50 100.00
V2 invalid_data1_data0_toggle_test usbdev_invalid_data1_data0_toggle_test 1.280s 463.526us 1 1 100.00
V2 setup_stage usbdev_setup_stage 0.870s 169.611us 50 50 100.00
V2 endpoint_access usbdev_endpoint_access 2.540s 1.064ms 50 50 100.00
V2 disable_endpoint usbdev_disable_endpoint 1.540s 466.304us 50 50 100.00
V2 out_trans_nak usbdev_out_trans_nak 0.910s 234.260us 50 50 100.00
V2 setup_trans_ignored usbdev_setup_trans_ignored 0.890s 213.252us 50 50 100.00
V2 nak_trans usbdev_nak_trans 0.970s 246.773us 50 50 100.00
V2 stall_trans usbdev_stall_trans 0.950s 196.920us 50 50 100.00
V2 setup_priority_over_stall_response usbdev_setup_priority_over_stall_response 0.980s 217.146us 5 5 100.00
V2 stall_priority_over_nak usbdev_stall_priority_over_nak 0.940s 176.273us 50 50 100.00
V2 pending_in_trans usbdev_pending_in_trans 0.930s 221.485us 50 50 100.00
V2 streaming_test usbdev_streaming_out 3.710m 7.847ms 50 50 100.00
V2 max_clock_error_untracked usbdev_freq_hiclk 2.390m 110.198ms 5 5 100.00
usbdev_freq_loclk 2.558m 115.155ms 5 5 100.00
V2 max_clock_error_tracking usbdev_freq_hiclk_max 2.950m 110.300ms 5 5 100.00
usbdev_freq_loclk_max 2.694m 112.985ms 5 5 100.00
V2 max_phase_error usbdev_freq_phase 2.749m 116.135ms 5 5 100.00
V2 min_inter_pkt_delay usbdev_min_inter_pkt_delay 3.211m 7.040ms 49 50 98.00
V2 max_inter_pkt_delay usbdev_max_inter_pkt_delay 3.500m 7.853ms 50 50 100.00
V2 device_timeout_missing_host_handshake usbdev_timeout_missing_host_handshake 5.060s 864.424us 1 50 2.00
V2 device_timeout usbdev_device_timeout 4.960s 817.064us 0 50 0.00
V2 packet_buffer usbdev_pkt_buffer 55.760s 22.253ms 50 50 100.00
V2 nak_to_out_trans_when_avbuffer_empty_rxfifo_full usbdev_nak_to_out_trans_when_avbuffer_empty_rxfifo_full 1.400s 403.228us 1 1 100.00
V2 aon_wake_resume usbdev_aon_wake_resume 30.020s 23.445ms 50 50 100.00
V2 aon_wake_reset usbdev_aon_wake_reset 16.890s 13.541ms 49 50 98.00
V2 aon_wake_disconnect usbdev_aon_wake_disconnect 5.980s 4.354ms 50 50 100.00
V2 invalid_sync usbdev_invalid_sync 4.729m 10.394ms 27 50 54.00
V2 spurious_pids_ignored usbdev_spurious_pids_ignored 3.118m 6.594ms 50 50 100.00
V2 low_speed_traffic usbdev_low_speed_traffic 5.684m 12.738ms 50 50 100.00
V2 rand_bus_resets usbdev_rand_bus_resets 5.479m 11.881ms 10 10 100.00
V2 rand_disconnects usbdev_rand_bus_disconnects 5.716m 13.591ms 10 10 100.00
V2 rand_suspends usbdev_rand_suspends 7.465m 19.473ms 10 10 100.00
V2 max_usb_traffic usbdev_max_usb_traffic 3.524m 7.492ms 50 50 100.00
V2 stress_usb_traffic usbdev_stress_usb_traffic 8.834m 23.630ms 5 5 100.00
V2 in_packet_retraction usbdev_iso_retraction 1.769m 12.824ms 44 50 88.00
V2 data_toggle_restore usbdev_data_toggle_restore 3.100s 1.448ms 50 50 100.00
V2 setup_priority usbdev_setup_priority 1.430s 482.795us 5 5 100.00
V2 fifo_resets usbdev_fifo_rst 2.640s 432.529us 50 50 100.00
V2 intr_test usbdev_intr_test 0.790s 116.986us 50 50 100.00
V2 alert_test usbdev_alert_test 0.770s 113.661us 50 50 100.00
V2 tl_d_oob_addr_access usbdev_tl_errors 3.250s 380.148us 20 20 100.00
V2 tl_d_illegal_access usbdev_tl_errors 3.250s 380.148us 20 20 100.00
V2 tl_d_outstanding_access usbdev_csr_hw_reset 1.070s 172.635us 5 5 100.00
usbdev_csr_rw 1.160s 97.115us 20 20 100.00
usbdev_csr_aliasing 3.630s 372.412us 5 5 100.00
usbdev_same_csr_outstanding 1.830s 523.578us 20 20 100.00
V2 tl_d_partial_access usbdev_csr_hw_reset 1.070s 172.635us 5 5 100.00
usbdev_csr_rw 1.160s 97.115us 20 20 100.00
usbdev_csr_aliasing 3.630s 372.412us 5 5 100.00
usbdev_same_csr_outstanding 1.830s 523.578us 20 20 100.00
V2 TOTAL 2711 2841 95.42
V2S tl_intg_err usbdev_sec_cm 1.530s 607.960us 5 5 100.00
usbdev_tl_intg_err 6.160s 2.178ms 20 20 100.00
V2S sec_cm_bus_integrity usbdev_tl_intg_err 6.160s 2.178ms 20 20 100.00
V2S TOTAL 25 25 100.00
V3 dpi_config_host usbdev_dpi_config_host 33.370s 5.188ms 1 1 100.00
V3 TOTAL 1 1 100.00
Unmapped tests usbdev_stress_all_with_rand_reset 0.670s 58.182us 0 10 0.00
usbdev_stress_all 0.650s 0 50 0.00
TOTAL 2851 3042 93.72

Testplan Progress

Items Total Written Passing Progress
N.A. 2 2 0 0.00
V1 8 8 7 87.50
V2 82 82 76 92.68
V2S 2 2 2 100.00
V3 1 1 1 100.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
93.35 97.82 93.81 97.44 73.44 96.21 98.17 96.58

Failure Buckets

Past Results