USBDEV Simulation Results

Thursday July 11 2024 23:02:31 UTC

GitHub Revision: edf2fd5092

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 110991919330983905489672005724934609038320729526710604109871030362225161447318

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke usbdev_smoke 1.080s 306.487us 50 50 100.00
V1 csr_hw_reset usbdev_csr_hw_reset 0.950s 105.971us 5 5 100.00
V1 csr_rw usbdev_csr_rw 1.150s 152.309us 20 20 100.00
V1 csr_bit_bash usbdev_csr_bit_bash 9.320s 1.818ms 5 5 100.00
V1 csr_aliasing usbdev_csr_aliasing 3.650s 362.645us 5 5 100.00
V1 csr_mem_rw_with_rand_reset usbdev_csr_mem_rw_with_rand_reset 2.450s 103.869us 20 20 100.00
V1 regwen_csr_and_corresponding_lockable_csr usbdev_csr_rw 1.150s 152.309us 20 20 100.00
usbdev_csr_aliasing 3.650s 362.645us 5 5 100.00
V1 mem_walk usbdev_mem_walk 4.190s 488.398us 5 5 100.00
V1 mem_partial_access usbdev_mem_partial_access 2.290s 164.542us 5 5 100.00
V1 TOTAL 115 115 100.00
V2 in_trans usbdev_in_trans 1.010s 301.031us 50 50 100.00
V2 data_toggle_clear usbdev_data_toggle_clear 1.610s 538.400us 50 50 100.00
V2 phy_pins_sense usbdev_phy_pins_sense 0.730s 58.824us 50 50 100.00
V2 av_buffer usbdev_av_buffer 0.930s 200.085us 50 50 100.00
V2 rx_fifo usbdev_pkt_buffer 57.370s 24.099ms 50 50 100.00
V2 phy_config_tx_osc_test_mode usbdev_phy_config_tx_osc_test_mode 1.030s 310.780us 1 1 100.00
V2 phy_config_eop_single_bit_handling usbdev_phy_config_eop_single_bit_handling 0.900s 203.067us 1 1 100.00
V2 phy_config_pinflip usbdev_phy_config_pinflip 1.110s 285.110us 50 50 100.00
V2 phy_config_rand_bus_type usbdev_phy_config_rand_bus_type 0.970s 250.928us 5 5 100.00
V2 phy_config_rx_dp_dn usbdev_phy_config_rx_dp_dn 0.900s 207.205us 1 1 100.00
V2 phy_config_tx_use_d_se0 usbdev_phy_config_tx_use_d_se0 0.910s 257.522us 1 1 100.00
V2 phy_config_usb_ref_disable usbdev_phy_config_usb_ref_disable 0.880s 201.923us 50 50 100.00
V2 max_length_out_transaction usbdev_max_length_out_transaction 0.980s 227.434us 50 50 100.00
usbdev_stream_len_max 2.790s 1.392ms 50 50 100.00
V2 max_length_in_transaction usbdev_max_length_in_transaction 1.050s 239.606us 50 50 100.00
V2 min_length_out_transaction usbdev_min_length_out_transaction 0.860s 139.103us 50 50 100.00
V2 min_length_in_transaction usbdev_min_length_in_transaction 0.870s 154.521us 50 50 100.00
V2 random_length_out_transaction usbdev_random_length_out_transaction 0.920s 201.290us 50 50 100.00
V2 random_length_in_transaction usbdev_random_length_in_transaction 0.990s 241.149us 50 50 100.00
V2 out_stall usbdev_out_stall 0.920s 249.138us 50 50 100.00
V2 in_stall usbdev_in_stall 0.840s 158.783us 50 50 100.00
V2 out_iso usbdev_out_iso 0.920s 212.331us 50 50 100.00
V2 in_iso usbdev_in_iso 1.030s 267.318us 50 50 100.00
V2 pkt_received usbdev_pkt_received 0.950s 223.133us 50 50 100.00
V2 pkt_sent usbdev_pkt_sent 1.000s 254.654us 50 50 100.00
V2 disconnected usbdev_disconnected 0.860s 197.651us 50 50 100.00
V2 host_lost usbdev_host_lost 8.160s 4.183ms 1 1 100.00
V2 link_reset usbdev_link_reset 0.750s 159.969us 1 1 100.00
V2 link_suspend usbdev_link_suspend 4.900s 3.339ms 50 50 100.00
V2 link_resume usbdev_link_resume 30.720s 23.287ms 50 50 100.00
V2 av_empty usbdev_av_empty 0.850s 172.342us 5 5 100.00
V2 rx_full usbdev_rx_full 0.930s 251.634us 1 1 100.00
V2 av_overflow usbdev_av_overflow 0.830s 176.481us 5 5 100.00
V2 link_in_err usbdev_link_in_err 0.990s 281.852us 50 50 100.00
V2 rx_crc_err usbdev_rx_crc_err 1.020s 191.088us 50 50 100.00
V2 rx_pid_err usbdev_rx_pid_err 0.920s 229.618us 5 5 100.00
V2 rx_bitstuff_err usbdev_bitstuff_err 0.880s 158.885us 50 50 100.00
V2 link_out_err usbdev_link_out_err 1.410s 485.788us 1 1 100.00
V2 enable usbdev_enable 0.730s 107.677us 50 50 100.00
V2 resume_link_active usbdev_resume_link_active 22.080s 20.165ms 1 1 100.00
V2 device_address usbdev_device_address 48.090s 22.195ms 50 50 100.00
V2 invalid_data1_data0_toggle_test usbdev_invalid_data1_data0_toggle_test 1.380s 417.613us 1 1 100.00
V2 setup_stage usbdev_setup_stage 0.970s 172.124us 50 50 100.00
V2 endpoint_access usbdev_endpoint_access 2.610s 1.089ms 50 50 100.00
V2 disable_endpoint usbdev_disable_endpoint 1.560s 478.040us 50 50 100.00
V2 out_trans_nak usbdev_out_trans_nak 0.940s 255.149us 50 50 100.00
V2 setup_trans_ignored usbdev_setup_trans_ignored 0.890s 173.458us 50 50 100.00
V2 nak_trans usbdev_nak_trans 1.010s 275.036us 50 50 100.00
V2 stall_trans usbdev_stall_trans 0.930s 212.676us 50 50 100.00
V2 setup_priority_over_stall_response usbdev_setup_priority_over_stall_response 1.000s 297.013us 5 5 100.00
V2 stall_priority_over_nak usbdev_stall_priority_over_nak 0.890s 220.022us 50 50 100.00
V2 pending_in_trans usbdev_pending_in_trans 0.870s 213.594us 50 50 100.00
V2 streaming_test usbdev_streaming_out 3.483m 7.358ms 50 50 100.00
V2 max_clock_error_untracked usbdev_freq_hiclk 3.012m 110.181ms 5 5 100.00
usbdev_freq_loclk 2.632m 115.111ms 5 5 100.00
V2 max_clock_error_tracking usbdev_freq_hiclk_max 3.069m 117.290ms 5 5 100.00
usbdev_freq_loclk_max 2.455m 113.294ms 5 5 100.00
V2 max_phase_error usbdev_freq_phase 2.727m 115.168ms 5 5 100.00
V2 min_inter_pkt_delay usbdev_min_inter_pkt_delay 3.111m 6.728ms 50 50 100.00
V2 max_inter_pkt_delay usbdev_max_inter_pkt_delay 3.702m 7.616ms 50 50 100.00
V2 device_timeout_missing_host_handshake usbdev_timeout_missing_host_handshake 4.610s 590.806us 0 50 0.00
V2 device_timeout usbdev_device_timeout 5.190s 814.819us 1 50 2.00
V2 packet_buffer usbdev_pkt_buffer 57.370s 24.099ms 50 50 100.00
V2 nak_to_out_trans_when_avbuffer_empty_rxfifo_full usbdev_nak_to_out_trans_when_avbuffer_empty_rxfifo_full 1.390s 551.687us 1 1 100.00
V2 aon_wake_resume usbdev_aon_wake_resume 30.560s 23.329ms 50 50 100.00
V2 aon_wake_reset usbdev_aon_wake_reset 16.650s 13.341ms 50 50 100.00
V2 aon_wake_disconnect usbdev_aon_wake_disconnect 5.760s 4.154ms 50 50 100.00
V2 invalid_sync usbdev_invalid_sync 4.305m 9.384ms 31 50 62.00
V2 spurious_pids_ignored usbdev_spurious_pids_ignored 2.863m 6.211ms 50 50 100.00
V2 low_speed_traffic usbdev_low_speed_traffic 5.870m 12.656ms 50 50 100.00
V2 rand_bus_resets usbdev_rand_bus_resets 3.834m 8.747ms 10 10 100.00
V2 rand_disconnects usbdev_rand_bus_disconnects 6.606m 15.385ms 10 10 100.00
V2 rand_suspends usbdev_rand_suspends 8.610m 22.794ms 10 10 100.00
V2 max_usb_traffic usbdev_max_usb_traffic 3.059m 6.464ms 50 50 100.00
V2 stress_usb_traffic usbdev_stress_usb_traffic 2.849m 19.019ms 4 5 80.00
V2 in_packet_retraction usbdev_iso_retraction 1.807m 12.028ms 39 50 78.00
V2 data_toggle_restore usbdev_data_toggle_restore 3.400s 1.459ms 50 50 100.00
V2 setup_priority usbdev_setup_priority 1.360s 416.909us 5 5 100.00
V2 fifo_resets usbdev_fifo_rst 2.440s 423.395us 50 50 100.00
V2 intr_test usbdev_intr_test 0.790s 98.735us 50 50 100.00
V2 alert_test usbdev_alert_test 0.760s 50.180us 50 50 100.00
V2 tl_d_oob_addr_access usbdev_tl_errors 2.870s 118.249us 20 20 100.00
V2 tl_d_illegal_access usbdev_tl_errors 2.870s 118.249us 20 20 100.00
V2 tl_d_outstanding_access usbdev_csr_hw_reset 0.950s 105.971us 5 5 100.00
usbdev_csr_rw 1.150s 152.309us 20 20 100.00
usbdev_csr_aliasing 3.650s 362.645us 5 5 100.00
usbdev_same_csr_outstanding 1.840s 343.812us 20 20 100.00
V2 tl_d_partial_access usbdev_csr_hw_reset 0.950s 105.971us 5 5 100.00
usbdev_csr_rw 1.150s 152.309us 20 20 100.00
usbdev_csr_aliasing 3.650s 362.645us 5 5 100.00
usbdev_same_csr_outstanding 1.840s 343.812us 20 20 100.00
V2 TOTAL 2711 2841 95.42
V2S tl_intg_err usbdev_sec_cm 1.800s 1.160ms 5 5 100.00
usbdev_tl_intg_err 6.400s 2.459ms 20 20 100.00
V2S sec_cm_bus_integrity usbdev_tl_intg_err 6.400s 2.459ms 20 20 100.00
V2S TOTAL 25 25 100.00
V3 dpi_config_host usbdev_dpi_config_host 41.580s 5.110ms 1 1 100.00
V3 TOTAL 1 1 100.00
Unmapped tests usbdev_stress_all_with_rand_reset 0.730s 68.129us 0 10 0.00
usbdev_stress_all 0.650s 0 50 0.00
TOTAL 2852 3042 93.75

Testplan Progress

Items Total Written Passing Progress
N.A. 2 2 0 0.00
V1 8 8 8 100.00
V2 82 82 77 93.90
V2S 2 2 2 100.00
V3 1 1 1 100.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
93.35 97.82 93.81 97.44 73.44 96.21 98.17 96.58

Failure Buckets

Past Results