USBDEV Simulation Results

Sunday February 18 2024 20:02:30 UTC

GitHub Revision: 8faf04697a

Branch: os_regression

Testplan

Simulator: VCS

Build randomization enabled with --build-seed 18983509472502570446328716692660256492766541929441074968843370054317032656232

Test Results

Stage Name Tests Max Job Runtime Simulated Time Passing Total Pass Rate
V1 smoke usbdev_smoke 9.840s 8.367ms 48 50 96.00
V1 csr_hw_reset usbdev_csr_hw_reset 0.800s 49.119us 5 5 100.00
V1 csr_rw usbdev_csr_rw 1.060s 65.715us 20 20 100.00
V1 csr_bit_bash usbdev_csr_bit_bash 4.720s 502.559us 1 5 20.00
V1 csr_aliasing usbdev_csr_aliasing 3.230s 121.889us 4 5 80.00
V1 csr_mem_rw_with_rand_reset usbdev_csr_mem_rw_with_rand_reset 6.530s 193.379us 10 20 50.00
V1 regwen_csr_and_corresponding_lockable_csr usbdev_csr_rw 1.060s 65.715us 20 20 100.00
usbdev_csr_aliasing 3.230s 121.889us 4 5 80.00
V1 mem_walk usbdev_mem_walk 4.150s 464.823us 4 5 80.00
V1 mem_partial_access usbdev_mem_partial_access 2.260s 151.141us 5 5 100.00
V1 TOTAL 97 115 84.35
V2 in_trans usbdev_in_trans 0 0 --
V2 data_toggle_clear usbdev_data_toggle_clear 0 0 --
V2 phy_pins_sense usbdev_phy_pins_sense 0 0 --
V2 wake_events usbdev_wake_events 0 0 --
V2 av_buffer usbdev_av_buffer 9.550s 8.373ms 49 50 98.00
V2 rx_fifo usbdev_rx_fifo 0 0 --
V2 phy_config_tx_osc_test_mode usbdev_phy_config_tx_osc_test_mode 0 0 --
V2 phy_config_eop_single_bit_handling usbdev_phy_config_eop_single_bit_handling 0 0 --
V2 phy_config_pinflip usbdev_phy_config_pinflip 0 0 --
V2 phy_config_usb_ref_disable usbdev_phy_config_usb_ref_disable 0 0 --
V2 max_length_out_transaction usbdev_max_length_out_transaction 0.620s 0 50 0.00
V2 max_length_in_transaction usbdev_max_length_in_transaction 0 0 --
V2 min_length_out_transaction usbdev_min_length_out_transaction 0.620s 0 50 0.00
V2 min_length_in_transaction usbdev_min_length_in_transaction 0 0 --
V2 random_length_out_trans usbdev_random_length_out_trans 0.620s 0 50 0.00
V2 random_length_in_trans usbdev_random_length_in_trans 0 0 --
V2 out_stall usbdev_out_stall 0.620s 0 50 0.00
V2 in_stall usbdev_in_stall 0 0 --
V2 out_iso usbdev_out_iso 0 0 --
V2 in_iso usbdev_in_iso 0 0 --
V2 pkt_received usbdev_pkt_received 10.050s 8.375ms 0 50 0.00
V2 pkt_sent usbdev_pkt_sent 9.910s 8.437ms 48 50 96.00
V2 disconnected usbdev_disconnected 0 0 --
V2 host_lost usbdev_host_lost 0 0 --
V2 link_reset usbdev_link_reset 0 0 --
V2 link_suspend usbdev_link_suspend 0 0 --
V2 link_resume usbdev_link_resume 0 0 --
V2 av_empty usbdev_av_empty 0 0 --
V2 rx_full usbdev_rx_full 0 0 --
V2 av_overflow usbdev_av_overflow 0 0 --
V2 enable usbdev_enable 9.390s 8.352ms 0 50 0.00
V2 resume_link_active usbdev_resume_link_active 0 0 --
V2 device_address usbdev_device_address 0 0 --
V2 link_in_err usbdev_link_in_err 0 0 --
V2 rx_crc_err usbdev_rx_crc_err 0 0 --
V2 rx_pid_err usbdev_rx_pid_err 0 0 --
V2 rx_bitstuff_err usbdev_rx_bitstuff_err 0 0 --
V2 link_out_err usbdev_link_out_err 0 0 --
V2 invalid_data1_data0_toggle_test usbdev_invalid_data1_data0_toggle_test 0 0 --
V2 setup_stage usbdev_setup_stage 0 0 --
V2 in_data_stage usbdev_in_data_stage 0 0 --
V2 out_data_stage usbdev_out_data_stage 0 0 --
V2 out_status_stage usbdev_out_status_stage 0 0 --
V2 in_status_stage usbdev_in_status_stage 0 0 --
V2 endpoint_access usbdev_endpoint_access 0 0 --
V2 disable_endpoint usbdev_disable_endpoint 0 0 --
V2 out_trans_nak usbdev_out_trans_nak 0.610s 0 50 0.00
V2 setup_trans_ignored usbdev_setup_trans_ignored 0 0 --
V2 nak_trans usbdev_nak_trans 9.680s 8.448ms 43 50 86.00
V2 stall_trans usbdev_stall_trans 0 0 --
V2 setup_priority_over_stall_response usbdev_setup_priority_over_stall_response 0 0 --
V2 stall_priority_over_NAK usbdev_stall_priority_over_NAK 0 0 --
V2 pending_in_trans usbdev_pending_in_trans 0 0 --
V2 streaming_test usbdev_streaming_test 0 0 --
V2 max_clock_error usbdev_max_clock_error 0 0 --
V2 max_phase_error usbdev_max_phase_error 0 0 --
V2 min_inter_pkt_delay usbdev_min_inter_pkt_delay 0 0 --
V2 max_inter_pkt_delay usbdev_max_inter_pkt_delay 0 0 --
V2 device_timeout_missing_host_handshake usbdev_device_timeout_missing_host_handshake 0 0 --
V2 device_timeout usbdev_device_timeout 0 0 --
V2 nak_to_out_trans_when_avbuffer_empty_rxfifo_full usbdev_nak_to_out_trans_when_avbuffer_empty_rxfifo_full 0 0 --
V2 intr_test usbdev_intr_test 0.650s 11.717us 0 50 0.00
V2 alert_test usbdev_alert_test 0 0 --
V2 tl_d_oob_addr_access usbdev_tl_errors 3.560s 278.285us 20 20 100.00
V2 tl_d_illegal_access usbdev_tl_errors 3.560s 278.285us 20 20 100.00
V2 tl_d_outstanding_access usbdev_csr_hw_reset 0.800s 49.119us 5 5 100.00
usbdev_csr_rw 1.060s 65.715us 20 20 100.00
usbdev_csr_aliasing 3.230s 121.889us 4 5 80.00
usbdev_same_csr_outstanding 1.710s 277.430us 20 20 100.00
V2 tl_d_partial_access usbdev_csr_hw_reset 0.800s 49.119us 5 5 100.00
usbdev_csr_rw 1.060s 65.715us 20 20 100.00
usbdev_csr_aliasing 3.230s 121.889us 4 5 80.00
usbdev_same_csr_outstanding 1.710s 277.430us 20 20 100.00
V2 TOTAL 180 590 30.51
V2S tl_intg_err usbdev_sec_cm 1.160s 276.362us 5 5 100.00
usbdev_tl_intg_err 4.960s 494.648us 14 20 70.00
V2S sec_cm_bus_integrity usbdev_tl_intg_err 4.960s 494.648us 14 20 70.00
V2S TOTAL 19 25 76.00
V3 TOTAL 0 0 --
Unmapped tests setup_trans_ignored 9.790s 8.361ms 49 50 98.00
in_trans 9.910s 8.389ms 47 50 94.00
usbdev_stress_all_with_rand_reset 0.660s 84.172us 0 50 0.00
usbdev_stress_all 0.630s 0 50 0.00
TOTAL 392 930 42.15

Testplan Progress

Items Total Written Passing Progress
N.A. 4 4 0 0.00
V1 8 8 3 37.50
V2 65 13 2 3.08
V2S 2 2 1 50.00

Coverage Results

Coverage Dashboard

SCORE LINE COND TOGGLE FSM BRANCH ASSERT GROUP
81.26 95.98 85.41 96.94 45.31 93.76 97.36 54.05

Failure Buckets

Past Results