4fd94db59a| Stage | Name | Tests | Max Job Runtime | Simulated Time | Passing | Total | Pass Rate |
|---|---|---|---|---|---|---|---|
| V1 | smoke | usbdev_smoke | 10.610s | 8.466ms | 50 | 50 | 100.00 |
| V1 | csr_hw_reset | usbdev_csr_hw_reset | 0.860s | 63.409us | 5 | 5 | 100.00 |
| V1 | csr_rw | usbdev_csr_rw | 1.030s | 66.931us | 20 | 20 | 100.00 |
| V1 | csr_bit_bash | usbdev_csr_bit_bash | 8.650s | 1.453ms | 5 | 5 | 100.00 |
| V1 | csr_aliasing | usbdev_csr_aliasing | 3.310s | 136.670us | 5 | 5 | 100.00 |
| V1 | csr_mem_rw_with_rand_reset | usbdev_csr_mem_rw_with_rand_reset | 2.620s | 122.442us | 20 | 20 | 100.00 |
| V1 | regwen_csr_and_corresponding_lockable_csr | usbdev_csr_rw | 1.030s | 66.931us | 20 | 20 | 100.00 |
| usbdev_csr_aliasing | 3.310s | 136.670us | 5 | 5 | 100.00 | ||
| V1 | mem_walk | usbdev_mem_walk | 4.990s | 704.978us | 5 | 5 | 100.00 |
| V1 | mem_partial_access | usbdev_mem_partial_access | 2.340s | 187.374us | 5 | 5 | 100.00 |
| V1 | TOTAL | 115 | 115 | 100.00 | |||
| V2 | in_trans | usbdev_in_trans | 10.620s | 8.409ms | 50 | 50 | 100.00 |
| V2 | data_toggle_clear | data_toggle_clear | 0 | 0 | -- | ||
| V2 | phy_pins_sense | usbdev_phy_pins_sense | 0.870s | 243.287us | 50 | 50 | 100.00 |
| V2 | av_buffer | usbdev_av_buffer | 10.620s | 8.441ms | 50 | 50 | 100.00 |
| V2 | rx_fifo | rx_fifo | 0 | 0 | -- | ||
| V2 | phy_config_tx_osc_test_mode | phy_config_tx_osc_test_mode | 0 | 0 | -- | ||
| V2 | phy_config_eop_single_bit_handling | phy_config_eop_single_bit_handling | 0 | 0 | -- | ||
| V2 | phy_config_pinflip | phy_config_pinflip | 0 | 0 | -- | ||
| V2 | phy_config_usb_ref_disable | usbdev_phy_config_usb_ref_disable | 10.690s | 8.370ms | 50 | 50 | 100.00 |
| V2 | max_length_out_transaction | usbdev_max_length_out_transaction | 10.820s | 8.456ms | 50 | 50 | 100.00 |
| V2 | max_length_in_transaction | max_length_in_transaction | 0 | 0 | -- | ||
| V2 | min_length_out_transaction | usbdev_min_length_out_transaction | 10.530s | 8.374ms | 50 | 50 | 100.00 |
| V2 | min_length_in_transaction | min_length_in_transaction | 0 | 0 | -- | ||
| V2 | random_length_out_trans | usbdev_random_length_out_trans | 10.220s | 8.375ms | 50 | 50 | 100.00 |
| V2 | random_length_in_trans | random_length_in_trans | 0 | 0 | -- | ||
| V2 | out_stall | usbdev_out_stall | 10.200s | 8.432ms | 50 | 50 | 100.00 |
| V2 | in_stall | usbdev_in_stall | 9.740s | 8.368ms | 50 | 50 | 100.00 |
| V2 | out_iso | out_iso | 0 | 0 | -- | ||
| V2 | in_iso | usbdev_in_iso | 10.210s | 8.423ms | 50 | 50 | 100.00 |
| V2 | pkt_received | usbdev_pkt_received | 10.400s | 8.412ms | 50 | 50 | 100.00 |
| V2 | pkt_sent | usbdev_pkt_sent | 10.440s | 8.385ms | 50 | 50 | 100.00 |
| V2 | disconnected | disconnected | 0 | 0 | -- | ||
| V2 | host_lost | host_lost | 0 | 0 | -- | ||
| V2 | link_reset | link_reset | 0 | 0 | -- | ||
| V2 | link_suspend | link_suspend | 0 | 0 | -- | ||
| V2 | link_resume | link_resume | 0 | 0 | -- | ||
| V2 | av_empty | av_empty | 0 | 0 | -- | ||
| V2 | rx_full | rx_full | 0 | 0 | -- | ||
| V2 | av_overflow | av_overflow | 0 | 0 | -- | ||
| V2 | link_in_err | link_in_err | 0 | 0 | -- | ||
| V2 | rx_crc_err | rx_crc_err | 0 | 0 | -- | ||
| V2 | rx_pid_err | rx_pid_err | 0 | 0 | -- | ||
| V2 | rx_bitstuff_err | rx_bitstuff_err | 0 | 0 | -- | ||
| V2 | link_out_err | link_out_err | 0 | 0 | -- | ||
| V2 | enable | usbdev_enable | 10.330s | 8.394ms | 50 | 50 | 100.00 |
| V2 | resume_link_active | resume_link_active | 0 | 0 | -- | ||
| V2 | device_address | device_address | 0 | 0 | -- | ||
| V2 | invalid_data1_data0_toggle_test | invalid_data1_data0_toggle_test | 0 | 0 | -- | ||
| V2 | setup_stage | usbdev_setup_stage | 10.170s | 8.372ms | 50 | 50 | 100.00 |
| V2 | in_data_stage | in_data_stage | 0 | 0 | -- | ||
| V2 | out_data_stage | out_data_stage | 0 | 0 | -- | ||
| V2 | endpoint_access | endpoint_access | 0 | 0 | -- | ||
| V2 | disable_endpoint | disable_endpoint | 0 | 0 | -- | ||
| V2 | out_trans_nak | usbdev_out_trans_nak | 10.120s | 8.427ms | 50 | 50 | 100.00 |
| V2 | setup_trans_ignored | usbdev_setup_trans_ignored | 10.110s | 8.367ms | 50 | 50 | 100.00 |
| V2 | nak_trans | usbdev_nak_trans | 10.300s | 8.455ms | 50 | 50 | 100.00 |
| V2 | stall_trans | usbdev_stall_trans | 10.080s | 8.371ms | 50 | 50 | 100.00 |
| V2 | setup_priority_over_stall_response | setup_priority_over_stall_response | 0 | 0 | -- | ||
| V2 | stall_priority_over_nak | usbdev_stall_priority_over_nak | 9.860s | 8.425ms | 50 | 50 | 100.00 |
| V2 | pending_in_trans | usbdev_pending_in_trans | 10.550s | 8.402ms | 50 | 50 | 100.00 |
| V2 | streaming_test | streaming_test | 0 | 0 | -- | ||
| V2 | max_clock_error_untracked | max_clock_error_untracked | 0 | 0 | -- | ||
| V2 | max_clock_error_tracking | max_clock_error_tracking | 0 | 0 | -- | ||
| V2 | max_phase_error | max_phase_error | 0 | 0 | -- | ||
| V2 | min_inter_pkt_delay | min_inter_pkt_delay | 0 | 0 | -- | ||
| V2 | max_inter_pkt_delay | max_inter_pkt_delay | 0 | 0 | -- | ||
| V2 | device_timeout_missing_host_handshake | device_timeout_missing_host_handshake | 0 | 0 | -- | ||
| V2 | device_timeout | device_timeout | 0 | 0 | -- | ||
| V2 | packet_buffer | usbdev_pkt_buffer | 1.172m | 30.774ms | 49 | 50 | 98.00 |
| V2 | nak_to_out_trans_when_avbuffer_empty_rxfifo_full | nak_to_out_trans_when_avbuffer_empty_rxfifo_full | 0 | 0 | -- | ||
| V2 | aon_wake_resume | aon_wake_resume | 0 | 0 | -- | ||
| V2 | aon_wake_reset | aon_wake_reset | 0 | 0 | -- | ||
| V2 | aon_wake_disconnect | aon_wake_disconnect | 0 | 0 | -- | ||
| V2 | invalid_sync | invalid_sync | 0 | 0 | -- | ||
| V2 | spurious_tokens_ignored | spurious_tokens_ignored | 0 | 0 | -- | ||
| V2 | low_speed_traffic | low_speed_traffic | 0 | 0 | -- | ||
| V2 | rand_bus_resets | rand_bus_resets | 0 | 0 | -- | ||
| V2 | rand_disconnects | rand_disconnects | 0 | 0 | -- | ||
| V2 | max_usb_traffic | max_usb_traffic | 0 | 0 | -- | ||
| V2 | stress_usb_traffic | stress_usb_traffic | 0 | 0 | -- | ||
| V2 | in_packet_retraction | in_packet_retraction | 0 | 0 | -- | ||
| V2 | data_toggle_restore | data_toggle_restore | 0 | 0 | -- | ||
| V2 | setup_priority | setup_priority | 0 | 0 | -- | ||
| V2 | fifo_resets | usbdev_fifo_rst | 2.650s | 306.226us | 50 | 50 | 100.00 |
| V2 | intr_test | usbdev_intr_test | 0.850s | 104.087us | 50 | 50 | 100.00 |
| V2 | alert_test | usbdev_alert_test | 0 | 0 | -- | ||
| V2 | tl_d_oob_addr_access | usbdev_tl_errors | 3.460s | 254.193us | 20 | 20 | 100.00 |
| V2 | tl_d_illegal_access | usbdev_tl_errors | 3.460s | 254.193us | 20 | 20 | 100.00 |
| V2 | tl_d_outstanding_access | usbdev_csr_hw_reset | 0.860s | 63.409us | 5 | 5 | 100.00 |
| usbdev_csr_rw | 1.030s | 66.931us | 20 | 20 | 100.00 | ||
| usbdev_csr_aliasing | 3.310s | 136.670us | 5 | 5 | 100.00 | ||
| usbdev_same_csr_outstanding | 2.000s | 345.304us | 20 | 20 | 100.00 | ||
| V2 | tl_d_partial_access | usbdev_csr_hw_reset | 0.860s | 63.409us | 5 | 5 | 100.00 |
| usbdev_csr_rw | 1.030s | 66.931us | 20 | 20 | 100.00 | ||
| usbdev_csr_aliasing | 3.310s | 136.670us | 5 | 5 | 100.00 | ||
| usbdev_same_csr_outstanding | 2.000s | 345.304us | 20 | 20 | 100.00 | ||
| V2 | TOTAL | 1189 | 1190 | 99.92 | |||
| V2S | tl_intg_err | usbdev_sec_cm | 1.650s | 842.603us | 5 | 5 | 100.00 |
| usbdev_tl_intg_err | 4.930s | 1.490ms | 20 | 20 | 100.00 | ||
| V2S | sec_cm_bus_integrity | usbdev_tl_intg_err | 4.930s | 1.490ms | 20 | 20 | 100.00 |
| V2S | TOTAL | 25 | 25 | 100.00 | |||
| V3 | TOTAL | 0 | 0 | -- | |||
| Unmapped tests | usbdev_dpi_config_host | 2.263m | 5.167ms | 1 | 1 | 100.00 | |
| random_length_in_trans | 10.710s | 8.421ms | 50 | 50 | 100.00 | ||
| min_length_in_transaction | 10.550s | 8.378ms | 50 | 50 | 100.00 | ||
| max_length_in_transaction | 10.280s | 8.471ms | 50 | 50 | 100.00 | ||
| usbdev_stress_all_with_rand_reset | 0.740s | 83.516us | 0 | 50 | 0.00 | ||
| usbdev_stress_all | 0.640s | 0 | 50 | 0.00 | |||
| TOTAL | 1330 | 1431 | 92.94 |
| Items | Total | Written | Passing | Progress |
|---|---|---|---|---|
| N.A. | 3 | 3 | 1 | 33.33 |
| V1 | 8 | 8 | 8 | 100.00 |
| V2 | 78 | 25 | 24 | 30.77 |
| V2S | 2 | 2 | 2 | 100.00 |
| SCORE | LINE | COND | TOGGLE | FSM | BRANCH | ASSERT | GROUP |
|---|---|---|---|---|---|---|---|
| 88.40 | 95.60 | 88.89 | 96.47 | 50.00 | 94.10 | 97.36 | 96.40 |
UVM_WARNING [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory. has 100 failures:
0.usbdev_stress_all_with_rand_reset.42297599960471948925502385931066716011835080460813401577048881782387464114647
Line 251, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 14940099 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 14940099 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all_with_rand_reset.62161611578289737446418068083197386296043344145833464713877365031140884218272
Line 251, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 16039174 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 16039174 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
0.usbdev_stress_all.40058310076960634372579189710173093604176157767330546692062810315974287117349
Line 251, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all.92100752419853757672742431339461995772288646125021137983443022023274843227248
Line 251, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
UVM_ERROR (usbdev_scoreboard.sv:135) [scoreboard] Check failed actual_pkt_q.pop_front() == expected_pkt_q.pop_front() (* [*] vs * [*]) has 1 failures:
5.usbdev_pkt_buffer.31367353881387811545650703404826296720284674022628526530584656993062933708387
Line 2184, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/5.usbdev_pkt_buffer/latest/run.log
UVM_ERROR @ 10237248545 ps: (usbdev_scoreboard.sv:135) [uvm_test_top.env.scoreboard] Check failed actual_pkt_q.pop_front() == expected_pkt_q.pop_front() (23455947771456 [0x1555436f4e40] vs 23455947771456 [0x1555436f4e40])
UVM_INFO @ 10237248545 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---