e3ca274e77| Stage | Name | Tests | Max Job Runtime | Simulated Time | Passing | Total | Pass Rate |
|---|---|---|---|---|---|---|---|
| V1 | smoke | usbdev_smoke | 10.570s | 8.479ms | 50 | 50 | 100.00 |
| V1 | csr_hw_reset | usbdev_csr_hw_reset | 0.760s | 37.509us | 5 | 5 | 100.00 |
| V1 | csr_rw | usbdev_csr_rw | 0.980s | 50.830us | 20 | 20 | 100.00 |
| V1 | csr_bit_bash | usbdev_csr_bit_bash | 3.620s | 502.309us | 3 | 5 | 60.00 |
| V1 | csr_aliasing | usbdev_csr_aliasing | 2.380s | 91.793us | 5 | 5 | 100.00 |
| V1 | csr_mem_rw_with_rand_reset | usbdev_csr_mem_rw_with_rand_reset | 2.540s | 78.490us | 20 | 20 | 100.00 |
| V1 | regwen_csr_and_corresponding_lockable_csr | usbdev_csr_rw | 0.980s | 50.830us | 20 | 20 | 100.00 |
| usbdev_csr_aliasing | 2.380s | 91.793us | 5 | 5 | 100.00 | ||
| V1 | mem_walk | usbdev_mem_walk | 3.820s | 147.279us | 2 | 5 | 40.00 |
| V1 | mem_partial_access | usbdev_mem_partial_access | 2.270s | 188.053us | 5 | 5 | 100.00 |
| V1 | TOTAL | 110 | 115 | 95.65 | |||
| V2 | in_trans | usbdev_in_trans | 9.420s | 8.372ms | 46 | 50 | 92.00 |
| V2 | data_toggle_clear | data_toggle_clear | 0 | 0 | -- | ||
| V2 | phy_pins_sense | usbdev_phy_pins_sense | 0.700s | 29.606us | 50 | 50 | 100.00 |
| V2 | wake_events | wake_events | 0 | 0 | -- | ||
| V2 | av_buffer | usbdev_av_buffer | 10.180s | 8.370ms | 50 | 50 | 100.00 |
| V2 | rx_fifo | rx_fifo | 0 | 0 | -- | ||
| V2 | phy_config_tx_osc_test_mode | phy_config_tx_osc_test_mode | 0 | 0 | -- | ||
| V2 | phy_config_eop_single_bit_handling | phy_config_eop_single_bit_handling | 0 | 0 | -- | ||
| V2 | phy_config_pinflip | phy_config_pinflip | 0 | 0 | -- | ||
| V2 | phy_config_usb_ref_disable | phy_config_usb_ref_disable | 0 | 0 | -- | ||
| V2 | max_length_out_transaction | usbdev_max_length_out_transaction | 9.810s | 8.412ms | 50 | 50 | 100.00 |
| V2 | max_length_in_transaction | max_length_in_transaction | 0 | 0 | -- | ||
| V2 | min_length_out_transaction | usbdev_min_length_out_transaction | 10.380s | 8.367ms | 50 | 50 | 100.00 |
| V2 | min_length_in_transaction | min_length_in_transaction | 0 | 0 | -- | ||
| V2 | random_length_out_trans | usbdev_random_length_out_trans | 9.530s | 8.395ms | 50 | 50 | 100.00 |
| V2 | random_length_in_trans | random_length_in_trans | 0 | 0 | -- | ||
| V2 | out_stall | usbdev_out_stall | 9.740s | 8.378ms | 50 | 50 | 100.00 |
| V2 | in_stall | in_stall | 0 | 0 | -- | ||
| V2 | out_iso | out_iso | 0 | 0 | -- | ||
| V2 | in_iso | in_iso | 0 | 0 | -- | ||
| V2 | pkt_received | usbdev_pkt_received | 9.920s | 8.403ms | 50 | 50 | 100.00 |
| V2 | pkt_sent | usbdev_pkt_sent | 9.540s | 8.424ms | 46 | 50 | 92.00 |
| V2 | disconnected | disconnected | 0 | 0 | -- | ||
| V2 | host_lost | host_lost | 0 | 0 | -- | ||
| V2 | link_reset | link_reset | 0 | 0 | -- | ||
| V2 | link_suspend | link_suspend | 0 | 0 | -- | ||
| V2 | link_resume | link_resume | 0 | 0 | -- | ||
| V2 | av_empty | av_empty | 0 | 0 | -- | ||
| V2 | rx_full | rx_full | 0 | 0 | -- | ||
| V2 | av_overflow | av_overflow | 0 | 0 | -- | ||
| V2 | enable | usbdev_enable | 9.840s | 8.370ms | 50 | 50 | 100.00 |
| V2 | resume_link_active | resume_link_active | 0 | 0 | -- | ||
| V2 | device_address | device_address | 0 | 0 | -- | ||
| V2 | link_in_err | link_in_err | 0 | 0 | -- | ||
| V2 | rx_crc_err | rx_crc_err | 0 | 0 | -- | ||
| V2 | rx_pid_err | rx_pid_err | 0 | 0 | -- | ||
| V2 | rx_bitstuff_err | rx_bitstuff_err | 0 | 0 | -- | ||
| V2 | link_out_err | link_out_err | 0 | 0 | -- | ||
| V2 | invalid_data1_data0_toggle_test | invalid_data1_data0_toggle_test | 0 | 0 | -- | ||
| V2 | setup_stage | setup_stage | 0 | 0 | -- | ||
| V2 | in_data_stage | in_data_stage | 0 | 0 | -- | ||
| V2 | out_data_stage | out_data_stage | 0 | 0 | -- | ||
| V2 | out_status_stage | out_status_stage | 0 | 0 | -- | ||
| V2 | in_status_stage | in_status_stage | 0 | 0 | -- | ||
| V2 | endpoint_access | endpoint_access | 0 | 0 | -- | ||
| V2 | disable_endpoint | disable_endpoint | 0 | 0 | -- | ||
| V2 | out_trans_nak | usbdev_out_trans_nak | 10.030s | 8.394ms | 50 | 50 | 100.00 |
| V2 | setup_trans_ignored | usbdev_setup_trans_ignored | 10.160s | 8.363ms | 50 | 50 | 100.00 |
| V2 | nak_trans | usbdev_nak_trans | 9.660s | 8.390ms | 46 | 50 | 92.00 |
| V2 | stall_trans | stall_trans | 0 | 0 | -- | ||
| V2 | setup_priority_over_stall_response | setup_priority_over_stall_response | 0 | 0 | -- | ||
| V2 | stall_priority_over_NAK | stall_priority_over_NAK | 0 | 0 | -- | ||
| V2 | pending_in_trans | pending_in_trans | 0 | 0 | -- | ||
| V2 | streaming_test | streaming_test | 0 | 0 | -- | ||
| V2 | max_clock_error_untracked | max_clock_error_untracked | 0 | 0 | -- | ||
| V2 | max_clock_error_tracking | max_clock_error_tracking | 0 | 0 | -- | ||
| V2 | max_phase_error | max_phase_error | 0 | 0 | -- | ||
| V2 | min_inter_pkt_delay | min_inter_pkt_delay | 0 | 0 | -- | ||
| V2 | max_inter_pkt_delay | max_inter_pkt_delay | 0 | 0 | -- | ||
| V2 | device_timeout_missing_host_handshake | device_timeout_missing_host_handshake | 0 | 0 | -- | ||
| V2 | device_timeout | device_timeout | 0 | 0 | -- | ||
| V2 | nak_to_out_trans_when_avbuffer_empty_rxfifo_full | nak_to_out_trans_when_avbuffer_empty_rxfifo_full | 0 | 0 | -- | ||
| V2 | aon_wake_resume | aon_wake_resume | 0 | 0 | -- | ||
| V2 | aon_wake_reset | aon_wake_reset | 0 | 0 | -- | ||
| V2 | aon_wake_disconnect | aon_wake_disconnect | 0 | 0 | -- | ||
| V2 | invalid_sync | invalid_sync | 0 | 0 | -- | ||
| V2 | spurious_tokens_ignored | spurious_tokens_ignored | 0 | 0 | -- | ||
| V2 | low_speed_traffic | low_speed_traffic | 0 | 0 | -- | ||
| V2 | rand_bus_resets | rand_bus_resets | 0 | 0 | -- | ||
| V2 | rand_disconnects | rand_disconnects | 0 | 0 | -- | ||
| V2 | max_usb_traffic | max_usb_traffic | 0 | 0 | -- | ||
| V2 | stress_usb_traffic | stress_usb_traffic | 0 | 0 | -- | ||
| V2 | in_packet_retraction | in_packet_retraction | 0 | 0 | -- | ||
| V2 | data_toggle_restore | data_toggle_restore | 0 | 0 | -- | ||
| V2 | setup_priority | setup_priority | 0 | 0 | -- | ||
| V2 | fifo_resets | usbdev_fifo_rst | 2.310s | 292.693us | 50 | 50 | 100.00 |
| V2 | intr_test | usbdev_intr_test | 0.760s | 22.290us | 21 | 50 | 42.00 |
| V2 | alert_test | usbdev_alert_test | 0 | 0 | -- | ||
| V2 | tl_d_oob_addr_access | usbdev_tl_errors | 3.670s | 356.227us | 20 | 20 | 100.00 |
| V2 | tl_d_illegal_access | usbdev_tl_errors | 3.670s | 356.227us | 20 | 20 | 100.00 |
| V2 | tl_d_outstanding_access | usbdev_csr_hw_reset | 0.760s | 37.509us | 5 | 5 | 100.00 |
| usbdev_csr_rw | 0.980s | 50.830us | 20 | 20 | 100.00 | ||
| usbdev_csr_aliasing | 2.380s | 91.793us | 5 | 5 | 100.00 | ||
| usbdev_same_csr_outstanding | 1.540s | 97.579us | 20 | 20 | 100.00 | ||
| V2 | tl_d_partial_access | usbdev_csr_hw_reset | 0.760s | 37.509us | 5 | 5 | 100.00 |
| usbdev_csr_rw | 0.980s | 50.830us | 20 | 20 | 100.00 | ||
| usbdev_csr_aliasing | 2.380s | 91.793us | 5 | 5 | 100.00 | ||
| usbdev_same_csr_outstanding | 1.540s | 97.579us | 20 | 20 | 100.00 | ||
| V2 | TOTAL | 749 | 790 | 94.81 | |||
| V2S | tl_intg_err | usbdev_sec_cm | 0.920s | 89.704us | 5 | 5 | 100.00 |
| usbdev_tl_intg_err | 4.310s | 453.118us | 18 | 20 | 90.00 | ||
| V2S | sec_cm_bus_integrity | usbdev_tl_intg_err | 4.310s | 453.118us | 18 | 20 | 90.00 |
| V2S | TOTAL | 23 | 25 | 92.00 | |||
| V3 | TOTAL | 0 | 0 | -- | |||
| Unmapped tests | usbdev_in_stall | 10.090s | 8.357ms | 50 | 50 | 100.00 | |
| usbdev_stress_all_with_rand_reset | 0.650s | 4.186us | 0 | 50 | 0.00 | ||
| usbdev_stress_all | 0.610s | 0 | 50 | 0.00 | |||
| TOTAL | 932 | 1080 | 86.30 |
| Items | Total | Written | Passing | Progress |
|---|---|---|---|---|
| N.A. | 3 | 3 | 1 | 33.33 |
| V1 | 8 | 8 | 6 | 75.00 |
| V2 | 80 | 17 | 13 | 16.25 |
| V2S | 2 | 2 | 1 | 50.00 |
| SCORE | LINE | COND | TOGGLE | FSM | BRANCH | ASSERT | GROUP |
|---|---|---|---|---|---|---|---|
| 88.16 | 96.33 | 88.64 | 97.17 | 46.88 | 94.15 | 97.36 | 96.58 |
UVM_WARNING [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory. has 100 failures:
0.usbdev_stress_all_with_rand_reset.84161549539172943895577396856231127103064790700086228195273166212973955866944
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 4912981 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 4912981 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all_with_rand_reset.94464110932509702230589203251113241156908754546520652241874075772425433594272
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 4155323 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 4155323 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
0.usbdev_stress_all.3537844498570306446146968329318556753979836274097274857619713393137253628889
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all.86770824563817309070602688019314775130897443837408305340306003930558750648182
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
UVM_ERROR (cip_base_vseq.sv:473) [usbdev_common_vseq] Check failed exp_val == act_val (* [*] vs * [*]) when reading the intr CSRusbdev_reg_block.intr_state has 29 failures:
2.usbdev_intr_test.62803442675775926785439427617525662138011750100997798631008373430199774740704
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_intr_test/latest/run.log
UVM_ERROR @ 5314207 ps: (cip_base_vseq.sv:473) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (18500 [0x4844] vs 51284 [0xc854]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 5314207 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
4.usbdev_intr_test.88088914646451847904192364581878500331500454167058676645986402031297835968553
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_intr_test/latest/run.log
UVM_ERROR @ 3004081 ps: (cip_base_vseq.sv:473) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (12308 [0x3014] vs 45076 [0xb014]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 3004081 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 27 more failures.
UVM_FATAL (usb20_driver.sv:295) [driver] timeout waiting for usb_pullup has 7 failures:
Test usbdev_csr_bit_bash has 2 failures.
0.usbdev_csr_bit_bash.34763270127751544590598451403904498957194360512991759917173403324298614462197
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 502308909 ps: (usb20_driver.sv:295) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502308909 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
3.usbdev_csr_bit_bash.31549053198796933136814991497451507663250838772802768358524486655955064368515
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/3.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 501476225 ps: (usb20_driver.sv:295) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501476225 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
Test usbdev_mem_walk has 3 failures.
1.usbdev_mem_walk.68358684439616727335513903400361290463682252317018115273104573666321545414315
Line 262, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_mem_walk/latest/run.log
UVM_FATAL @ 501814549 ps: (usb20_driver.sv:295) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501814549 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
2.usbdev_mem_walk.96437770841142046799125668716979539410659752030088365790567962575086826984204
Line 262, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_mem_walk/latest/run.log
UVM_FATAL @ 501563941 ps: (usb20_driver.sv:295) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501563941 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 1 more failures.
Test usbdev_tl_intg_err has 2 failures.
3.usbdev_tl_intg_err.106441948540752247536376848800566468900284611967985527832542690990540562696228
Line 405, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/3.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 501801415 ps: (usb20_driver.sv:295) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501801415 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
16.usbdev_tl_intg_err.23371223735180514256738503580836749949662388877581844218632462687547608297952
Line 404, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/16.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 501653138 ps: (usb20_driver.sv:295) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501653138 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
UVM_ERROR (cip_base_vseq.sv:503) [usbdev_in_trans_vseq] Check failed data & ~ro_mask == * (* [*] vs * [*]) has 4 failures:
1.usbdev_in_trans.111115832893837111165728273186727316077405243938527782503847504008519839270015
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_in_trans/latest/run.log
UVM_ERROR @ 9961018 ps: (cip_base_vseq.sv:503) [uvm_test_top.env.virtual_sequencer.usbdev_in_trans_vseq] Check failed data & ~ro_mask == 0 (16 [0x10] vs 0 [0x0])
UVM_INFO @ 9961018 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
25.usbdev_in_trans.36952445483613729365360029040816795822818293474975831318167266718789973655563
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/25.usbdev_in_trans/latest/run.log
UVM_ERROR @ 10957292 ps: (cip_base_vseq.sv:503) [uvm_test_top.env.virtual_sequencer.usbdev_in_trans_vseq] Check failed data & ~ro_mask == 0 (16 [0x10] vs 0 [0x0])
UVM_INFO @ 10957292 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 2 more failures.
UVM_ERROR (cip_base_vseq.sv:503) [usbdev_pkt_sent_vseq] Check failed data & ~ro_mask == * (* [*] vs * [*]) has 4 failures:
6.usbdev_pkt_sent.61893563391266127304331926652341201569234845149232685309301402510152412284027
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/6.usbdev_pkt_sent/latest/run.log
UVM_ERROR @ 10686838 ps: (cip_base_vseq.sv:503) [uvm_test_top.env.virtual_sequencer.usbdev_pkt_sent_vseq] Check failed data & ~ro_mask == 0 (16 [0x10] vs 0 [0x0])
UVM_INFO @ 10686838 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
17.usbdev_pkt_sent.26298327026997286351949585250092570680668081320088257882008925324776817018016
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/17.usbdev_pkt_sent/latest/run.log
UVM_ERROR @ 9619407 ps: (cip_base_vseq.sv:503) [uvm_test_top.env.virtual_sequencer.usbdev_pkt_sent_vseq] Check failed data & ~ro_mask == 0 (16 [0x10] vs 0 [0x0])
UVM_INFO @ 9619407 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 2 more failures.
UVM_ERROR (cip_base_vseq.sv:503) [usbdev_nak_trans_vseq] Check failed data & ~ro_mask == * (* [*] vs * [*]) has 4 failures:
26.usbdev_nak_trans.100972629312426575886604594995060039351776797356572140725142814627795474642319
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/26.usbdev_nak_trans/latest/run.log
UVM_ERROR @ 10186181 ps: (cip_base_vseq.sv:503) [uvm_test_top.env.virtual_sequencer.usbdev_nak_trans_vseq] Check failed data & ~ro_mask == 0 (16 [0x10] vs 0 [0x0])
UVM_INFO @ 10186181 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
35.usbdev_nak_trans.87818121699356937110333569499706641596592454455853594479509161386069838835028
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/35.usbdev_nak_trans/latest/run.log
UVM_ERROR @ 9583774 ps: (cip_base_vseq.sv:503) [uvm_test_top.env.virtual_sequencer.usbdev_nak_trans_vseq] Check failed data & ~ro_mask == 0 (16 [0x10] vs 0 [0x0])
UVM_INFO @ 9583774 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 2 more failures.