a9c19f09f3| Stage | Name | Tests | Max Job Runtime | Simulated Time | Passing | Total | Pass Rate |
|---|---|---|---|---|---|---|---|
| V1 | smoke | usbdev_smoke | 10.180s | 8.345ms | 0 | 50 | 0.00 |
| V1 | csr_hw_reset | usbdev_csr_hw_reset | 0.860s | 144.079us | 5 | 5 | 100.00 |
| V1 | csr_rw | usbdev_csr_rw | 1.130s | 79.883us | 20 | 20 | 100.00 |
| V1 | csr_bit_bash | usbdev_csr_bit_bash | 8.850s | 388.043us | 3 | 5 | 60.00 |
| V1 | csr_aliasing | usbdev_csr_aliasing | 3.390s | 346.375us | 5 | 5 | 100.00 |
| V1 | csr_mem_rw_with_rand_reset | usbdev_csr_mem_rw_with_rand_reset | 2.130s | 53.924us | 18 | 20 | 90.00 |
| V1 | regwen_csr_and_corresponding_lockable_csr | usbdev_csr_rw | 1.130s | 79.883us | 20 | 20 | 100.00 |
| usbdev_csr_aliasing | 3.390s | 346.375us | 5 | 5 | 100.00 | ||
| V1 | mem_walk | usbdev_mem_walk | 4.110s | 472.352us | 4 | 5 | 80.00 |
| V1 | mem_partial_access | usbdev_mem_partial_access | 2.130s | 64.359us | 5 | 5 | 100.00 |
| V1 | TOTAL | 60 | 115 | 52.17 | |||
| V2 | in_trans | usbdev_in_trans | 0 | 0 | -- | ||
| V2 | data_toggle_clear | usbdev_data_toggle_clear | 0 | 0 | -- | ||
| V2 | phy_pins_sense | usbdev_phy_pins_sense | 0 | 0 | -- | ||
| V2 | wake_events | usbdev_wake_events | 0 | 0 | -- | ||
| V2 | av_buffer | usbdev_av_buffer | 0 | 0 | -- | ||
| V2 | rx_fifo | usbdev_rx_fifo | 0 | 0 | -- | ||
| V2 | phy_config_tx_osc_test_mode | usbdev_phy_config_tx_osc_test_mode | 0 | 0 | -- | ||
| V2 | phy_config_eop_single_bit_handling | usbdev_phy_config_eop_single_bit_handling | 0 | 0 | -- | ||
| V2 | phy_config_pinflip | usbdev_phy_config_pinflip | 0 | 0 | -- | ||
| V2 | phy_config_usb_ref_disable | usbdev_phy_config_usb_ref_disable | 0 | 0 | -- | ||
| V2 | max_length_out_transaction | usbdev_max_length_out_transaction | 0 | 0 | -- | ||
| V2 | max_length_in_transaction | usbdev_max_length_in_transaction | 0 | 0 | -- | ||
| V2 | min_length_out_transaction | usbdev_min_length_out_transaction | 0 | 0 | -- | ||
| V2 | min_length_in_transaction | usbdev_min_length_in_transaction | 0 | 0 | -- | ||
| V2 | random_length_out_trans | usbdev_random_length_out_trans | 0 | 0 | -- | ||
| V2 | random_length_in_trans | usbdev_random_length_in_trans | 0 | 0 | -- | ||
| V2 | out_stall | usbdev_out_stall | 0 | 0 | -- | ||
| V2 | in_stall | usbdev_in_stall | 0 | 0 | -- | ||
| V2 | out_iso | usbdev_out_iso | 0 | 0 | -- | ||
| V2 | in_iso | usbdev_in_iso | 0 | 0 | -- | ||
| V2 | pkt_received | usbdev_pkt_received | 0 | 0 | -- | ||
| V2 | pkt_sent | usbdev_pkt_sent | 0 | 0 | -- | ||
| V2 | disconnected | usbdev_disconnected | 0 | 0 | -- | ||
| V2 | host_lost | usbdev_host_lost | 0 | 0 | -- | ||
| V2 | link_reset | usbdev_link_reset | 0 | 0 | -- | ||
| V2 | link_suspend | usbdev_link_suspend | 0 | 0 | -- | ||
| V2 | link_resume | usbdev_link_resume | 0 | 0 | -- | ||
| V2 | av_empty | usbdev_av_empty | 0 | 0 | -- | ||
| V2 | rx_full | usbdev_rx_full | 0 | 0 | -- | ||
| V2 | av_overflow | usbdev_av_overflow | 0 | 0 | -- | ||
| V2 | enable | usbdev_enable | 0 | 0 | -- | ||
| V2 | resume_link_active | usbdev_resume_link_active | 0 | 0 | -- | ||
| V2 | device_address | usbdev_device_address | 0 | 0 | -- | ||
| V2 | link_in_err | usbdev_link_in_err | 0 | 0 | -- | ||
| V2 | rx_crc_err | usbdev_rx_crc_err | 0 | 0 | -- | ||
| V2 | rx_pid_err | usbdev_rx_pid_err | 0 | 0 | -- | ||
| V2 | rx_bitstuff_err | usbdev_rx_bitstuff_err | 0 | 0 | -- | ||
| V2 | link_out_err | usbdev_link_out_err | 0 | 0 | -- | ||
| V2 | invalid_data1_data0_toggle_test | usbdev_invalid_data1_data0_toggle_test | 0 | 0 | -- | ||
| V2 | setup_stage | usbdev_setup_stage | 0 | 0 | -- | ||
| V2 | in_data_stage | usbdev_in_data_stage | 0 | 0 | -- | ||
| V2 | out_data_stage | usbdev_out_data_stage | 0 | 0 | -- | ||
| V2 | out_status_stage | usbdev_out_status_stage | 0 | 0 | -- | ||
| V2 | in_status_stage | usbdev_in_status_stage | 0 | 0 | -- | ||
| V2 | endpoint_access | usbdev_endpoint_access | 0 | 0 | -- | ||
| V2 | disable_endpoint | usbdev_disable_endpoint | 0 | 0 | -- | ||
| V2 | out_trans_nak | usbdev_out_trans_nak | 0 | 0 | -- | ||
| V2 | setup_trans_ignored | usbdev_setup_trans_ignored | 0 | 0 | -- | ||
| V2 | nak_trans | usbdev_nak_trans | 0 | 0 | -- | ||
| V2 | stall_trans | usbdev_stall_trans | 0 | 0 | -- | ||
| V2 | setup_priority_over_stall_response | usbdev_setup_priority_over_stall_response | 0 | 0 | -- | ||
| V2 | stall_priority_over_NAK | usbdev_stall_priority_over_NAK | 0 | 0 | -- | ||
| V2 | pending_in_trans | usbdev_pending_in_trans | 0 | 0 | -- | ||
| V2 | streaming_test | usbdev_streaming_test | 0 | 0 | -- | ||
| V2 | max_clock_error | usbdev_max_clock_error | 0 | 0 | -- | ||
| V2 | max_phase_error | usbdev_max_phase_error | 0 | 0 | -- | ||
| V2 | min_inter_pkt_delay | usbdev_min_inter_pkt_delay | 0 | 0 | -- | ||
| V2 | max_inter_pkt_delay | usbdev_max_inter_pkt_delay | 0 | 0 | -- | ||
| V2 | device_timeout_missing_host_handshake | usbdev_device_timeout_missing_host_handshake | 0 | 0 | -- | ||
| V2 | device_timeout | usbdev_device_timeout | 0 | 0 | -- | ||
| V2 | nak_to_out_trans_when_avbuffer_empty_rxfifo_full | usbdev_nak_to_out_trans_when_avbuffer_empty_rxfifo_full | 0 | 0 | -- | ||
| V2 | intr_test | usbdev_intr_test | 0.720s | 121.725us | 34 | 50 | 68.00 |
| V2 | alert_test | usbdev_alert_test | 0 | 0 | -- | ||
| V2 | tl_d_oob_addr_access | usbdev_tl_errors | 3.670s | 359.583us | 19 | 20 | 95.00 |
| V2 | tl_d_illegal_access | usbdev_tl_errors | 3.670s | 359.583us | 19 | 20 | 95.00 |
| V2 | tl_d_outstanding_access | usbdev_csr_hw_reset | 0.860s | 144.079us | 5 | 5 | 100.00 |
| usbdev_csr_rw | 1.130s | 79.883us | 20 | 20 | 100.00 | ||
| usbdev_csr_aliasing | 3.390s | 346.375us | 5 | 5 | 100.00 | ||
| usbdev_same_csr_outstanding | 1.550s | 179.139us | 20 | 20 | 100.00 | ||
| V2 | tl_d_partial_access | usbdev_csr_hw_reset | 0.860s | 144.079us | 5 | 5 | 100.00 |
| usbdev_csr_rw | 1.130s | 79.883us | 20 | 20 | 100.00 | ||
| usbdev_csr_aliasing | 3.390s | 346.375us | 5 | 5 | 100.00 | ||
| usbdev_same_csr_outstanding | 1.550s | 179.139us | 20 | 20 | 100.00 | ||
| V2 | TOTAL | 73 | 90 | 81.11 | |||
| V2S | tl_intg_err | usbdev_sec_cm | 1.410s | 501.732us | 3 | 5 | 60.00 |
| usbdev_tl_intg_err | 4.690s | 501.980us | 13 | 20 | 65.00 | ||
| V2S | sec_cm_bus_integrity | usbdev_tl_intg_err | 4.690s | 501.980us | 13 | 20 | 65.00 |
| V2S | TOTAL | 16 | 25 | 64.00 | |||
| V3 | TOTAL | 0 | 0 | -- | |||
| Unmapped tests | usbdev_stress_all_with_rand_reset | 0.680s | 108.225us | 0 | 50 | 0.00 | |
| usbdev_stress_all | 0.600s | 0 | 50 | 0.00 | |||
| TOTAL | 149 | 330 | 45.15 |
| Items | Total | Written | Passing | Progress |
|---|---|---|---|---|
| N.A. | 2 | 2 | 0 | 0.00 |
| V1 | 8 | 8 | 4 | 50.00 |
| V2 | 65 | 3 | 1 | 1.54 |
| V2S | 2 | 2 | 0 | 0.00 |
| SCORE | LINE | COND | TOGGLE | FSM | BRANCH | ASSERT | GROUP |
|---|---|---|---|---|---|---|---|
| 77.04 | 89.84 | 75.67 | 95.05 | 3.12 | 87.16 | 92.01 | 96.47 |
UVM_WARNING [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory. has 100 failures:
0.usbdev_stress_all_with_rand_reset.80436736242305058324690717226371953813634635502170659418705895784344618161573
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 13973352 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 13973352 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all_with_rand_reset.59595675025454234735108835567620923273168694079440927765744770556278208654882
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 3527023 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 3527023 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
0.usbdev_stress_all.61277827890808793334995556166987238908159261043888175946361771553775315850899
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all.40105377387939103657946578691218323143632165505277494793292531738875924856726
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
UVM_ERROR (usbdev_scoreboard.sv:74) [scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (* [*] vs * [*]) has 49 failures:
0.usbdev_smoke.26717816845581871033106304979554621380073627134184781855895929557107042740686
Line 264, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_smoke/latest/run.log
UVM_ERROR @ 8347506957 ps: (usbdev_scoreboard.sv:74) [uvm_test_top.env.scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (1 [0x1] vs 0 [0x0])
UVM_INFO @ 8347506957 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
1.usbdev_smoke.72848501113657721859750078887201724157607448831200241007627622524952805248749
Line 264, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_smoke/latest/run.log
UVM_ERROR @ 8343850760 ps: (usbdev_scoreboard.sv:74) [uvm_test_top.env.scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (1 [0x1] vs 0 [0x0])
UVM_INFO @ 8343850760 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 47 more failures.
UVM_ERROR (cip_base_vseq.sv:455) [usbdev_common_vseq] Check failed exp_val == act_val (* [*] vs * [*]) when reading the intr CSRusbdev_reg_block.intr_state has 14 failures:
3.usbdev_intr_test.99263288523360735749723913794270386072598063837607409265658445290333558504268
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/3.usbdev_intr_test/latest/run.log
UVM_ERROR @ 9385710 ps: (cip_base_vseq.sv:455) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (9698 [0x25e2] vs 42466 [0xa5e2]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 9385710 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
5.usbdev_intr_test.70106314818799507899943514257381855016228431279608325210140531436282517608421
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/5.usbdev_intr_test/latest/run.log
UVM_ERROR @ 4656170 ps: (cip_base_vseq.sv:455) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (32122 [0x7d7a] vs 64890 [0xfd7a]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 4656170 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 12 more failures.
UVM_FATAL (usb20_driver.sv:254) [driver] timeout waiting for usb_pullup has 12 failures:
Test usbdev_csr_bit_bash has 2 failures.
0.usbdev_csr_bit_bash.34830543747608059818515399258014342546910916092880193159707658826977207951690
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 502472997 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502472997 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
1.usbdev_csr_bit_bash.105349943346308206865324429240441987275669031411080953097732353769662517161892
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 501981522 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501981522 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
Test usbdev_sec_cm has 2 failures.
1.usbdev_sec_cm.79524762780327834100585331270732541998309275172050611407673929938177917559840
Line 362, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_sec_cm/latest/run.log
UVM_FATAL @ 502308170 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502308170 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
2.usbdev_sec_cm.36939853222625636926176429202935241767691074751124427753394650856313055425779
Line 288, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_sec_cm/latest/run.log
UVM_FATAL @ 501731924 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501731924 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
Test usbdev_tl_intg_err has 7 failures.
3.usbdev_tl_intg_err.53714912952950976366204234568008137530689973781949722708091570645842614029829
Line 312, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/3.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 501737044 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501737044 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
5.usbdev_tl_intg_err.54333777360291613298413447008509871271090213427084765910248183453186996982363
Line 351, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/5.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 501885723 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501885723 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 5 more failures.
Test usbdev_mem_walk has 1 failures.
4.usbdev_mem_walk.49814812988659564755281722087372053128382036296090106288609238271775869852244
Line 263, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_mem_walk/latest/run.log
UVM_FATAL @ 501639466 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501639466 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
Job usbdev-sim-vcs_run_cover_reg_top killed due to: Exit reason: User job exceeded runlimit: User job timed out has 5 failures:
Test usbdev_csr_mem_rw_with_rand_reset has 2 failures.
2.usbdev_csr_mem_rw_with_rand_reset.29911832317455716522808136344589535527497171084387497951543578368654860787094
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_csr_mem_rw_with_rand_reset/latest/run.log
Job ID: smart:f22162a3-a2e7-4229-b334-d57f4732620c
17.usbdev_csr_mem_rw_with_rand_reset.65843219602086816613691560162639728515846506726763655716962951434245189588153
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/17.usbdev_csr_mem_rw_with_rand_reset/latest/run.log
Job ID: smart:d7a0d96d-f58e-4652-bdbf-fd02bbc10441
Test usbdev_tl_errors has 1 failures.
12.usbdev_tl_errors.52633129747852102799748952479875018949579335650977725674990608733556540841962
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/12.usbdev_tl_errors/latest/run.log
Job ID: smart:9432814b-ee67-401e-97b4-4351d3fc8b51
Test usbdev_intr_test has 2 failures.
31.usbdev_intr_test.47719956770367950432558957150924746919653981477762083852076166830866517775163
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/31.usbdev_intr_test/latest/run.log
Job ID: smart:062c49d6-9120-4d9b-8154-999b1a645235
46.usbdev_intr_test.71885821074240954674869002975155791745900967709217447137000133433926070640551
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/46.usbdev_intr_test/latest/run.log
Job ID: smart:4d23af0b-7f67-481f-b14c-e2f1bae1b92b
Job usbdev-sim-vcs_run_default killed due to: Exit reason: User job exceeded runlimit: User job timed out has 1 failures:
14.usbdev_smoke.4310270141474352210459907726327771256066001566982385112656593888081761331650
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/14.usbdev_smoke/latest/run.log
Job ID: smart:99bb2ca6-41ed-4b36-95c4-70dbc1459343