4d88b9516c| Stage | Name | Tests | Max Job Runtime | Simulated Time | Passing | Total | Pass Rate |
|---|---|---|---|---|---|---|---|
| V1 | smoke | usbdev_smoke | 9.040s | 8.354ms | 0 | 50 | 0.00 |
| V1 | csr_hw_reset | usbdev_csr_hw_reset | 0.860s | 54.213us | 4 | 5 | 80.00 |
| V1 | csr_rw | usbdev_csr_rw | 1.090s | 98.476us | 20 | 20 | 100.00 |
| V1 | csr_bit_bash | usbdev_csr_bit_bash | 8.500s | 426.906us | 1 | 5 | 20.00 |
| V1 | csr_aliasing | usbdev_csr_aliasing | 3.210s | 224.974us | 5 | 5 | 100.00 |
| V1 | csr_mem_rw_with_rand_reset | usbdev_csr_mem_rw_with_rand_reset | 1.800s | 49.637us | 18 | 20 | 90.00 |
| V1 | regwen_csr_and_corresponding_lockable_csr | usbdev_csr_rw | 1.090s | 98.476us | 20 | 20 | 100.00 |
| usbdev_csr_aliasing | 3.210s | 224.974us | 5 | 5 | 100.00 | ||
| V1 | mem_walk | usbdev_mem_walk | 3.750s | 203.017us | 5 | 5 | 100.00 |
| V1 | mem_partial_access | usbdev_mem_partial_access | 2.270s | 182.932us | 5 | 5 | 100.00 |
| V1 | TOTAL | 58 | 115 | 50.43 | |||
| V2 | in_trans | usbdev_in_trans | 0 | 0 | -- | ||
| V2 | data_toggle_clear | usbdev_data_toggle_clear | 0 | 0 | -- | ||
| V2 | phy_pins_sense | usbdev_phy_pins_sense | 0 | 0 | -- | ||
| V2 | wake_events | usbdev_wake_events | 0 | 0 | -- | ||
| V2 | av_buffer | usbdev_av_buffer | 0 | 0 | -- | ||
| V2 | rx_fifo | usbdev_rx_fifo | 0 | 0 | -- | ||
| V2 | phy_config_tx_osc_test_mode | usbdev_phy_config_tx_osc_test_mode | 0 | 0 | -- | ||
| V2 | phy_config_eop_single_bit_handling | usbdev_phy_config_eop_single_bit_handling | 0 | 0 | -- | ||
| V2 | phy_config_pinflip | usbdev_phy_config_pinflip | 0 | 0 | -- | ||
| V2 | phy_config_usb_ref_disable | usbdev_phy_config_usb_ref_disable | 0 | 0 | -- | ||
| V2 | max_length_out_transaction | usbdev_max_length_out_transaction | 0 | 0 | -- | ||
| V2 | max_length_in_transaction | usbdev_max_length_in_transaction | 0 | 0 | -- | ||
| V2 | min_length_out_transaction | usbdev_min_length_out_transaction | 0 | 0 | -- | ||
| V2 | min_length_in_transaction | usbdev_min_length_in_transaction | 0 | 0 | -- | ||
| V2 | random_length_out_trans | usbdev_random_length_out_trans | 0 | 0 | -- | ||
| V2 | random_length_in_trans | usbdev_random_length_in_trans | 0 | 0 | -- | ||
| V2 | out_stall | usbdev_out_stall | 0 | 0 | -- | ||
| V2 | in_stall | usbdev_in_stall | 0 | 0 | -- | ||
| V2 | out_iso | usbdev_out_iso | 0 | 0 | -- | ||
| V2 | in_iso | usbdev_in_iso | 0 | 0 | -- | ||
| V2 | pkt_received | usbdev_pkt_received | 0 | 0 | -- | ||
| V2 | pkt_sent | usbdev_pkt_sent | 0 | 0 | -- | ||
| V2 | disconnected | usbdev_disconnected | 0 | 0 | -- | ||
| V2 | host_lost | usbdev_host_lost | 0 | 0 | -- | ||
| V2 | link_reset | usbdev_link_reset | 0 | 0 | -- | ||
| V2 | link_suspend | usbdev_link_suspend | 0 | 0 | -- | ||
| V2 | link_resume | usbdev_link_resume | 0 | 0 | -- | ||
| V2 | av_empty | usbdev_av_empty | 0 | 0 | -- | ||
| V2 | rx_full | usbdev_rx_full | 0 | 0 | -- | ||
| V2 | av_overflow | usbdev_av_overflow | 0 | 0 | -- | ||
| V2 | enable | usbdev_enable | 0 | 0 | -- | ||
| V2 | resume_link_active | usbdev_resume_link_active | 0 | 0 | -- | ||
| V2 | device_address | usbdev_device_address | 0 | 0 | -- | ||
| V2 | link_in_err | usbdev_link_in_err | 0 | 0 | -- | ||
| V2 | rx_crc_err | usbdev_rx_crc_err | 0 | 0 | -- | ||
| V2 | rx_pid_err | usbdev_rx_pid_err | 0 | 0 | -- | ||
| V2 | rx_bitstuff_err | usbdev_rx_bitstuff_err | 0 | 0 | -- | ||
| V2 | link_out_err | usbdev_link_out_err | 0 | 0 | -- | ||
| V2 | invalid_data1_data0_toggle_test | usbdev_invalid_data1_data0_toggle_test | 0 | 0 | -- | ||
| V2 | setup_stage | usbdev_setup_stage | 0 | 0 | -- | ||
| V2 | in_data_stage | usbdev_in_data_stage | 0 | 0 | -- | ||
| V2 | out_data_stage | usbdev_out_data_stage | 0 | 0 | -- | ||
| V2 | out_status_stage | usbdev_out_status_stage | 0 | 0 | -- | ||
| V2 | in_status_stage | usbdev_in_status_stage | 0 | 0 | -- | ||
| V2 | endpoint_access | usbdev_endpoint_access | 0 | 0 | -- | ||
| V2 | disable_endpoint | usbdev_disable_endpoint | 0 | 0 | -- | ||
| V2 | out_trans_nak | usbdev_out_trans_nak | 0 | 0 | -- | ||
| V2 | setup_trans_ignored | usbdev_setup_trans_ignored | 0 | 0 | -- | ||
| V2 | nak_trans | usbdev_nak_trans | 0 | 0 | -- | ||
| V2 | stall_trans | usbdev_stall_trans | 0 | 0 | -- | ||
| V2 | setup_priority_over_stall_response | usbdev_setup_priority_over_stall_response | 0 | 0 | -- | ||
| V2 | stall_priority_over_NAK | usbdev_stall_priority_over_NAK | 0 | 0 | -- | ||
| V2 | pending_in_trans | usbdev_pending_in_trans | 0 | 0 | -- | ||
| V2 | streaming_test | usbdev_streaming_test | 0 | 0 | -- | ||
| V2 | max_clock_error | usbdev_max_clock_error | 0 | 0 | -- | ||
| V2 | max_phase_error | usbdev_max_phase_error | 0 | 0 | -- | ||
| V2 | min_inter_pkt_delay | usbdev_min_inter_pkt_delay | 0 | 0 | -- | ||
| V2 | max_inter_pkt_delay | usbdev_max_inter_pkt_delay | 0 | 0 | -- | ||
| V2 | device_timeout_missing_host_handshake | usbdev_device_timeout_missing_host_handshake | 0 | 0 | -- | ||
| V2 | device_timeout | usbdev_device_timeout | 0 | 0 | -- | ||
| V2 | nak_to_out_trans_when_avbuffer_empty_rxfifo_full | usbdev_nak_to_out_trans_when_avbuffer_empty_rxfifo_full | 0 | 0 | -- | ||
| V2 | intr_test | usbdev_intr_test | 0.770s | 133.592us | 43 | 50 | 86.00 |
| V2 | alert_test | usbdev_alert_test | 0 | 0 | -- | ||
| V2 | tl_d_oob_addr_access | usbdev_tl_errors | 3.050s | 316.120us | 20 | 20 | 100.00 |
| V2 | tl_d_illegal_access | usbdev_tl_errors | 3.050s | 316.120us | 20 | 20 | 100.00 |
| V2 | tl_d_outstanding_access | usbdev_csr_hw_reset | 0.860s | 54.213us | 4 | 5 | 80.00 |
| usbdev_csr_rw | 1.090s | 98.476us | 20 | 20 | 100.00 | ||
| usbdev_csr_aliasing | 3.210s | 224.974us | 5 | 5 | 100.00 | ||
| usbdev_same_csr_outstanding | 1.580s | 62.089us | 19 | 20 | 95.00 | ||
| V2 | tl_d_partial_access | usbdev_csr_hw_reset | 0.860s | 54.213us | 4 | 5 | 80.00 |
| usbdev_csr_rw | 1.090s | 98.476us | 20 | 20 | 100.00 | ||
| usbdev_csr_aliasing | 3.210s | 224.974us | 5 | 5 | 100.00 | ||
| usbdev_same_csr_outstanding | 1.580s | 62.089us | 19 | 20 | 95.00 | ||
| V2 | TOTAL | 82 | 90 | 91.11 | |||
| V2S | tl_intg_err | usbdev_sec_cm | 1.310s | 501.564us | 3 | 5 | 60.00 |
| usbdev_tl_intg_err | 5.440s | 502.051us | 14 | 20 | 70.00 | ||
| V2S | sec_cm_bus_integrity | usbdev_tl_intg_err | 5.440s | 502.051us | 14 | 20 | 70.00 |
| V2S | TOTAL | 17 | 25 | 68.00 | |||
| V3 | TOTAL | 0 | 0 | -- | |||
| Unmapped tests | usbdev_stress_all_with_rand_reset | 0.700s | 95.828us | 0 | 50 | 0.00 | |
| usbdev_stress_all | 0.600s | 0 | 50 | 0.00 | |||
| TOTAL | 157 | 330 | 47.58 |
| Items | Total | Written | Passing | Progress |
|---|---|---|---|---|
| N.A. | 2 | 2 | 0 | 0.00 |
| V1 | 8 | 8 | 4 | 50.00 |
| V2 | 65 | 3 | 1 | 1.54 |
| V2S | 2 | 2 | 0 | 0.00 |
| SCORE | LINE | COND | TOGGLE | FSM | BRANCH | ASSERT | GROUP |
|---|---|---|---|---|---|---|---|
| 77.09 | 90.03 | 75.61 | 95.05 | 3.12 | 87.16 | 92.01 | 96.65 |
UVM_WARNING [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory. has 99 failures:
0.usbdev_stress_all_with_rand_reset.35116183207534136272889835619134060441122717752755839854218749349954506402866
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 5125357 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 5125357 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all_with_rand_reset.51285925028811485243001530652176759586368951554019913524911437386509711832201
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 12901537 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 12901537 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 47 more failures.
0.usbdev_stress_all.74740376329260009844565083548064206341471358419277626815301031862888803475789
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all.75889415598614846759770488923971106813118258331229946654141336375829479937054
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
UVM_ERROR (usbdev_scoreboard.sv:74) [scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (* [*] vs * [*]) has 50 failures:
0.usbdev_smoke.26995643348949640082462821103704877852450512956949327068723133984931361774935
Line 264, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_smoke/latest/run.log
UVM_ERROR @ 8341841267 ps: (usbdev_scoreboard.sv:74) [uvm_test_top.env.scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (1 [0x1] vs 0 [0x0])
UVM_INFO @ 8341841267 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
1.usbdev_smoke.54669213237622499207373844990391662883056922790226010821211560630878064328722
Line 264, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_smoke/latest/run.log
UVM_ERROR @ 8339918251 ps: (usbdev_scoreboard.sv:74) [uvm_test_top.env.scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (1 [0x1] vs 0 [0x0])
UVM_INFO @ 8339918251 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 48 more failures.
UVM_FATAL (usb20_driver.sv:254) [driver] timeout waiting for usb_pullup has 11 failures:
Test usbdev_csr_bit_bash has 4 failures.
0.usbdev_csr_bit_bash.41559861472347321074914504905278381238165779113451342779450101232107017619073
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 501821602 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501821602 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
2.usbdev_csr_bit_bash.95910829811822090736371479882959520954065381971385665590139305114086284565561
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 502561084 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502561084 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 2 more failures.
Test usbdev_sec_cm has 2 failures.
1.usbdev_sec_cm.96116785126378787961052014784318993529624696988146812595009896619304423128225
Line 316, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_sec_cm/latest/run.log
UVM_FATAL @ 501564177 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501564177 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
4.usbdev_sec_cm.33606581508763355469947863866862813751889917240056525803396485827691289451789
Line 283, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_sec_cm/latest/run.log
UVM_FATAL @ 501567977 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501567977 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
Test usbdev_tl_intg_err has 5 failures.
5.usbdev_tl_intg_err.39760252525917863155524473765234791697301962033511851742257351083429767141599
Line 398, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/5.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 501730144 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501730144 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
7.usbdev_tl_intg_err.71702081429999616117216601363307939779628081665091725656670485723389944810974
Line 378, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/7.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 502145170 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502145170 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 3 more failures.
UVM_ERROR (cip_base_vseq.sv:455) [usbdev_common_vseq] Check failed exp_val == act_val (* [*] vs * [*]) when reading the intr CSRusbdev_reg_block.intr_state has 7 failures:
6.usbdev_intr_test.96202867587537334380030281721630114347126125853738804382141546813703051659064
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/6.usbdev_intr_test/latest/run.log
UVM_ERROR @ 14684109 ps: (cip_base_vseq.sv:455) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (93197 [0x16c0d] vs 125965 [0x1ec0d]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 14684109 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
9.usbdev_intr_test.23016681961832887714846242164139300605464572109379138657422238922280913181012
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/9.usbdev_intr_test/latest/run.log
UVM_ERROR @ 4155217 ps: (cip_base_vseq.sv:455) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (2278 [0x8e6] vs 35046 [0x88e6]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 4155217 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 5 more failures.
Job usbdev-sim-vcs_run_cover_reg_top killed due to: Exit reason: User job exceeded runlimit: User job timed out has 4 failures:
Test usbdev_same_csr_outstanding has 1 failures.
6.usbdev_same_csr_outstanding.60279064754751631046813176022340170648165657377299616464875710389081231846013
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/6.usbdev_same_csr_outstanding/latest/run.log
Job ID: smart:a0889b3e-f72d-4bec-a9ab-117e0b02f002
Test usbdev_csr_mem_rw_with_rand_reset has 2 failures.
8.usbdev_csr_mem_rw_with_rand_reset.98858219024719786727048128166216063916605979338199542961778106288327129867732
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/8.usbdev_csr_mem_rw_with_rand_reset/latest/run.log
Job ID: smart:1b565b61-1c28-4c8f-9775-10fdc04ddcf5
13.usbdev_csr_mem_rw_with_rand_reset.1678488546624583650899543774467243903077845280812067421691986545555256207770
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/13.usbdev_csr_mem_rw_with_rand_reset/latest/run.log
Job ID: smart:0528647f-20a3-4420-a6d1-89de9b6a3456
Test usbdev_tl_intg_err has 1 failures.
11.usbdev_tl_intg_err.100148042810215307444958558927345466003459780952778297756120521845363170883163
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/11.usbdev_tl_intg_err/latest/run.log
Job ID: smart:9fef5df4-eff7-4868-a00b-cb49d89d089e
Error-[SV-WMIBC] Width mismatch in bit-stream casting has 1 failures:
1.usbdev_csr_hw_reset.82254048853132434708597822132997090544154650344076086736924235549284316816324
Line 254, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_csr_hw_reset/latest/run.log
Error-[SV-WMIBC] Width mismatch in bit-stream casting
../src/lowrisc_dv_usb20_agent_0.1/usb20_monitor.sv, 122
Source size is 3 bit(s) whereas destination size is 35 bit(s).
Please make sure that both source and destination are of same size.
Job usbdev-sim-vcs_run_default killed due to: Exit reason: User job exceeded runlimit: User job timed out has 1 failures:
3.usbdev_stress_all_with_rand_reset.56253722695301810431645244596158361290464498776536098194700188635229589569411
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/3.usbdev_stress_all_with_rand_reset/latest/run.log
Job ID: smart:f443bc18-8a82-4d40-9956-a71ff04e55ad