5f48fbc0e7
Stage | Name | Tests | Max Job Runtime | Simulated Time | Passing | Total | Pass Rate |
---|---|---|---|---|---|---|---|
V1 | smoke | usbdev_smoke | 10.090s | 8.342ms | 0 | 50 | 0.00 |
V1 | csr_hw_reset | usbdev_csr_hw_reset | 0.830s | 78.084us | 4 | 5 | 80.00 |
V1 | csr_rw | usbdev_csr_rw | 1.050s | 70.131us | 18 | 20 | 90.00 |
V1 | csr_bit_bash | usbdev_csr_bit_bash | 8.840s | 450.363us | 3 | 5 | 60.00 |
V1 | csr_aliasing | usbdev_csr_aliasing | 3.750s | 312.368us | 5 | 5 | 100.00 |
V1 | csr_mem_rw_with_rand_reset | usbdev_csr_mem_rw_with_rand_reset | 2.210s | 66.369us | 20 | 20 | 100.00 |
V1 | regwen_csr_and_corresponding_lockable_csr | usbdev_csr_rw | 1.050s | 70.131us | 18 | 20 | 90.00 |
usbdev_csr_aliasing | 3.750s | 312.368us | 5 | 5 | 100.00 | ||
V1 | mem_walk | usbdev_mem_walk | 3.780s | 149.338us | 3 | 5 | 60.00 |
V1 | mem_partial_access | usbdev_mem_partial_access | 2.290s | 63.944us | 5 | 5 | 100.00 |
V1 | TOTAL | 58 | 115 | 50.43 | |||
V2 | in_trans | usbdev_in_trans | 0 | 0 | -- | ||
V2 | data_toggle_clear | usbdev_data_toggle_clear | 0 | 0 | -- | ||
V2 | phy_pins_sense | usbdev_phy_pins_sense | 0 | 0 | -- | ||
V2 | wake_events | usbdev_wake_events | 0 | 0 | -- | ||
V2 | av_buffer | usbdev_av_buffer | 0 | 0 | -- | ||
V2 | rx_fifo | usbdev_rx_fifo | 0 | 0 | -- | ||
V2 | phy_config_tx_osc_test_mode | usbdev_phy_config_tx_osc_test_mode | 0 | 0 | -- | ||
V2 | phy_config_eop_single_bit_handling | usbdev_phy_config_eop_single_bit_handling | 0 | 0 | -- | ||
V2 | phy_config_pinflip | usbdev_phy_config_pinflip | 0 | 0 | -- | ||
V2 | phy_config_usb_ref_disable | usbdev_phy_config_usb_ref_disable | 0 | 0 | -- | ||
V2 | max_length_out_transaction | usbdev_max_length_out_transaction | 0 | 0 | -- | ||
V2 | max_length_in_transaction | usbdev_max_length_in_transaction | 0 | 0 | -- | ||
V2 | min_length_out_transaction | usbdev_min_length_out_transaction | 0 | 0 | -- | ||
V2 | min_length_in_transaction | usbdev_min_length_in_transaction | 0 | 0 | -- | ||
V2 | random_length_out_trans | usbdev_random_length_out_trans | 0 | 0 | -- | ||
V2 | random_length_in_trans | usbdev_random_length_in_trans | 0 | 0 | -- | ||
V2 | out_stall | usbdev_out_stall | 0 | 0 | -- | ||
V2 | in_stall | usbdev_in_stall | 0 | 0 | -- | ||
V2 | out_iso | usbdev_out_iso | 0 | 0 | -- | ||
V2 | in_iso | usbdev_in_iso | 0 | 0 | -- | ||
V2 | pkt_received | usbdev_pkt_received | 0 | 0 | -- | ||
V2 | pkt_sent | usbdev_pkt_sent | 0 | 0 | -- | ||
V2 | disconnected | usbdev_disconnected | 0 | 0 | -- | ||
V2 | host_lost | usbdev_host_lost | 0 | 0 | -- | ||
V2 | link_reset | usbdev_link_reset | 0 | 0 | -- | ||
V2 | link_suspend | usbdev_link_suspend | 0 | 0 | -- | ||
V2 | link_resume | usbdev_link_resume | 0 | 0 | -- | ||
V2 | av_empty | usbdev_av_empty | 0 | 0 | -- | ||
V2 | rx_full | usbdev_rx_full | 0 | 0 | -- | ||
V2 | av_overflow | usbdev_av_overflow | 0 | 0 | -- | ||
V2 | enable | usbdev_enable | 0 | 0 | -- | ||
V2 | resume_link_active | usbdev_resume_link_active | 0 | 0 | -- | ||
V2 | device_address | usbdev_device_address | 0 | 0 | -- | ||
V2 | link_in_err | usbdev_link_in_err | 0 | 0 | -- | ||
V2 | rx_crc_err | usbdev_rx_crc_err | 0 | 0 | -- | ||
V2 | rx_pid_err | usbdev_rx_pid_err | 0 | 0 | -- | ||
V2 | rx_bitstuff_err | usbdev_rx_bitstuff_err | 0 | 0 | -- | ||
V2 | link_out_err | usbdev_link_out_err | 0 | 0 | -- | ||
V2 | invalid_data1_data0_toggle_test | usbdev_invalid_data1_data0_toggle_test | 0 | 0 | -- | ||
V2 | setup_stage | usbdev_setup_stage | 0 | 0 | -- | ||
V2 | in_data_stage | usbdev_in_data_stage | 0 | 0 | -- | ||
V2 | out_data_stage | usbdev_out_data_stage | 0 | 0 | -- | ||
V2 | out_status_stage | usbdev_out_status_stage | 0 | 0 | -- | ||
V2 | in_status_stage | usbdev_in_status_stage | 0 | 0 | -- | ||
V2 | endpoint_access | usbdev_endpoint_access | 0 | 0 | -- | ||
V2 | disable_endpoint | usbdev_disable_endpoint | 0 | 0 | -- | ||
V2 | out_trans_nak | usbdev_out_trans_nak | 0 | 0 | -- | ||
V2 | setup_trans_ignored | usbdev_setup_trans_ignored | 0 | 0 | -- | ||
V2 | nak_trans | usbdev_nak_trans | 0 | 0 | -- | ||
V2 | stall_trans | usbdev_stall_trans | 0 | 0 | -- | ||
V2 | setup_priority_over_stall_response | usbdev_setup_priority_over_stall_response | 0 | 0 | -- | ||
V2 | stall_priority_over_NAK | usbdev_stall_priority_over_NAK | 0 | 0 | -- | ||
V2 | pending_in_trans | usbdev_pending_in_trans | 0 | 0 | -- | ||
V2 | streaming_test | usbdev_streaming_test | 0 | 0 | -- | ||
V2 | max_clock_error | usbdev_max_clock_error | 0 | 0 | -- | ||
V2 | max_phase_error | usbdev_max_phase_error | 0 | 0 | -- | ||
V2 | min_inter_pkt_delay | usbdev_min_inter_pkt_delay | 0 | 0 | -- | ||
V2 | max_inter_pkt_delay | usbdev_max_inter_pkt_delay | 0 | 0 | -- | ||
V2 | device_timeout_missing_host_handshake | usbdev_device_timeout_missing_host_handshake | 0 | 0 | -- | ||
V2 | device_timeout | usbdev_device_timeout | 0 | 0 | -- | ||
V2 | nak_to_out_trans_when_avbuffer_empty_rxfifo_full | usbdev_nak_to_out_trans_when_avbuffer_empty_rxfifo_full | 0 | 0 | -- | ||
V2 | intr_test | usbdev_intr_test | 0.720s | 25.902us | 37 | 50 | 74.00 |
V2 | alert_test | usbdev_alert_test | 0 | 0 | -- | ||
V2 | tl_d_oob_addr_access | usbdev_tl_errors | 3.200s | 99.503us | 20 | 20 | 100.00 |
V2 | tl_d_illegal_access | usbdev_tl_errors | 3.200s | 99.503us | 20 | 20 | 100.00 |
V2 | tl_d_outstanding_access | usbdev_csr_hw_reset | 0.830s | 78.084us | 4 | 5 | 80.00 |
usbdev_csr_rw | 1.050s | 70.131us | 18 | 20 | 90.00 | ||
usbdev_csr_aliasing | 3.750s | 312.368us | 5 | 5 | 100.00 | ||
usbdev_same_csr_outstanding | 1.720s | 140.307us | 20 | 20 | 100.00 | ||
V2 | tl_d_partial_access | usbdev_csr_hw_reset | 0.830s | 78.084us | 4 | 5 | 80.00 |
usbdev_csr_rw | 1.050s | 70.131us | 18 | 20 | 90.00 | ||
usbdev_csr_aliasing | 3.750s | 312.368us | 5 | 5 | 100.00 | ||
usbdev_same_csr_outstanding | 1.720s | 140.307us | 20 | 20 | 100.00 | ||
V2 | TOTAL | 77 | 90 | 85.56 | |||
V2S | tl_intg_err | usbdev_sec_cm | 1.220s | 502.320us | 4 | 5 | 80.00 |
usbdev_tl_intg_err | 5.360s | 501.808us | 14 | 20 | 70.00 | ||
V2S | sec_cm_bus_integrity | usbdev_tl_intg_err | 5.360s | 501.808us | 14 | 20 | 70.00 |
V2S | TOTAL | 18 | 25 | 72.00 | |||
V3 | TOTAL | 0 | 0 | -- | |||
Unmapped tests | usbdev_stress_all_with_rand_reset | 0.630s | 6.570us | 0 | 50 | 0.00 | |
usbdev_stress_all | 0.610s | 0 | 50 | 0.00 | |||
TOTAL | 153 | 330 | 46.36 |
Items | Total | Written | Passing | Progress |
---|---|---|---|---|
N.A. | 2 | 2 | 0 | 0.00 |
V1 | 8 | 8 | 3 | 37.50 |
V2 | 65 | 3 | 2 | 3.08 |
V2S | 2 | 2 | 0 | 0.00 |
SCORE | LINE | COND | TOGGLE | FSM | BRANCH | ASSERT | GROUP |
---|---|---|---|---|---|---|---|
77.02 | 89.84 | 75.69 | 95.05 | 3.12 | 87.16 | 92.01 | 96.28 |
UVM_WARNING [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
has 100 failures:
0.usbdev_stress_all_with_rand_reset.36795494967829629049140731323473600192436998189597505682779599012682570428531
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 4274230 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 4274230 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all_with_rand_reset.88735422638309384084084271036811179996113646785036943462887223956608627874377
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 3546904 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 3546904 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
0.usbdev_stress_all.2243346866372598907813176789156089396767334753245944226226131685568286980563
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all.106372843003114516405516985452057154609617345081044921290739842644757929418792
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
UVM_ERROR (usbdev_scoreboard.sv:74) [scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (* [*] vs * [*])
has 49 failures:
0.usbdev_smoke.63503806486638831061348195703032067736840828489957290694644873471105602164161
Line 264, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_smoke/latest/run.log
UVM_ERROR @ 8347266167 ps: (usbdev_scoreboard.sv:74) [uvm_test_top.env.scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (1 [0x1] vs 0 [0x0])
UVM_INFO @ 8347266167 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
1.usbdev_smoke.113712237394701557537383047955703142623799006003579156609072201760813974754272
Line 264, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_smoke/latest/run.log
UVM_ERROR @ 8372517030 ps: (usbdev_scoreboard.sv:74) [uvm_test_top.env.scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (1 [0x1] vs 0 [0x0])
UVM_INFO @ 8372517030 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 47 more failures.
UVM_FATAL (usb20_driver.sv:254) [driver] timeout waiting for usb_pullup
has 11 failures:
Test usbdev_csr_bit_bash has 2 failures.
0.usbdev_csr_bit_bash.62046163832794502089383327099571683191112027265920266540288862314230039404052
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 502486054 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502486054 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
1.usbdev_csr_bit_bash.85445954801643768023509315480328314945678686924779781116543654915295334709345
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 502469696 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502469696 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
Test usbdev_tl_intg_err has 6 failures.
1.usbdev_tl_intg_err.43120424553337910029254671567158844704071361040847062651516834826440431664910
Line 396, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 501807566 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501807566 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
4.usbdev_tl_intg_err.115197509209331570123860993505039143207301309368058199088192295336384513349354
Line 360, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 501570912 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501570912 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 4 more failures.
Test usbdev_mem_walk has 2 failures.
2.usbdev_mem_walk.72649101702864709819402515098453320359690704907665364571887167882671774435412
Line 263, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_mem_walk/latest/run.log
UVM_FATAL @ 501568275 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501568275 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
4.usbdev_mem_walk.112480914928158873541042244968429987710447032307459927254428819281904967645741
Line 263, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_mem_walk/latest/run.log
UVM_FATAL @ 502304975 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502304975 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
Test usbdev_sec_cm has 1 failures.
4.usbdev_sec_cm.78035508626432004705805548747799715183101226484647720914979955999947129050608
Line 277, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_sec_cm/latest/run.log
UVM_FATAL @ 502319584 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502319584 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
UVM_ERROR (cip_base_vseq.sv:455) [usbdev_common_vseq] Check failed exp_val == act_val (* [*] vs * [*]) when reading the intr CSRusbdev_reg_block.intr_state
has 11 failures:
4.usbdev_intr_test.13227001112017427188453291974056438519895735721580300084349787057404479777103
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_intr_test/latest/run.log
UVM_ERROR @ 4337204 ps: (cip_base_vseq.sv:455) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (160 [0xa0] vs 32928 [0x80a0]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 4337204 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
15.usbdev_intr_test.58250411953927487303013836126954944751289720230587535117738044871278788800629
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/15.usbdev_intr_test/latest/run.log
UVM_ERROR @ 3939251 ps: (cip_base_vseq.sv:455) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (80468 [0x13a54] vs 113236 [0x1ba54]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 3939251 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 9 more failures.
Job usbdev-sim-vcs_run_cover_reg_top killed due to: Exit reason: User job exceeded runlimit: User job timed out
has 4 failures:
Test usbdev_csr_rw has 2 failures.
2.usbdev_csr_rw.104427535213880327149252011660105091735452124439817821433008070336961691243022
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_csr_rw/latest/run.log
Job ID: smart:b50332f0-c1ac-44b9-8620-be96914fb515
16.usbdev_csr_rw.3931183650103024308831430135379073626205774980882386669135696328591701617230
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/16.usbdev_csr_rw/latest/run.log
Job ID: smart:a605481a-85f2-4502-98ca-5b60a696bdf8
Test usbdev_intr_test has 2 failures.
14.usbdev_intr_test.101913918081057603252613023061382014930608982325387142896350011595390855496424
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/14.usbdev_intr_test/latest/run.log
Job ID: smart:da4daa25-d880-4331-9951-b4d876069732
16.usbdev_intr_test.22729959567223577123497724241318496901365089507394885451110000535503103538243
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/16.usbdev_intr_test/latest/run.log
Job ID: smart:f3739917-75f9-4e0b-a2e7-b468f1b9a32b
Error-[SV-WMIBC] Width mismatch in bit-stream casting
has 1 failures:
1.usbdev_csr_hw_reset.25494296670401109459858167493656616995171029693878612760771822252016521623314
Line 254, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_csr_hw_reset/latest/run.log
Error-[SV-WMIBC] Width mismatch in bit-stream casting
../src/lowrisc_dv_usb20_agent_0.1/usb20_monitor.sv, 122
Source size is 3 bit(s) whereas destination size is 35 bit(s).
Please make sure that both source and destination are of same size.
Job usbdev-sim-vcs_run_default killed due to: Exit reason: User job exceeded runlimit: User job timed out
has 1 failures:
39.usbdev_smoke.41531207573173916231386698662115973605609327725104008147830086556070103314809
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/39.usbdev_smoke/latest/run.log
Job ID: smart:ad1ecd27-d113-4255-a40c-1054e8ea524f