0dd29ab736
Stage | Name | Tests | Max Job Runtime | Simulated Time | Passing | Total | Pass Rate |
---|---|---|---|---|---|---|---|
V1 | smoke | usbdev_smoke | 9.790s | 8.369ms | 48 | 50 | 96.00 |
V1 | csr_hw_reset | usbdev_csr_hw_reset | 0.740s | 37.163us | 4 | 5 | 80.00 |
V1 | csr_rw | usbdev_csr_rw | 1.090s | 82.204us | 19 | 20 | 95.00 |
V1 | csr_bit_bash | usbdev_csr_bit_bash | 4.840s | 302.277us | 1 | 5 | 20.00 |
V1 | csr_aliasing | usbdev_csr_aliasing | 3.330s | 312.818us | 4 | 5 | 80.00 |
V1 | csr_mem_rw_with_rand_reset | usbdev_csr_mem_rw_with_rand_reset | 2.190s | 60.478us | 19 | 20 | 95.00 |
V1 | regwen_csr_and_corresponding_lockable_csr | usbdev_csr_rw | 1.090s | 82.204us | 19 | 20 | 95.00 |
usbdev_csr_aliasing | 3.330s | 312.818us | 4 | 5 | 80.00 | ||
V1 | mem_walk | usbdev_mem_walk | 3.400s | 502.401us | 4 | 5 | 80.00 |
V1 | mem_partial_access | usbdev_mem_partial_access | 2.160s | 71.249us | 5 | 5 | 100.00 |
V1 | TOTAL | 104 | 115 | 90.43 | |||
V2 | in_trans | usbdev_in_trans | 0 | 0 | -- | ||
V2 | data_toggle_clear | usbdev_data_toggle_clear | 0 | 0 | -- | ||
V2 | phy_pins_sense | usbdev_phy_pins_sense | 0 | 0 | -- | ||
V2 | wake_events | usbdev_wake_events | 0 | 0 | -- | ||
V2 | av_buffer | usbdev_av_buffer | 0 | 0 | -- | ||
V2 | rx_fifo | usbdev_rx_fifo | 0 | 0 | -- | ||
V2 | phy_config_tx_osc_test_mode | usbdev_phy_config_tx_osc_test_mode | 0 | 0 | -- | ||
V2 | phy_config_eop_single_bit_handling | usbdev_phy_config_eop_single_bit_handling | 0 | 0 | -- | ||
V2 | phy_config_pinflip | usbdev_phy_config_pinflip | 0 | 0 | -- | ||
V2 | phy_config_usb_ref_disable | usbdev_phy_config_usb_ref_disable | 0 | 0 | -- | ||
V2 | max_length_out_transaction | usbdev_max_length_out_transaction | 0 | 0 | -- | ||
V2 | max_length_in_transaction | usbdev_max_length_in_transaction | 0 | 0 | -- | ||
V2 | min_length_out_transaction | usbdev_min_length_out_transaction | 0 | 0 | -- | ||
V2 | min_length_in_transaction | usbdev_min_length_in_transaction | 0 | 0 | -- | ||
V2 | random_length_out_trans | usbdev_random_length_out_trans | 0 | 0 | -- | ||
V2 | random_length_in_trans | usbdev_random_length_in_trans | 0 | 0 | -- | ||
V2 | out_stall | usbdev_out_stall | 0 | 0 | -- | ||
V2 | in_stall | usbdev_in_stall | 0 | 0 | -- | ||
V2 | out_iso | usbdev_out_iso | 0 | 0 | -- | ||
V2 | in_iso | usbdev_in_iso | 0 | 0 | -- | ||
V2 | pkt_received | usbdev_pkt_received | 9.870s | 8.347ms | 37 | 50 | 74.00 |
V2 | pkt_sent | usbdev_pkt_sent | 0 | 0 | -- | ||
V2 | disconnected | usbdev_disconnected | 0 | 0 | -- | ||
V2 | host_lost | usbdev_host_lost | 0 | 0 | -- | ||
V2 | link_reset | usbdev_link_reset | 0 | 0 | -- | ||
V2 | link_suspend | usbdev_link_suspend | 0 | 0 | -- | ||
V2 | link_resume | usbdev_link_resume | 0 | 0 | -- | ||
V2 | av_empty | usbdev_av_empty | 0 | 0 | -- | ||
V2 | rx_full | usbdev_rx_full | 0 | 0 | -- | ||
V2 | av_overflow | usbdev_av_overflow | 0 | 0 | -- | ||
V2 | enable | usbdev_enable | 0 | 0 | -- | ||
V2 | resume_link_active | usbdev_resume_link_active | 0 | 0 | -- | ||
V2 | device_address | usbdev_device_address | 0 | 0 | -- | ||
V2 | link_in_err | usbdev_link_in_err | 0 | 0 | -- | ||
V2 | rx_crc_err | usbdev_rx_crc_err | 0 | 0 | -- | ||
V2 | rx_pid_err | usbdev_rx_pid_err | 0 | 0 | -- | ||
V2 | rx_bitstuff_err | usbdev_rx_bitstuff_err | 0 | 0 | -- | ||
V2 | link_out_err | usbdev_link_out_err | 0 | 0 | -- | ||
V2 | invalid_data1_data0_toggle_test | usbdev_invalid_data1_data0_toggle_test | 0 | 0 | -- | ||
V2 | setup_stage | usbdev_setup_stage | 0 | 0 | -- | ||
V2 | in_data_stage | usbdev_in_data_stage | 0 | 0 | -- | ||
V2 | out_data_stage | usbdev_out_data_stage | 0 | 0 | -- | ||
V2 | out_status_stage | usbdev_out_status_stage | 0 | 0 | -- | ||
V2 | in_status_stage | usbdev_in_status_stage | 0 | 0 | -- | ||
V2 | endpoint_access | usbdev_endpoint_access | 0 | 0 | -- | ||
V2 | disable_endpoint | usbdev_disable_endpoint | 0 | 0 | -- | ||
V2 | out_trans_nak | usbdev_out_trans_nak | 0 | 0 | -- | ||
V2 | setup_trans_ignored | usbdev_setup_trans_ignored | 0 | 0 | -- | ||
V2 | nak_trans | usbdev_nak_trans | 0 | 0 | -- | ||
V2 | stall_trans | usbdev_stall_trans | 0 | 0 | -- | ||
V2 | setup_priority_over_stall_response | usbdev_setup_priority_over_stall_response | 0 | 0 | -- | ||
V2 | stall_priority_over_NAK | usbdev_stall_priority_over_NAK | 0 | 0 | -- | ||
V2 | pending_in_trans | usbdev_pending_in_trans | 0 | 0 | -- | ||
V2 | streaming_test | usbdev_streaming_test | 0 | 0 | -- | ||
V2 | max_clock_error | usbdev_max_clock_error | 0 | 0 | -- | ||
V2 | max_phase_error | usbdev_max_phase_error | 0 | 0 | -- | ||
V2 | min_inter_pkt_delay | usbdev_min_inter_pkt_delay | 0 | 0 | -- | ||
V2 | max_inter_pkt_delay | usbdev_max_inter_pkt_delay | 0 | 0 | -- | ||
V2 | device_timeout_missing_host_handshake | usbdev_device_timeout_missing_host_handshake | 0 | 0 | -- | ||
V2 | device_timeout | usbdev_device_timeout | 0 | 0 | -- | ||
V2 | nak_to_out_trans_when_avbuffer_empty_rxfifo_full | usbdev_nak_to_out_trans_when_avbuffer_empty_rxfifo_full | 0 | 0 | -- | ||
V2 | intr_test | usbdev_intr_test | 0.780s | 90.683us | 35 | 50 | 70.00 |
V2 | alert_test | usbdev_alert_test | 0 | 0 | -- | ||
V2 | tl_d_oob_addr_access | usbdev_tl_errors | 2.990s | 275.699us | 19 | 20 | 95.00 |
V2 | tl_d_illegal_access | usbdev_tl_errors | 2.990s | 275.699us | 19 | 20 | 95.00 |
V2 | tl_d_outstanding_access | usbdev_csr_hw_reset | 0.740s | 37.163us | 4 | 5 | 80.00 |
usbdev_csr_rw | 1.090s | 82.204us | 19 | 20 | 95.00 | ||
usbdev_csr_aliasing | 3.330s | 312.818us | 4 | 5 | 80.00 | ||
usbdev_same_csr_outstanding | 1.430s | 72.773us | 20 | 20 | 100.00 | ||
V2 | tl_d_partial_access | usbdev_csr_hw_reset | 0.740s | 37.163us | 4 | 5 | 80.00 |
usbdev_csr_rw | 1.090s | 82.204us | 19 | 20 | 95.00 | ||
usbdev_csr_aliasing | 3.330s | 312.818us | 4 | 5 | 80.00 | ||
usbdev_same_csr_outstanding | 1.430s | 72.773us | 20 | 20 | 100.00 | ||
V2 | TOTAL | 111 | 140 | 79.29 | |||
V2S | tl_intg_err | usbdev_sec_cm | 1.450s | 501.975us | 3 | 5 | 60.00 |
usbdev_tl_intg_err | 4.970s | 502.553us | 13 | 20 | 65.00 | ||
V2S | sec_cm_bus_integrity | usbdev_tl_intg_err | 4.970s | 502.553us | 13 | 20 | 65.00 |
V2S | TOTAL | 16 | 25 | 64.00 | |||
V3 | TOTAL | 0 | 0 | -- | |||
Unmapped tests | usbdev_stress_all_with_rand_reset | 0.660s | 23.953us | 0 | 50 | 0.00 | |
usbdev_stress_all | 0.610s | 0 | 50 | 0.00 | |||
TOTAL | 231 | 380 | 60.79 |
Items | Total | Written | Passing | Progress |
---|---|---|---|---|
N.A. | 2 | 2 | 0 | 0.00 |
V1 | 8 | 8 | 1 | 12.50 |
V2 | 65 | 4 | 1 | 1.54 |
V2S | 2 | 2 | 0 | 0.00 |
SCORE | LINE | COND | TOGGLE | FSM | BRANCH | ASSERT | GROUP |
---|---|---|---|---|---|---|---|
84.14 | 94.26 | 82.58 | 97.14 | 31.25 | 92.22 | 95.05 | 96.47 |
UVM_WARNING [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
has 100 failures:
0.usbdev_stress_all_with_rand_reset.53454749164610553685703345824618192732824155683173421216581787837119816342382
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 4015344 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 4015344 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all_with_rand_reset.34446653808036129836360479607092163790947782154127710703581881349662636492527
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 7646046 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 7646046 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
0.usbdev_stress_all.20115770529730098856739974480753394449008128882084667692284291316515143334576
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all.45366003085003787926527126582739880185973339245743051557548205520807082166803
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
UVM_ERROR (cip_base_vseq.sv:455) [usbdev_common_vseq] Check failed exp_val == act_val (* [*] vs * [*]) when reading the intr CSRusbdev_reg_block.intr_state
has 15 failures:
3.usbdev_intr_test.100351631876694413139575000534247862070068068288534467070626003548566613379636
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/3.usbdev_intr_test/latest/run.log
UVM_ERROR @ 23883009 ps: (cip_base_vseq.sv:455) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (7325 [0x1c9d] vs 40093 [0x9c9d]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 23883009 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
9.usbdev_intr_test.37493218104929160106512857268817710474547586359089168411931883377036259463279
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/9.usbdev_intr_test/latest/run.log
UVM_ERROR @ 5321021 ps: (cip_base_vseq.sv:455) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (65758 [0x100de] vs 98526 [0x180de]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 5321021 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 13 more failures.
UVM_FATAL (usb20_driver.sv:254) [driver] timeout waiting for usb_pullup
has 13 failures:
Test usbdev_sec_cm has 2 failures.
0.usbdev_sec_cm.30466311258491888437796833931481468445083239764783310091370792163459804959647
Line 279, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_sec_cm/latest/run.log
UVM_FATAL @ 501891024 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501891024 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
4.usbdev_sec_cm.36711884034693141507276143217076909070202929987759257202425632187892070008360
Line 330, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_sec_cm/latest/run.log
UVM_FATAL @ 501975334 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501975334 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
Test usbdev_tl_intg_err has 6 failures.
0.usbdev_tl_intg_err.67203959926252987878768198142901913267350473044517740447812570550413030432752
Line 347, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 501976022 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501976022 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
6.usbdev_tl_intg_err.63205336997901752737389170943959662854573731895197702308943426480074676783277
Line 390, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/6.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 502148175 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502148175 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 4 more failures.
Test usbdev_csr_bit_bash has 4 failures.
1.usbdev_csr_bit_bash.66630123842885994027202774262379814667027640209762784783316689616829431676664
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 501899511 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501899511 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
2.usbdev_csr_bit_bash.87239537182006090210916255498733909895231876044765573580226077211814026511131
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 502307367 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502307367 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 2 more failures.
Test usbdev_mem_walk has 1 failures.
4.usbdev_mem_walk.31938262829838672061878876927962598201639349092480590844159242266544556499153
Line 262, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_mem_walk/latest/run.log
UVM_FATAL @ 502400613 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502400613 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
Exit reason: Error: User command failed Error-[SV-WMIBC] Width mismatch in bit-stream casting
has 10 failures:
Test usbdev_csr_hw_reset has 1 failures.
3.usbdev_csr_hw_reset.91023148845781044162794308887862688926825945894606615934947386339070384318492
Line 253, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/3.usbdev_csr_hw_reset/latest/run.log
Error-[SV-WMIBC] Width mismatch in bit-stream casting
../src/lowrisc_dv_usb20_agent_0.1/usb20_monitor.sv, 121
Source size is 3 bit(s) whereas destination size is 35 bit(s).
Please make sure that both source and destination are of same size.
Test usbdev_pkt_received has 9 failures.
4.usbdev_pkt_received.109362892760552661643483018390639130209619199474317756960649413867245860998978
Line 263, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_pkt_received/latest/run.log
Error-[SV-WMIBC] Width mismatch in bit-stream casting
../src/lowrisc_dv_usb20_agent_0.1/usb20_monitor.sv, 121
Source size is 34 bit(s) whereas destination size is 35 bit(s).
Please make sure that both source and destination are of same size.
12.usbdev_pkt_received.98921191496679960205608215374662663111489196341880001000826943149511333270619
Line 263, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/12.usbdev_pkt_received/latest/run.log
Error-[SV-WMIBC] Width mismatch in bit-stream casting
../src/lowrisc_dv_usb20_agent_0.1/usb20_monitor.sv, 121
Source size is 34 bit(s) whereas destination size is 35 bit(s).
Please make sure that both source and destination are of same size.
... and 7 more failures.
Job usbdev-sim-vcs_run_cover_reg_top killed due to: Exit reason: User job exceeded runlimit: User job timed out
has 5 failures:
Test usbdev_csr_aliasing has 1 failures.
0.usbdev_csr_aliasing.103949156305964472626159964113834122725354235802307966602739246909237249909107
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_csr_aliasing/latest/run.log
Job ID: smart:6a42644e-3580-49b2-8757-63142b3815ec
Test usbdev_csr_rw has 1 failures.
2.usbdev_csr_rw.2067759741402983531288683057600558330506385254130088449832889639851776145639
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_csr_rw/latest/run.log
Job ID: smart:d6c21d90-eb17-4063-b753-e03a655709af
Test usbdev_tl_intg_err has 1 failures.
4.usbdev_tl_intg_err.48375772527899435460461780027719451501930108321488705043875646164923732069992
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_tl_intg_err/latest/run.log
Job ID: smart:52354b87-f5de-4f0c-85a7-88fd377e87f2
Test usbdev_tl_errors has 1 failures.
8.usbdev_tl_errors.75069834869830593181423867106852153030520769942400972494631784407898992016855
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/8.usbdev_tl_errors/latest/run.log
Job ID: smart:df59e2ea-c9de-41bf-b753-78503cedb7a1
Test usbdev_csr_mem_rw_with_rand_reset has 1 failures.
19.usbdev_csr_mem_rw_with_rand_reset.62223577891564513665724714844004308116771074957699526082514202682940235391985
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/19.usbdev_csr_mem_rw_with_rand_reset/latest/run.log
Job ID: smart:f4287fd0-3550-439b-9d43-e2020a800179
UVM_ERROR (usbdev_scoreboard.sv:112) [scoreboard] Check failed actual_pkt_q.pop_front() == expected_pkt_q.pop_front() (* [*] vs * [*])
has 4 failures:
1.usbdev_pkt_received.43769166797496267732923704406643402512420746048849290916320084336470622931573
Line 281, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_pkt_received/latest/run.log
UVM_ERROR @ 8360186569 ps: (usbdev_scoreboard.sv:112) [uvm_test_top.env.scoreboard] Check failed actual_pkt_q.pop_front() == expected_pkt_q.pop_front() (23455904797824 [0x155543928e40] vs 23455904798816 [0x155543928e40])
UVM_INFO @ 8360186569 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
6.usbdev_pkt_received.112048181027657559790372555334683435381872068117695117169045207964143321543077
Line 277, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/6.usbdev_pkt_received/latest/run.log
UVM_ERROR @ 8346586082 ps: (usbdev_scoreboard.sv:112) [uvm_test_top.env.scoreboard] Check failed actual_pkt_q.pop_front() == expected_pkt_q.pop_front() (23455904806016 [0x155543928e40] vs 23455904807008 [0x155543928e40])
UVM_INFO @ 8346586082 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 2 more failures.
Job usbdev-sim-vcs_run_default killed due to: Exit reason: User job exceeded runlimit: User job timed out
has 2 failures:
17.usbdev_smoke.53606277002445357861972069802719617122380008711842663717331510743777831725924
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/17.usbdev_smoke/latest/run.log
Job ID: smart:d5bf4073-19df-49a3-b215-1f41622e3740
27.usbdev_smoke.48642439868888999397890257726588654780633538634461836587622391743981934153086
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/27.usbdev_smoke/latest/run.log
Job ID: smart:df9cebc9-131f-438f-86a3-913edb2e7fb5