796f9fb805| Stage | Name | Tests | Max Job Runtime | Simulated Time | Passing | Total | Pass Rate |
|---|---|---|---|---|---|---|---|
| V1 | smoke | usbdev_smoke | 10.060s | 8.341ms | 0 | 50 | 0.00 |
| V1 | csr_hw_reset | usbdev_csr_hw_reset | 0.840s | 55.592us | 4 | 5 | 80.00 |
| V1 | csr_rw | usbdev_csr_rw | 1.060s | 61.394us | 19 | 20 | 95.00 |
| V1 | csr_bit_bash | usbdev_csr_bit_bash | 9.440s | 484.833us | 2 | 5 | 40.00 |
| V1 | csr_aliasing | usbdev_csr_aliasing | 3.680s | 313.431us | 5 | 5 | 100.00 |
| V1 | csr_mem_rw_with_rand_reset | usbdev_csr_mem_rw_with_rand_reset | 2.340s | 66.670us | 20 | 20 | 100.00 |
| V1 | regwen_csr_and_corresponding_lockable_csr | usbdev_csr_rw | 1.060s | 61.394us | 19 | 20 | 95.00 |
| usbdev_csr_aliasing | 3.680s | 313.431us | 5 | 5 | 100.00 | ||
| V1 | mem_walk | usbdev_mem_walk | 4.760s | 479.372us | 5 | 5 | 100.00 |
| V1 | mem_partial_access | usbdev_mem_partial_access | 2.350s | 196.359us | 5 | 5 | 100.00 |
| V1 | TOTAL | 60 | 115 | 52.17 | |||
| V2 | in_trans | usbdev_in_trans | 0 | 0 | -- | ||
| V2 | data_toggle_clear | usbdev_data_toggle_clear | 0 | 0 | -- | ||
| V2 | phy_pins_sense | usbdev_phy_pins_sense | 0 | 0 | -- | ||
| V2 | wake_events | usbdev_wake_events | 0 | 0 | -- | ||
| V2 | av_buffer | usbdev_av_buffer | 0 | 0 | -- | ||
| V2 | rx_fifo | usbdev_rx_fifo | 0 | 0 | -- | ||
| V2 | phy_config_tx_osc_test_mode | usbdev_phy_config_tx_osc_test_mode | 0 | 0 | -- | ||
| V2 | phy_config_eop_single_bit_handling | usbdev_phy_config_eop_single_bit_handling | 0 | 0 | -- | ||
| V2 | phy_config_pinflip | usbdev_phy_config_pinflip | 0 | 0 | -- | ||
| V2 | phy_config_usb_ref_disable | usbdev_phy_config_usb_ref_disable | 0 | 0 | -- | ||
| V2 | max_length_out_transaction | usbdev_max_length_out_transaction | 0 | 0 | -- | ||
| V2 | max_length_in_transaction | usbdev_max_length_in_transaction | 0 | 0 | -- | ||
| V2 | min_length_out_transaction | usbdev_min_length_out_transaction | 0 | 0 | -- | ||
| V2 | min_length_in_transaction | usbdev_min_length_in_transaction | 0 | 0 | -- | ||
| V2 | random_length_out_trans | usbdev_random_length_out_trans | 0 | 0 | -- | ||
| V2 | random_length_in_trans | usbdev_random_length_in_trans | 0 | 0 | -- | ||
| V2 | out_stall | usbdev_out_stall | 0 | 0 | -- | ||
| V2 | in_stall | usbdev_in_stall | 0 | 0 | -- | ||
| V2 | out_iso | usbdev_out_iso | 0 | 0 | -- | ||
| V2 | in_iso | usbdev_in_iso | 0 | 0 | -- | ||
| V2 | pkt_received | usbdev_pkt_received | 0 | 0 | -- | ||
| V2 | pkt_sent | usbdev_pkt_sent | 0 | 0 | -- | ||
| V2 | disconnected | usbdev_disconnected | 0 | 0 | -- | ||
| V2 | host_lost | usbdev_host_lost | 0 | 0 | -- | ||
| V2 | link_reset | usbdev_link_reset | 0 | 0 | -- | ||
| V2 | link_suspend | usbdev_link_suspend | 0 | 0 | -- | ||
| V2 | link_resume | usbdev_link_resume | 0 | 0 | -- | ||
| V2 | av_empty | usbdev_av_empty | 0 | 0 | -- | ||
| V2 | rx_full | usbdev_rx_full | 0 | 0 | -- | ||
| V2 | av_overflow | usbdev_av_overflow | 0 | 0 | -- | ||
| V2 | enable | usbdev_enable | 0 | 0 | -- | ||
| V2 | resume_link_active | usbdev_resume_link_active | 0 | 0 | -- | ||
| V2 | device_address | usbdev_device_address | 0 | 0 | -- | ||
| V2 | link_in_err | usbdev_link_in_err | 0 | 0 | -- | ||
| V2 | rx_crc_err | usbdev_rx_crc_err | 0 | 0 | -- | ||
| V2 | rx_pid_err | usbdev_rx_pid_err | 0 | 0 | -- | ||
| V2 | rx_bitstuff_err | usbdev_rx_bitstuff_err | 0 | 0 | -- | ||
| V2 | link_out_err | usbdev_link_out_err | 0 | 0 | -- | ||
| V2 | invalid_data1_data0_toggle_test | usbdev_invalid_data1_data0_toggle_test | 0 | 0 | -- | ||
| V2 | setup_stage | usbdev_setup_stage | 0 | 0 | -- | ||
| V2 | in_data_stage | usbdev_in_data_stage | 0 | 0 | -- | ||
| V2 | out_data_stage | usbdev_out_data_stage | 0 | 0 | -- | ||
| V2 | out_status_stage | usbdev_out_status_stage | 0 | 0 | -- | ||
| V2 | in_status_stage | usbdev_in_status_stage | 0 | 0 | -- | ||
| V2 | endpoint_access | usbdev_endpoint_access | 0 | 0 | -- | ||
| V2 | disable_endpoint | usbdev_disable_endpoint | 0 | 0 | -- | ||
| V2 | out_trans_nak | usbdev_out_trans_nak | 0 | 0 | -- | ||
| V2 | setup_trans_ignored | usbdev_setup_trans_ignored | 0 | 0 | -- | ||
| V2 | nak_trans | usbdev_nak_trans | 0 | 0 | -- | ||
| V2 | stall_trans | usbdev_stall_trans | 0 | 0 | -- | ||
| V2 | setup_priority_over_stall_response | usbdev_setup_priority_over_stall_response | 0 | 0 | -- | ||
| V2 | stall_priority_over_NAK | usbdev_stall_priority_over_NAK | 0 | 0 | -- | ||
| V2 | pending_in_trans | usbdev_pending_in_trans | 0 | 0 | -- | ||
| V2 | streaming_test | usbdev_streaming_test | 0 | 0 | -- | ||
| V2 | max_clock_error | usbdev_max_clock_error | 0 | 0 | -- | ||
| V2 | max_phase_error | usbdev_max_phase_error | 0 | 0 | -- | ||
| V2 | min_inter_pkt_delay | usbdev_min_inter_pkt_delay | 0 | 0 | -- | ||
| V2 | max_inter_pkt_delay | usbdev_max_inter_pkt_delay | 0 | 0 | -- | ||
| V2 | device_timeout_missing_host_handshake | usbdev_device_timeout_missing_host_handshake | 0 | 0 | -- | ||
| V2 | device_timeout | usbdev_device_timeout | 0 | 0 | -- | ||
| V2 | nak_to_out_trans_when_avbuffer_empty_rxfifo_full | usbdev_nak_to_out_trans_when_avbuffer_empty_rxfifo_full | 0 | 0 | -- | ||
| V2 | intr_test | usbdev_intr_test | 0.740s | 26.081us | 38 | 50 | 76.00 |
| V2 | alert_test | usbdev_alert_test | 0 | 0 | -- | ||
| V2 | tl_d_oob_addr_access | usbdev_tl_errors | 3.390s | 261.977us | 19 | 20 | 95.00 |
| V2 | tl_d_illegal_access | usbdev_tl_errors | 3.390s | 261.977us | 19 | 20 | 95.00 |
| V2 | tl_d_outstanding_access | usbdev_csr_hw_reset | 0.840s | 55.592us | 4 | 5 | 80.00 |
| usbdev_csr_rw | 1.060s | 61.394us | 19 | 20 | 95.00 | ||
| usbdev_csr_aliasing | 3.680s | 313.431us | 5 | 5 | 100.00 | ||
| usbdev_same_csr_outstanding | 1.760s | 62.147us | 20 | 20 | 100.00 | ||
| V2 | tl_d_partial_access | usbdev_csr_hw_reset | 0.840s | 55.592us | 4 | 5 | 80.00 |
| usbdev_csr_rw | 1.060s | 61.394us | 19 | 20 | 95.00 | ||
| usbdev_csr_aliasing | 3.680s | 313.431us | 5 | 5 | 100.00 | ||
| usbdev_same_csr_outstanding | 1.760s | 62.147us | 20 | 20 | 100.00 | ||
| V2 | TOTAL | 77 | 90 | 85.56 | |||
| V2S | tl_intg_err | usbdev_sec_cm | 1.290s | 501.566us | 3 | 5 | 60.00 |
| usbdev_tl_intg_err | 5.030s | 258.999us | 12 | 20 | 60.00 | ||
| V2S | sec_cm_bus_integrity | usbdev_tl_intg_err | 5.030s | 258.999us | 12 | 20 | 60.00 |
| V2S | TOTAL | 15 | 25 | 60.00 | |||
| V3 | TOTAL | 0 | 0 | -- | |||
| Unmapped tests | usbdev_stress_all_with_rand_reset | 0.680s | 38.525us | 0 | 50 | 0.00 | |
| usbdev_stress_all | 0.660s | 0 | 50 | 0.00 | |||
| TOTAL | 152 | 330 | 46.06 |
| Items | Total | Written | Passing | Progress |
|---|---|---|---|---|
| N.A. | 2 | 2 | 0 | 0.00 |
| V1 | 8 | 8 | 4 | 50.00 |
| V2 | 65 | 3 | 1 | 1.54 |
| V2S | 2 | 2 | 0 | 0.00 |
| SCORE | LINE | COND | TOGGLE | FSM | BRANCH | ASSERT | GROUP |
|---|---|---|---|---|---|---|---|
| 77.03 | 90.03 | 75.63 | 94.84 | 3.12 | 87.11 | 92.01 | 96.47 |
UVM_WARNING [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory. has 97 failures:
0.usbdev_stress_all_with_rand_reset.48027943422118710252595762778184649638827283056237667953682447066954537809775
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 8270404 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 8270404 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all_with_rand_reset.64255678172113226985858474215255568939617255190170963204047247149030896416939
Line 249, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all_with_rand_reset/latest/run.log
UVM_WARNING @ 4329540 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 4329540 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 45 more failures.
0.usbdev_stress_all.87777640055131279975488809106415856782875263973502170096182738719212014403875
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
1.usbdev_stress_all.20430353842075336379163552903108036540095665754201529304193496058248908287143
Line 248, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_stress_all/latest/run.log
UVM_WARNING @ 0 ps: [BDTYP] Cannot create an object of type 'usbdev_stress_all_vseq' because it is not registered with the factory.
UVM_INFO @ 0 ps: (uvm_factory.svh:1645) [UVM/FACTORY/PRINT]
#### Factory Configuration (*)
No instance overrides are registered with this factory
... and 48 more failures.
UVM_ERROR (usbdev_scoreboard.sv:74) [scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (* [*] vs * [*]) has 48 failures:
0.usbdev_smoke.46025410523966290315161026224901585514833356061953156828262635521609863899751
Line 264, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_smoke/latest/run.log
UVM_ERROR @ 8340418777 ps: (usbdev_scoreboard.sv:74) [uvm_test_top.env.scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (1 [0x1] vs 0 [0x0])
UVM_INFO @ 8340418777 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
1.usbdev_smoke.28142197845936491045029493911525134430156791802964854028602406682561852659655
Line 264, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/1.usbdev_smoke/latest/run.log
UVM_ERROR @ 8340176861 ps: (usbdev_scoreboard.sv:74) [uvm_test_top.env.scoreboard] Check failed actual_pkt[i] == expected_pkt[i] (1 [0x1] vs 0 [0x0])
UVM_INFO @ 8340176861 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 46 more failures.
UVM_FATAL (usb20_driver.sv:254) [driver] timeout waiting for usb_pullup has 12 failures:
Test usbdev_sec_cm has 2 failures.
0.usbdev_sec_cm.58670647095480290641102565251934772537292156118066049707250602776313028747385
Line 391, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_sec_cm/latest/run.log
UVM_FATAL @ 501651118 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501651118 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
4.usbdev_sec_cm.95363781777639089032596256771377091346900655830333492291200288597212067266683
Line 283, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/4.usbdev_sec_cm/latest/run.log
UVM_FATAL @ 501565764 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501565764 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
Test usbdev_tl_intg_err has 7 failures.
0.usbdev_tl_intg_err.51911286565404105248009301591541894774992120229589122449943095185750692029823
Line 384, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/0.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 501654630 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 501654630 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
2.usbdev_tl_intg_err.69322802733811916007305346198629699432251352760751577592767851924414204052211
Line 362, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_tl_intg_err/latest/run.log
UVM_FATAL @ 502055124 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502055124 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 5 more failures.
Test usbdev_csr_bit_bash has 3 failures.
2.usbdev_csr_bit_bash.52348877937424505458534561833020238137723806824854831083705811809776638525709
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/2.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 502320159 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502320159 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
3.usbdev_csr_bit_bash.6166140498957372110603617256225311657190881180406380884221595560575636728325
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/3.usbdev_csr_bit_bash/latest/run.log
UVM_FATAL @ 502220219 ps: (usb20_driver.sv:254) [uvm_test_top.env.m_usb20_agent.driver] timeout waiting for usb_pullup
UVM_INFO @ 502220219 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 1 more failures.
UVM_ERROR (cip_base_vseq.sv:455) [usbdev_common_vseq] Check failed exp_val == act_val (* [*] vs * [*]) when reading the intr CSRusbdev_reg_block.intr_state has 11 failures:
12.usbdev_intr_test.89459997165698180671624017097601410839396193350698893920534775068338082735116
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/12.usbdev_intr_test/latest/run.log
UVM_ERROR @ 65198851 ps: (cip_base_vseq.sv:455) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (70749 [0x1145d] vs 103517 [0x1945d]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 65198851 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
14.usbdev_intr_test.99705133074140311442021896104159669875274694171353793236556174085840443048865
Line 250, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/14.usbdev_intr_test/latest/run.log
UVM_ERROR @ 6984726 ps: (cip_base_vseq.sv:455) [uvm_test_top.env.virtual_sequencer.usbdev_common_vseq] Check failed exp_val == act_val (1205 [0x4b5] vs 33973 [0x84b5]) when reading the intr CSRusbdev_reg_block.intr_state
UVM_INFO @ 6984726 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
--- UVM Report catcher Summary ---
... and 9 more failures.
Job usbdev-sim-vcs_run_default killed due to: Exit reason: User job exceeded runlimit: User job timed out has 5 failures:
Test usbdev_smoke has 2 failures.
8.usbdev_smoke.43878010252289402101659827330314147198329580903180748592984357558852945531004
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/8.usbdev_smoke/latest/run.log
Job ID: smart:28c140f2-29cf-4173-830e-01232f93c2a8
12.usbdev_smoke.4873400656283634020597792465563262990450100924204825102456220285120774433691
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/12.usbdev_smoke/latest/run.log
Job ID: smart:6c4d9c71-c96f-4b58-9fc8-67715b7d6f09
Test usbdev_stress_all_with_rand_reset has 3 failures.
18.usbdev_stress_all_with_rand_reset.22165837763450823315161726932086953892514490541985947219404165727791186531658
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/18.usbdev_stress_all_with_rand_reset/latest/run.log
Job ID: smart:633fd0c8-ae74-4888-a1d5-452f93a2668c
21.usbdev_stress_all_with_rand_reset.59464978655304858287355223820325877140579339188120748735451223075630438253078
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/21.usbdev_stress_all_with_rand_reset/latest/run.log
Job ID: smart:d1923150-1eeb-412e-afcc-d41d79f69495
... and 1 more failures.
Job usbdev-sim-vcs_run_cover_reg_top killed due to: Exit reason: User job exceeded runlimit: User job timed out has 4 failures:
Test usbdev_tl_intg_err has 1 failures.
16.usbdev_tl_intg_err.97659854025578922999449023078975778450367367966911791289459589297056471962047
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/16.usbdev_tl_intg_err/latest/run.log
Job ID: smart:eea1de48-aeb5-44e9-8535-cbd6928d4311
Test usbdev_csr_rw has 1 failures.
16.usbdev_csr_rw.35410759259561478662701750586445709395444729167467953552353497202322750076570
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/16.usbdev_csr_rw/latest/run.log
Job ID: smart:f9c404ca-a969-474b-8eee-d0ede3301065
Test usbdev_tl_errors has 1 failures.
17.usbdev_tl_errors.32877640447120654784090882710070955939203390090958870187487796050875993846311
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/17.usbdev_tl_errors/latest/run.log
Job ID: smart:b2fdc59d-30e0-4243-8670-40c332f0e648
Test usbdev_intr_test has 1 failures.
33.usbdev_intr_test.7962092541006522074447179109573804342318187394117538753090963337327580239403
Log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/33.usbdev_intr_test/latest/run.log
Job ID: smart:13287084-22d0-4c7b-8d8a-92af3f2d6d91
Exit reason: Error: User command failed Error-[SV-WMIBC] Width mismatch in bit-stream casting has 1 failures:
3.usbdev_csr_hw_reset.8100155114708357613609978847526000520731081398990410861918725547656383853893
Line 254, in log /container/opentitan-public/scratch/os_regression/usbdev-sim-vcs/3.usbdev_csr_hw_reset/latest/run.log
Error-[SV-WMIBC] Width mismatch in bit-stream casting
../src/lowrisc_dv_usb20_agent_0.1/usb20_monitor.sv, 122
Source size is 3 bit(s) whereas destination size is 35 bit(s).
Please make sure that both source and destination are of same size.