PWM Simulation Results

Wednesday May 11 2022 08:19:00 UTC

GitHub Revision: `beb156d82`
Foundry Revision: `beb156d82`

Branch: os_regression

Testplan

Simulator: XCELIUM

Build randomization enabled with --build-seed 2905146407

Test Results

Milestone	Name	Tests	Passing	Total	Pass Rate
V1	smoke	pwm_smoke	50	50	100.00
V1	csr_hw_reset	pwm_csr_hw_reset	5	5	100.00
V1	csr_rw	pwm_csr_rw	20	20	100.00
V1	csr_bit_bash	pwm_csr_bit_bash	5	5	100.00
V1	csr_aliasing	pwm_csr_aliasing	5	5	100.00
V1	csr_mem_rw_with_rand_reset	pwm_csr_mem_rw_with_rand_reset	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	pwm_csr_rw	20	20	100.00
		pwm_csr_aliasing	5	5	100.00
V1		TOTAL	105	105	100.00
V2	dutycycle	pwm_rand_output	41	50	82.00
V2	pulse	pwm_rand_output	41	50	82.00
V2	blink	pwm_rand_output	41	50	82.00
V2	heartbeat	pwm_rand_output	41	50	82.00
V2	resolution	pwm_rand_output	41	50	82.00
V2	multi_channel	pwm_rand_output	41	50	82.00
V2	polarity	pwm_rand_output	41	50	82.00
V2	phase	pwm_rand_output	41	50	82.00
V2	lowpower	pwm_rand_output	41	50	82.00
V2	perf	pwm_perf	33	50	66.00
V2	stress_all	pwm_stress_perf	0	0	--
V2	alert_test	pwm_alert_test	50	50	100.00
V2	intr_test	pwm_intr_test	50	50	100.00
V2	tl_d_oob_addr_access	pwm_tl_errors	20	20	100.00
V2	tl_d_illegal_access	pwm_tl_errors	20	20	100.00
V2	tl_d_outstanding_access	pwm_csr_hw_reset	5	5	100.00
		pwm_csr_rw	20	20	100.00
		pwm_csr_aliasing	5	5	100.00
		pwm_same_csr_outstanding	20	20	100.00
V2	tl_d_partial_access	pwm_csr_hw_reset	5	5	100.00
		pwm_csr_rw	20	20	100.00
		pwm_csr_aliasing	5	5	100.00
		pwm_same_csr_outstanding	20	20	100.00
V2		TOTAL	214	240	89.17
V2S	tl_intg_err	pwm_tl_intg_err	20	20	100.00
V2S	sec_cm_bus_integrity	sec_cm_bus_integrity	0	0	--
V2S		TOTAL	20	20	100.00
V3		TOTAL	0	0	--
	Unmapped tests	pwm_mem_walk	5	5	100.00
		pwm_mem_partial_access	5	5	100.00
		TOTAL	349	375	93.07

Testplan Progress

Items	Total	Written	Passing	Progress
N.A.	2	2	2	100.00
V1	6	6	6	100.00
V2	7	6	4	57.14
V2S	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
77.66	79.39	72.97	82.98	77.04	72.84	100.00	81.28	93.77

Failure Buckets

UVM_ERROR (pwm_scoreboard.sv:371) [scoreboard] exp_item_q[i] item uncompared: has 21 failures:

Test pwm_perf has 17 failures.

1.pwm_perf.2405749739
Line 173, in log /container/opentitan-public/scratch/os_regression/pwm-sim-xcelium/1.pwm_perf/out/run.log

  UVM_ERROR @ 461915491 ps: (pwm_scoreboard.sv:371) [uvm_test_top.env.scoreboard] exp_item_q[i] item uncompared:
  --------------------------------------
  Name            Type      Size  Value
  --------------------------------------
  exp_item        pwm_item  -     @12015

7.pwm_perf.3392748332
Line 131, in log /container/opentitan-public/scratch/os_regression/pwm-sim-xcelium/7.pwm_perf/out/run.log

  UVM_ERROR @ 1851481714 ps: (pwm_scoreboard.sv:371) [uvm_test_top.env.scoreboard] exp_item_q[i] item uncompared:
  ---------------------------------------
  Name            Type      Size  Value
  ---------------------------------------
  exp_item        pwm_item  -     @12017

... and 15 more failures.

Test pwm_rand_output has 4 failures.

6.pwm_rand_output.1681950753
Line 259, in log /container/opentitan-public/scratch/os_regression/pwm-sim-xcelium/6.pwm_rand_output/out/run.log

  UVM_ERROR @ 853635480 ps: (pwm_scoreboard.sv:371) [uvm_test_top.env.scoreboard] exp_item_q[i] item uncompared:
  --------------------------------------
  Name            Type      Size  Value
  --------------------------------------
  exp_item        pwm_item  -     @12568

29.pwm_rand_output.1656755584
Line 1669, in log /container/opentitan-public/scratch/os_regression/pwm-sim-xcelium/29.pwm_rand_output/out/run.log

  UVM_ERROR @ 401524960 ps: (pwm_scoreboard.sv:371) [uvm_test_top.env.scoreboard] exp_item_q[i] item uncompared:
  --------------------------------------
  Name            Type      Size  Value
  --------------------------------------
  exp_item        pwm_item  -     @26516

... and 2 more failures.

Exit reason: Error: User command failed UVM_FATAL (pwm_scoreboard.sv:201) scoreboard [scoreboard] has 5 failures:
- Test pwm_rand_output has 5 failures.
  - 0.pwm_rand_output.1819099287
    Line 157, in log /container/opentitan-public/scratch/os_regression/pwm-sim-xcelium/0.pwm_rand_output/out/run.log
```
  UVM_FATAL @ 1992223747 ps: (pwm_scoreboard.sv:201) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard]
   PWM pulse on Channel           3 did not match
  .......| Exp Item |.......
  
  ------| PWM ITEM |------
```
  - 14.pwm_rand_output.681731926
    Line 204, in log /container/opentitan-public/scratch/os_regression/pwm-sim-xcelium/14.pwm_rand_output/out/run.log
```
  UVM_FATAL @ 984064036 ps: (pwm_scoreboard.sv:201) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard]
   PWM pulse on Channel           3 did not match
  .......| Exp Item |.......
  
  ------| PWM ITEM |------
```
  - ... and 3 more failures.