PWM Simulation Results

Thursday May 12 2022 08:22:36 UTC

GitHub Revision: `5533c0504`
Foundry Revision: `5533c0504`

Branch: os_regression

Testplan

Simulator: XCELIUM

Build randomization enabled with --build-seed 1629440991

Test Results

Milestone	Name	Tests	Passing	Total	Pass Rate
V1	smoke	pwm_smoke	50	50	100.00
V1	csr_hw_reset	pwm_csr_hw_reset	5	5	100.00
V1	csr_rw	pwm_csr_rw	20	20	100.00
V1	csr_bit_bash	pwm_csr_bit_bash	5	5	100.00
V1	csr_aliasing	pwm_csr_aliasing	5	5	100.00
V1	csr_mem_rw_with_rand_reset	pwm_csr_mem_rw_with_rand_reset	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	pwm_csr_rw	20	20	100.00
		pwm_csr_aliasing	5	5	100.00
V1		TOTAL	105	105	100.00
V2	dutycycle	pwm_rand_output	41	50	82.00
V2	pulse	pwm_rand_output	41	50	82.00
V2	blink	pwm_rand_output	41	50	82.00
V2	heartbeat	pwm_rand_output	41	50	82.00
V2	resolution	pwm_rand_output	41	50	82.00
V2	multi_channel	pwm_rand_output	41	50	82.00
V2	polarity	pwm_rand_output	41	50	82.00
V2	phase	pwm_rand_output	41	50	82.00
V2	lowpower	pwm_rand_output	41	50	82.00
V2	perf	pwm_perf	35	50	70.00
V2	stress_all	pwm_stress_perf	0	0	--
V2	alert_test	pwm_alert_test	50	50	100.00
V2	intr_test	pwm_intr_test	50	50	100.00
V2	tl_d_oob_addr_access	pwm_tl_errors	20	20	100.00
V2	tl_d_illegal_access	pwm_tl_errors	20	20	100.00
V2	tl_d_outstanding_access	pwm_csr_hw_reset	5	5	100.00
		pwm_csr_rw	20	20	100.00
		pwm_csr_aliasing	5	5	100.00
		pwm_same_csr_outstanding	20	20	100.00
V2	tl_d_partial_access	pwm_csr_hw_reset	5	5	100.00
		pwm_csr_rw	20	20	100.00
		pwm_csr_aliasing	5	5	100.00
		pwm_same_csr_outstanding	20	20	100.00
V2		TOTAL	216	240	90.00
V2S	tl_intg_err	pwm_tl_intg_err	20	20	100.00
V2S	sec_cm_bus_integrity	sec_cm_bus_integrity	0	0	--
V2S		TOTAL	20	20	100.00
V3		TOTAL	0	0	--
	Unmapped tests	pwm_mem_walk	5	5	100.00
		pwm_mem_partial_access	5	5	100.00
		TOTAL	351	375	93.60

Testplan Progress

Items	Total	Written	Passing	Progress
N.A.	2	2	2	100.00
V1	6	6	6	100.00
V2	7	6	4	57.14
V2S	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
77.65	79.37	72.93	82.98	77.01	72.84	100.00	81.28	93.77

Failure Buckets

UVM_ERROR (pwm_scoreboard.sv:371) [scoreboard] exp_item_q[i] item uncompared: has 16 failures:

Test pwm_perf has 15 failures.

5.pwm_perf.960071520
Line 131, in log /container/opentitan-public/scratch/os_regression/pwm-sim-xcelium/5.pwm_perf/out/run.log

  UVM_ERROR @ 531831526 ps: (pwm_scoreboard.sv:371) [uvm_test_top.env.scoreboard] exp_item_q[i] item uncompared:
  -----------------------------------------
  Name            Type      Size  Value
  -----------------------------------------
  exp_item        pwm_item  -     @12017

7.pwm_perf.1825516912
Line 151, in log /container/opentitan-public/scratch/os_regression/pwm-sim-xcelium/7.pwm_perf/out/run.log

  UVM_ERROR @ 668495410 ps: (pwm_scoreboard.sv:371) [uvm_test_top.env.scoreboard] exp_item_q[i] item uncompared:
  --------------------------------------
  Name            Type      Size  Value
  --------------------------------------
  exp_item        pwm_item  -     @12016

... and 13 more failures.

Test pwm_rand_output has 1 failures.

12.pwm_rand_output.998205120
Line 385, in log /container/opentitan-public/scratch/os_regression/pwm-sim-xcelium/12.pwm_rand_output/out/run.log

  UVM_ERROR @ 413126991 ps: (pwm_scoreboard.sv:371) [uvm_test_top.env.scoreboard] exp_item_q[i] item uncompared:
  --------------------------------------
  Name            Type      Size  Value
  --------------------------------------
  exp_item        pwm_item  -     @14283

Exit reason: Error: User command failed UVM_FATAL (pwm_scoreboard.sv:201) scoreboard [scoreboard] has 8 failures:
- Test pwm_rand_output has 8 failures.
  - 8.pwm_rand_output.1189972729
    Line 203, in log /container/opentitan-public/scratch/os_regression/pwm-sim-xcelium/8.pwm_rand_output/out/run.log
```
  UVM_FATAL @ 468894370 ps: (pwm_scoreboard.sv:201) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard]
   PWM pulse on Channel           4 did not match
  .......| Exp Item |.......
  
  ------| PWM ITEM |------
```
  - 14.pwm_rand_output.3685164131
    Line 182, in log /container/opentitan-public/scratch/os_regression/pwm-sim-xcelium/14.pwm_rand_output/out/run.log
```
  UVM_FATAL @ 362159837 ps: (pwm_scoreboard.sv:201) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard]
   PWM pulse on Channel           4 did not match
  .......| Exp Item |.......
  
  ------| PWM ITEM |------
```
  - ... and 6 more failures.