ENTROPY_SRC Simulation Results

Wednesday July 17 2024 23:02:16 UTC

GitHub Revision: `8b2da8db5e`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 31877364624131593519988921539075110140045739991215723614576185349550879231344

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	5.000s	37.678us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	4.000s	74.719us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	4.000s	35.647us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	15.000s	669.926us	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	8.000s	264.678us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	5.000s	35.038us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	4.000s	35.647us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	264.678us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	5.000s	37.678us	50	50	100.00
		entropy_src_rng	5.867m	10.021ms	298	300	99.33
		entropy_src_fw_ov	2.967m	5.054ms	282	300	94.00
V2	firmware_mode	entropy_src_fw_ov	2.967m	5.054ms	282	300	94.00
V2	rng_mode	entropy_src_rng	5.867m	10.021ms	298	300	99.33
V2	rng_max_rate	entropy_src_rng_max_rate	10.433m	10.022ms	396	400	99.00
V2	health_checks	entropy_src_rng	5.867m	10.021ms	298	300	99.33
V2	conditioning	entropy_src_rng	5.867m	10.021ms	298	300	99.33
V2	interrupts	entropy_src_rng	5.867m	10.021ms	298	300	99.33
		entropy_src_intr	32.000s	1.968ms	50	50	100.00
V2	alerts	entropy_src_rng	5.867m	10.021ms	298	300	99.33
		entropy_src_functional_alerts	14.000s	64.687us	50	50	100.00
V2	stress_all	entropy_src_stress_all	16.000s	371.566us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	9.617m	10.012ms	967	1000	96.70
V2	firmware_ov_read_contiguous_data	entropy_src_fw_ov_contiguous	29.000s	467.511us	50	50	100.00
V2	intr_test	entropy_src_intr_test	4.000s	102.937us	50	50	100.00
V2	alert_test	entropy_src_alert_test	13.000s	18.690us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	8.000s	718.093us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	8.000s	718.093us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	4.000s	74.719us	5	5	100.00
		entropy_src_csr_rw	4.000s	35.647us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	264.678us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	264.204us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	4.000s	74.719us	5	5	100.00
		entropy_src_csr_rw	4.000s	35.647us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	264.678us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	264.204us	20	20	100.00
V2		TOTAL			2283	2340	97.56
V2S	tl_intg_err	entropy_src_sec_cm	5.000s	67.205us	5	5	100.00
		entropy_src_tl_intg_err	7.000s	205.094us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	5.867m	10.021ms	298	300	99.33
		entropy_src_cfg_regwen	9.000s	98.385us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	5.867m	10.021ms	298	300	99.33
V2S	sec_cm_config_redun	entropy_src_rng	5.867m	10.021ms	298	300	99.33
V2S	sec_cm_intersig_mubi	entropy_src_rng	5.867m	10.021ms	298	300	99.33
		entropy_src_fw_ov	2.967m	5.054ms	282	300	94.00
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	9.617m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	5.000s	67.205us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	9.617m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	5.000s	67.205us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	5.867m	10.021ms	298	300	99.33
V2S	sec_cm_fifo_ctr_redun	entropy_src_functional_errors	9.617m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	5.000s	67.205us	5	5	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	9.617m	10.012ms	967	1000	96.70
		entropy_src_sec_cm	5.000s	67.205us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	9.617m	10.012ms	967	1000	96.70
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	14.000s	64.687us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	7.000s	205.094us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	5.650m	10.025ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
		TOTAL			2513	2570	97.78

Testplan Progress

Items	Total	Written	Passing	Progress
V1	6	6	6	100.00
V2	12	12	8	66.67
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
97.09	98.11	95.22	98.33	95.79	96.68	96.88	90.48	95.66

Failure Buckets

UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 9 failures:
- Test entropy_src_fw_ov has 9 failures.
  - 5.entropy_src_fw_ov.28042584644755439653997479114908447481434529564358529973729114376071429442707
    Line 583, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/5.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 4595051541 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 4595051541 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 34.entropy_src_fw_ov.113121216089839752777462598336634812841529648976712485252752864051234519694981
    Line 539, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/34.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 3891228073 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 3891228073 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 7 more failures.

UVM_ERROR (entropy_src_scoreboard.sv:2031) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.err_code has 9 failures:

Test entropy_src_fw_ov has 9 failures.

11.entropy_src_fw_ov.41767110084370650869755990027601190681645506845085154157817656059099504440743
Line 429, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/11.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 1734538110 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 1734538110 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

128.entropy_src_fw_ov.99145249847595114764047910050841255689994651661127841524391503226171706099407
Line 1206, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/128.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 4880750526 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 4880750526 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 7 more failures.

Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 8 failures:
- Test entropy_src_functional_errors has 8 failures.
  - 107.entropy_src_functional_errors.49912203810846530076663813225918831145118719981782140207433152334001513189988
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/107.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10012188173 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x7a65c2d8) == 0x1
  UVM_INFO @ 10012188173 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 212.entropy_src_functional_errors.75782584392406598590740996749861939776222274086195868060452295964803342936010
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/212.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10012798537 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x4ad048d8) == 0x1
  UVM_INFO @ 10012798537 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 6 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 8 failures:
- Test entropy_src_functional_errors has 8 failures.
  - 236.entropy_src_functional_errors.95088833472448709777111940315698141571105585742777057462308177849339104874189
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/236.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10085145891 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x7c0336d8) == 0x1
  UVM_INFO @ 10085145891 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 245.entropy_src_functional_errors.4118107807890151394365426403320550863975455921663106224478711581118920542045
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/245.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10016531239 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x572de4d8) == 0x1
  UVM_INFO @ 10016531239 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 6 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 7 failures:
- Test entropy_src_functional_errors has 7 failures.
  - 82.entropy_src_functional_errors.45176810274264808786860704548839983152714885580493757981495129263023143641368
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/82.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10215200640 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x1e91e4d8) == 0x1
  UVM_INFO @ 10215200640 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 203.entropy_src_functional_errors.109726594527277296638855054387530876644896566599975601588049548348065820715921
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/203.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10046343376 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x652ed9d8) == 0x1
  UVM_INFO @ 10046343376 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 5 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 6 failures:
- Test entropy_src_functional_errors has 6 failures.
  - 309.entropy_src_functional_errors.108538085253191314096022773578452041678501205461159628409165570593238493074822
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/309.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10065673298 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x625c0ad8) == 0x1
  UVM_INFO @ 10065673298 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 425.entropy_src_functional_errors.9042385134593445357740894697646629726165766770389716280938851855354279061487
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/425.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10145041171 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x9192e0d8) == 0x1
  UVM_INFO @ 10145041171 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 4 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 3 failures:
- Test entropy_src_functional_errors has 3 failures.
  - 195.entropy_src_functional_errors.22744359751636972745145656857099075723976979127105811679926363094134014795719
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/195.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10060961736 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x3cf6e0d8) == 0x1
  UVM_INFO @ 10060961736 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 744.entropy_src_functional_errors.55213055097276377485677728753364839926146013361107638343452380566741598994621
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/744.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10016770617 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xe68425d8) == 0x1
  UVM_INFO @ 10016770617 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 1 more failures.
UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 2 failures:
- Test entropy_src_rng_max_rate has 2 failures.
  - 134.entropy_src_rng_max_rate.114025554572228318448359132601757193290473354778096986976875207472434982379591
    Line 687, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/134.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 2331489680 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 2331489680 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 197.entropy_src_rng_max_rate.95672169331271234725346342763960427842237053384805677353197124685103364472947
    Line 1621, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/197.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 5452498523 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 5452498523 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (entropy_src_scoreboard.sv:2031) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.alert_summary_fail_counts has 2 failures:
- Test entropy_src_rng_max_rate has 2 failures.
  - 241.entropy_src_rng_max_rate.41520647978546753263110223406063212384710077573477381753928964660261697146730
    Line 2531, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/241.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 10161438801 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (4 [0x4] vs 3 [0x3]) reg name: entropy_src_reg_block.alert_summary_fail_counts
  UVM_INFO @ 10161438801 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 263.entropy_src_rng_max_rate.81653756500534763476079229543659447665990740089374583357885260672192743281088
    Line 532, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/263.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 329236910 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1 [0x1] vs 0 [0x0]) reg name: entropy_src_reg_block.alert_summary_fail_counts
  UVM_INFO @ 329236910 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_ERROR (cip_base_scoreboard.sv:302) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 1 failures:
- Test entropy_src_rng has 1 failures.
  - 87.entropy_src_rng.42305742454092193474327755018569807820991206269953706838077711631474963480161
    Line 795, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/87.entropy_src_rng/latest/run.log
```
  UVM_ERROR @ 3327134000 ps: (cip_base_scoreboard.sv:302) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 3327134000 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (cip_base_scoreboard.sv:302) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 1 failures:
- Test entropy_src_rng has 1 failures.
  - 232.entropy_src_rng.21490559948188243321053062734550294100778340334293151285311767952847891322447
    Line 1316, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/232.entropy_src_rng/latest/run.log
```
  UVM_ERROR @ 6773186856 ps: (cip_base_scoreboard.sv:302) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 6773186856 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 1 failures:
- Test entropy_src_functional_errors has 1 failures.
  - 502.entropy_src_functional_errors.15315317617897607912817776210894238219035295374392966737774394288938264599703
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/502.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10026028003 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x11c376d8) == 0x1
  UVM_INFO @ 10026028003 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```