ENTROPY_SRC Simulation Results

Tuesday July 09 2024 23:02:48 UTC

GitHub Revision: `6a84251492`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 61727890964832844865465694323650730626175387240181955975848876152363892893427

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	8.000s	78.547us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	4.000s	24.955us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	12.000s	27.372us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	14.000s	797.145us	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	7.000s	81.625us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	9.000s	108.688us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	12.000s	27.372us	20	20	100.00
		entropy_src_csr_aliasing	7.000s	81.625us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	8.000s	78.547us	50	50	100.00
		entropy_src_rng	4.850m	10.058ms	300	300	100.00
		entropy_src_fw_ov	2.417m	5.071ms	281	300	93.67
V2	firmware_mode	entropy_src_fw_ov	2.417m	5.071ms	281	300	93.67
V2	rng_mode	entropy_src_rng	4.850m	10.058ms	300	300	100.00
V2	rng_max_rate	entropy_src_rng_max_rate	9.300m	10.096ms	396	400	99.00
V2	health_checks	entropy_src_rng	4.850m	10.058ms	300	300	100.00
V2	conditioning	entropy_src_rng	4.850m	10.058ms	300	300	100.00
V2	interrupts	entropy_src_rng	4.850m	10.058ms	300	300	100.00
		entropy_src_intr	30.000s	1.940ms	50	50	100.00
V2	alerts	entropy_src_rng	4.850m	10.058ms	300	300	100.00
		entropy_src_functional_alerts	9.000s	120.145us	50	50	100.00
V2	stress_all	entropy_src_stress_all	14.000s	361.870us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	9.967m	10.012ms	979	1000	97.90
V2	firmware_ov_read_contiguous_data	entropy_src_fw_ov_contiguous	23.000s	696.017us	50	50	100.00
V2	intr_test	entropy_src_intr_test	7.000s	18.743us	50	50	100.00
V2	alert_test	entropy_src_alert_test	8.000s	25.989us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	12.000s	242.741us	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	12.000s	242.741us	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	4.000s	24.955us	5	5	100.00
		entropy_src_csr_rw	12.000s	27.372us	20	20	100.00
		entropy_src_csr_aliasing	7.000s	81.625us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	1.008ms	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	4.000s	24.955us	5	5	100.00
		entropy_src_csr_rw	12.000s	27.372us	20	20	100.00
		entropy_src_csr_aliasing	7.000s	81.625us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	1.008ms	20	20	100.00
V2		TOTAL			2296	2340	98.12
V2S	tl_intg_err	entropy_src_sec_cm	8.000s	87.531us	5	5	100.00
		entropy_src_tl_intg_err	8.000s	118.520us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	4.850m	10.058ms	300	300	100.00
		entropy_src_cfg_regwen	13.000s	214.832us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	4.850m	10.058ms	300	300	100.00
V2S	sec_cm_config_redun	entropy_src_rng	4.850m	10.058ms	300	300	100.00
V2S	sec_cm_intersig_mubi	entropy_src_rng	4.850m	10.058ms	300	300	100.00
		entropy_src_fw_ov	2.417m	5.071ms	281	300	93.67
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	9.967m	10.012ms	979	1000	97.90
		entropy_src_sec_cm	8.000s	87.531us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	9.967m	10.012ms	979	1000	97.90
		entropy_src_sec_cm	8.000s	87.531us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	4.850m	10.058ms	300	300	100.00
V2S	sec_cm_fifo_ctr_redun	entropy_src_functional_errors	9.967m	10.012ms	979	1000	97.90
		entropy_src_sec_cm	8.000s	87.531us	5	5	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	9.967m	10.012ms	979	1000	97.90
		entropy_src_sec_cm	8.000s	87.531us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	9.967m	10.012ms	979	1000	97.90
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	9.000s	120.145us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	8.000s	118.520us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	4.583m	10.032ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
		TOTAL			2526	2570	98.29

Testplan Progress

Items	Total	Written	Passing	Progress
V1	6	6	6	100.00
V2	12	12	9	75.00
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
97.10	98.15	95.32	98.33	95.79	96.62	96.88	90.48	95.70

Failure Buckets

UVM_ERROR (entropy_src_scoreboard.sv:1928) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.err_code has 11 failures:

Test entropy_src_fw_ov has 11 failures.

6.entropy_src_fw_ov.102697260322159585056332046225667403636886877775550069944406116732362562136919
Line 433, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/6.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 3802792943 ps: (entropy_src_scoreboard.sv:1928) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 3802792943 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

66.entropy_src_fw_ov.51528848487773372042703691162693364137491585064534196202033543467388235590584
Line 379, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/66.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 1576440779 ps: (entropy_src_scoreboard.sv:1928) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 1576440779 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 9 more failures.

Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 7 failures:
- Test entropy_src_functional_errors has 7 failures.
  - 175.entropy_src_functional_errors.49705743920905551041228547134726362395423495803637833811141709079768701579648
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/175.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10017233699 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xa25547d8) == 0x1
  UVM_INFO @ 10017233699 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 252.entropy_src_functional_errors.15905435432953210039058171939936089671113062488555424325689962269895134988058
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/252.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10011498209 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x370501d8) == 0x1
  UVM_INFO @ 10011498209 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 5 more failures.
UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 5 failures:
- Test entropy_src_fw_ov has 5 failures.
  - 34.entropy_src_fw_ov.46630947412327724575529458788213508621971223668258917712170273626130745304382
    Line 482, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/34.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 4241890576 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 4241890576 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 126.entropy_src_fw_ov.10016256649507544285992661856871391718241698571013682118109834689094276992601
    Line 430, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/126.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 3032803706 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 3032803706 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 5 failures:
- Test entropy_src_functional_errors has 5 failures.
  - 260.entropy_src_functional_errors.30205978147308452942301495523388290525021250273859980716106219478752647739200
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/260.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10033907004 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xff9e9ad8) == 0x1
  UVM_INFO @ 10033907004 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 281.entropy_src_functional_errors.83907097544123023576779927177900470936373698023519902091693381390928946778263
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/281.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10045063118 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x4b337dd8) == 0x1
  UVM_INFO @ 10045063118 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 4 failures:
- Test entropy_src_functional_errors has 4 failures.
  - 63.entropy_src_functional_errors.56463676617821601705323993110705087288588160810622117277272271492551980459257
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/63.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10028472805 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x54dea6d8) == 0x1
  UVM_INFO @ 10028472805 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 74.entropy_src_functional_errors.108511258628134374966890531126666536286317145099459339984422672729745943578435
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/74.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10012114156 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xf0cf01d8) == 0x1
  UVM_INFO @ 10012114156 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 2 more failures.
Exit reason: Error: User command failed UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 3 failures:
- Test entropy_src_fw_ov has 3 failures.
  - 105.entropy_src_fw_ov.80519343794836278176474471166725761747265786122143196227516384356816736543672
    Line 697, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/105.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 4330053319 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 4330053319 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 177.entropy_src_fw_ov.107080538767914204780210775873148115386859478088500404472029628074577185412860
    Line 379, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/177.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 1485352432 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 1485352432 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 1 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 3 failures:
- Test entropy_src_functional_errors has 3 failures.
  - 107.entropy_src_functional_errors.11062456211559430677450363538064951014698585007115980292864417356241980960982
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/107.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10101338410 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x374a68d8) == 0x1
  UVM_INFO @ 10101338410 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 724.entropy_src_functional_errors.65128845644102971862603496340210657290285013500799299247347469994549568020692
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/724.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10022069714 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xc0472d8) == 0x1
  UVM_INFO @ 10022069714 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 1 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 2 failures:
- Test entropy_src_functional_errors has 2 failures.
  - 43.entropy_src_functional_errors.26098700408633150603762166957058572486354855180785264228791626860172854581487
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/43.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10018143008 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x8d0905d8) == 0x1
  UVM_INFO @ 10018143008 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 396.entropy_src_functional_errors.65984655010952963557969464984890693039140571266648102135501605434440370059847
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/396.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10035963978 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x7a03c9d8) == 0x1
  UVM_INFO @ 10035963978 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 66.entropy_src_rng_max_rate.114335539644331344944153933617739338827527162453770767500970822772524948210569
    Line 685, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/66.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 3305433478 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 3305433478 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 158.entropy_src_rng_max_rate.73202441769755718551627998201058375991438509793358257609440293274417572922021
    Line 1824, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/158.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 9958204134 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 9958204134 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_*/rtl/entropy_src_core.sv,3141): Assertion AtReset_ValidRngBitsPushedIntoEsrngFifo_A has failed has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 211.entropy_src_rng_max_rate.97975032503005472726199679872879256013663200530887661432608230984856902978660
    Line 1119, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/211.entropy_src_rng_max_rate/latest/run.log
```
  xmsim: *E,ASRTST (/workspace/default/src/lowrisc_ip_entropy_src_0.1/rtl/entropy_src_core.sv,3141): (time 1792284170 PS) Assertion tb.dut.u_entropy_src_core.AtReset_ValidRngBitsPushedIntoEsrngFifo_A has failed
  UVM_ERROR @ 1792284170 ps: (entropy_src_core.sv:3141) [ASSERT FAILED] AtReset_ValidRngBitsPushedIntoEsrngFifo_A
  UVM_INFO @ 1792284170 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (cip_base_scoreboard.sv:302) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 325.entropy_src_rng_max_rate.100017073669812846066539885749691986319914613658405122708844243549099038104769
    Line 2270, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/325.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 6960127304 ps: (cip_base_scoreboard.sv:302) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 6960127304 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```