ENTROPY_SRC Simulation Results

Tuesday July 16 2024 23:15:02 UTC

GitHub Revision: `aad711e1bc`

Branch: os_regression

Simulator: XCELIUM

Build randomization enabled with --build-seed 38297581588405771015102977205739484163575733999253050480227719508149669635625

Test Results

Stage	Name	Tests	Max Job Runtime	Simulated Time	Passing	Total	Pass Rate
V1	smoke	entropy_src_smoke	4.000s	98.551us	50	50	100.00
V1	csr_hw_reset	entropy_src_csr_hw_reset	5.000s	93.327us	5	5	100.00
V1	csr_rw	entropy_src_csr_rw	4.000s	280.699us	20	20	100.00
V1	csr_bit_bash	entropy_src_csr_bit_bash	13.000s	514.997us	5	5	100.00
V1	csr_aliasing	entropy_src_csr_aliasing	8.000s	318.914us	5	5	100.00
V1	csr_mem_rw_with_rand_reset	entropy_src_csr_mem_rw_with_rand_reset	4.000s	90.479us	20	20	100.00
V1	regwen_csr_and_corresponding_lockable_csr	entropy_src_csr_rw	4.000s	280.699us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	318.914us	5	5	100.00
V1		TOTAL			105	105	100.00
V2	firmware	entropy_src_smoke	4.000s	98.551us	50	50	100.00
		entropy_src_rng	5.517m	10.099ms	300	300	100.00
		entropy_src_fw_ov	2.750m	5.050ms	280	300	93.33
V2	firmware_mode	entropy_src_fw_ov	2.750m	5.050ms	280	300	93.33
V2	rng_mode	entropy_src_rng	5.517m	10.099ms	300	300	100.00
V2	rng_max_rate	entropy_src_rng_max_rate	9.583m	10.049ms	397	400	99.25
V2	health_checks	entropy_src_rng	5.517m	10.099ms	300	300	100.00
V2	conditioning	entropy_src_rng	5.517m	10.099ms	300	300	100.00
V2	interrupts	entropy_src_rng	5.517m	10.099ms	300	300	100.00
		entropy_src_intr	34.000s	519.087us	50	50	100.00
V2	alerts	entropy_src_rng	5.517m	10.099ms	300	300	100.00
		entropy_src_functional_alerts	5.000s	266.942us	50	50	100.00
V2	stress_all	entropy_src_stress_all	12.000s	262.266us	50	50	100.00
V2	functional_errors	entropy_src_functional_errors	9.267m	10.012ms	966	1000	96.60
V2	firmware_ov_read_contiguous_data	entropy_src_fw_ov_contiguous	24.000s	1.364ms	50	50	100.00
V2	intr_test	entropy_src_intr_test	4.000s	53.145us	50	50	100.00
V2	alert_test	entropy_src_alert_test	4.000s	42.169us	50	50	100.00
V2	tl_d_oob_addr_access	entropy_src_tl_errors	8.000s	1.360ms	20	20	100.00
V2	tl_d_illegal_access	entropy_src_tl_errors	8.000s	1.360ms	20	20	100.00
V2	tl_d_outstanding_access	entropy_src_csr_hw_reset	5.000s	93.327us	5	5	100.00
		entropy_src_csr_rw	4.000s	280.699us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	318.914us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	95.600us	20	20	100.00
V2	tl_d_partial_access	entropy_src_csr_hw_reset	5.000s	93.327us	5	5	100.00
		entropy_src_csr_rw	4.000s	280.699us	20	20	100.00
		entropy_src_csr_aliasing	8.000s	318.914us	5	5	100.00
		entropy_src_same_csr_outstanding	5.000s	95.600us	20	20	100.00
V2		TOTAL			2283	2340	97.56
V2S	tl_intg_err	entropy_src_sec_cm	4.000s	93.837us	5	5	100.00
		entropy_src_tl_intg_err	6.000s	332.267us	20	20	100.00
V2S	sec_cm_config_regwen	entropy_src_rng	5.517m	10.099ms	300	300	100.00
		entropy_src_cfg_regwen	7.000s	327.031us	50	50	100.00
V2S	sec_cm_config_mubi	entropy_src_rng	5.517m	10.099ms	300	300	100.00
V2S	sec_cm_config_redun	entropy_src_rng	5.517m	10.099ms	300	300	100.00
V2S	sec_cm_intersig_mubi	entropy_src_rng	5.517m	10.099ms	300	300	100.00
		entropy_src_fw_ov	2.750m	5.050ms	280	300	93.33
V2S	sec_cm_main_sm_fsm_sparse	entropy_src_functional_errors	9.267m	10.012ms	966	1000	96.60
		entropy_src_sec_cm	4.000s	93.837us	5	5	100.00
V2S	sec_cm_ack_sm_fsm_sparse	entropy_src_functional_errors	9.267m	10.012ms	966	1000	96.60
		entropy_src_sec_cm	4.000s	93.837us	5	5	100.00
V2S	sec_cm_rng_bkgn_chk	entropy_src_rng	5.517m	10.099ms	300	300	100.00
V2S	sec_cm_fifo_ctr_redun	entropy_src_functional_errors	9.267m	10.012ms	966	1000	96.60
		entropy_src_sec_cm	4.000s	93.837us	5	5	100.00
V2S	sec_cm_ctr_redun	entropy_src_functional_errors	9.267m	10.012ms	966	1000	96.60
		entropy_src_sec_cm	4.000s	93.837us	5	5	100.00
V2S	sec_cm_ctr_local_esc	entropy_src_functional_errors	9.267m	10.012ms	966	1000	96.60
V2S	sec_cm_esfinal_rdata_bus_consistency	entropy_src_functional_alerts	5.000s	266.942us	50	50	100.00
V2S	sec_cm_tile_link_bus_integrity	entropy_src_tl_intg_err	6.000s	332.267us	20	20	100.00
V2S		TOTAL			75	75	100.00
V3	external_health_tests	entropy_src_rng_with_xht_rsps	5.300m	10.050ms	50	50	100.00
V3	stress_all_with_rand_reset	entropy_src_stress_all_with_rand_reset			0	0	--
V3		TOTAL			50	50	100.00
		TOTAL			2513	2570	97.78

Testplan Progress

Items	Total	Written	Passing	Progress
V1	6	6	6	100.00
V2	12	12	9	75.00
V2S	3	3	3	100.00
V3	2	1	1	50.00

Coverage Results

Coverage Dashboard

Score	Block	Branch	Statement	Expression	Toggle	Fsm	Assertion	CoverGroup
97.14	98.15	95.32	98.33	95.79	96.71	96.88	90.48	95.93

Failure Buckets

UVM_ERROR (cip_base_scoreboard.sv:242) [scoreboard] Check failed expected_alert[alert_name].expected == * (* [*] vs * [*]) alert fatal_alert triggered unexpectedly has 11 failures:
- Test entropy_src_fw_ov has 11 failures.
  - 5.entropy_src_fw_ov.12851045339603532103061209350930746322724581653691125265113798718610709128841
    Line 858, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/5.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 3410629017 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 3410629017 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 35.entropy_src_fw_ov.4535326296272234627030279665213260401935268547152176682860836447818207285217
    Line 488, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/35.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 3749193244 ps: (cip_base_scoreboard.sv:242) [uvm_test_top.env.scoreboard] Check failed expected_alert[alert_name].expected == 1 (0 [0x0] vs 1 [0x1]) alert fatal_alert triggered unexpectedly
  UVM_INFO @ 3749193244 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 9 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 11 failures:
- Test entropy_src_functional_errors has 11 failures.
  - 6.entropy_src_functional_errors.28326969101671383334078316505006796659251456071877905240740127481474488985161
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/6.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10022809551 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0x61e13bd8) == 0x1
  UVM_INFO @ 10022809551 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 166.entropy_src_functional_errors.101045614199752789770968961104377777236535972039200696273297329811741549986390
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/166.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10060209730 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xf0a8c8d8) == 0x1
  UVM_INFO @ 10060209730 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 9 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 11 failures:
- Test entropy_src_functional_errors has 11 failures.
  - 122.entropy_src_functional_errors.20675245286929516211014723657009691044696886073613935987939138692743626385672
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/122.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10022126135 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x5bb7a8d8) == 0x1
  UVM_INFO @ 10022126135 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 151.entropy_src_functional_errors.60267622918360454794767764091625817363144815507934666352100189228893979719814
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/151.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10034218829 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0xda78d4d8) == 0x1
  UVM_INFO @ 10034218829 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 9 more failures.

UVM_ERROR (entropy_src_scoreboard.sv:2031) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.err_code has 7 failures:

Test entropy_src_fw_ov has 7 failures.

132.entropy_src_fw_ov.80444191124853505075346410780344443861912812294303826649072354667305959616289
Line 537, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/132.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 3782906979 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 3782906979 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

138.entropy_src_fw_ov.21627490128146265112232975970635646381766474585758836550152984832358385924222
Line 599, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/138.entropy_src_fw_ov/latest/run.log

  UVM_ERROR @ 1848655248 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1048576 [0x100000] vs 3145728 [0x300000]) reg name: entropy_src_reg_block.err_code
  UVM_INFO @ 1848655248 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---

... and 5 more failures.

Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 5 failures:
- Test entropy_src_functional_errors has 5 failures.
  - 161.entropy_src_functional_errors.114484880836154436706909513259480410450007236646027061319578758076652601141469
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/161.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10013504959 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x4310b5d8) == 0x1
  UVM_INFO @ 10013504959 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 341.entropy_src_functional_errors.87778782820475421649646821752398389715048101526091511947220662691731507062021
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/341.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10012615570 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x1515cdd8) == 0x1
  UVM_INFO @ 10012615570 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 3 more failures.
UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=*) == * has 4 failures:
- Test entropy_src_functional_errors has 4 failures.
  - 147.entropy_src_functional_errors.103052807578089555692559413722412660065626089228826242615186771529715519449379
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/147.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10015453538 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0x20d339d8) == 0x1
  UVM_INFO @ 10015453538 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 301.entropy_src_functional_errors.97828974473144918442563827383544326248747663537998466713276343984276861510567
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/301.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10017155682 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.sfifo_observe_err (addr=0xac4965d8) == 0x1
  UVM_INFO @ 10017155682 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - ... and 2 more failures.
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=*) == * has 2 failures:
- Test entropy_src_functional_errors has 2 failures.
  - 30.entropy_src_functional_errors.79717932980333333927551477122204439834417113728341971813495660006683425917988
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/30.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10067525883 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x620fc7d8) == 0x1
  UVM_INFO @ 10067525883 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
  
  
```
  - 66.entropy_src_functional_errors.80157996666698320361249340355442795765188941772968421389292155037745839037006
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/66.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10065130765 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_state_err (addr=0x92f8ad8) == 0x1
  UVM_INFO @ 10065130765 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (entropy_src_scoreboard.sv:2031) [scoreboard] Check failed csr.get_mirrored_value() == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.alert_summary_fail_counts has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 30.entropy_src_rng_max_rate.61434202784604263518952872074805346739702543869819886553614252948127721023214
    Line 1813, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/30.entropy_src_rng_max_rate/latest/run.log
```
  UVM_ERROR @ 8005752814 ps: (entropy_src_scoreboard.sv:2031) [uvm_test_top.env.scoreboard] Check failed csr.get_mirrored_value() == item.d_data (1 [0x1] vs 0 [0x0]) reg name: entropy_src_reg_block.alert_summary_fail_counts
  UVM_INFO @ 8005752814 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (cip_base_scoreboard.sv:302) scoreboard [scoreboard] alert recov_alert did not trigger max_delay:* has 1 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 161.entropy_src_fw_ov.61524859297214970724389409458268676035243779520781828608383756076797170434564
    Line 382, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/161.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 3674930788 ps: (cip_base_scoreboard.sv:302) uvm_test_top.env.scoreboard [uvm_test_top.env.scoreboard] alert recov_alert did not trigger max_delay:5
  UVM_INFO @ 3674930788 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
Exit reason: Error: User command failed UVM_FATAL (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=*) == * has 1 failures:
- Test entropy_src_functional_errors has 1 failures.
  - 211.entropy_src_functional_errors.32015371838868616855583432404474079593556660888068408117478925484606753720007
    Line 332, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/211.entropy_src_functional_errors/latest/run.log
```
  UVM_FATAL @ 10059513489 ps: (csr_utils_pkg.sv:577) [csr_utils::csr_spinwait] timeout entropy_src_reg_block.err_code.fifo_read_err (addr=0xe54737d8) == 0x1
  UVM_INFO @ 10059513489 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (entropy_src_base_vseq.sv:442) [entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 287.entropy_src_rng_max_rate.48310832487919222962957700577278864607242740994472354003836359786814056637952
    Line 1250, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/287.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 6998593146 ps: (entropy_src_base_vseq.sv:442) [uvm_test_top.env.virtual_sequencer.entropy_src_rng_vseq] Timeout encountered while reading TlSrcObserveFIFO
  UVM_INFO @ 6998593146 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_ERROR (entropy_src_scoreboard.sv:2016) [scoreboard] Check failed fw_ov_wr_fifo_full_prediction == item.d_data (* [*] vs * [*]) reg name: entropy_src_reg_block.fw_ov_wr_fifo_full has 1 failures:
- Test entropy_src_fw_ov has 1 failures.
  - 296.entropy_src_fw_ov.31737156721086294571347691283017395267804709879340241555735381512818157344659
    Line 908, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/296.entropy_src_fw_ov/latest/run.log
```
  UVM_ERROR @ 4836208690 ps: (entropy_src_scoreboard.sv:2016) [uvm_test_top.env.scoreboard] Check failed fw_ov_wr_fifo_full_prediction == item.d_data (1 [0x1] vs 0 [0x0]) reg name: entropy_src_reg_block.fw_ov_wr_fifo_full
  UVM_INFO @ 4836208690 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```
UVM_FATAL (entropy_src_scoreboard.sv:2649) [scoreboard] Check failed match_found == * (* [*] vs * [*]) All candidate csrng seeds have been checked, with no match has 1 failures:
- Test entropy_src_rng_max_rate has 1 failures.
  - 341.entropy_src_rng_max_rate.93950071717271402542847145539307509845126899253862052702208774235914925065454
    Line 1650, in log /container/opentitan-public/scratch/os_regression/entropy_src-sim-xcelium/341.entropy_src_rng_max_rate/latest/run.log
```
  UVM_FATAL @ 6056635821 ps: (entropy_src_scoreboard.sv:2649) [uvm_test_top.env.scoreboard] Check failed match_found == 1 (0 [0x0] vs 1 [0x1]) All candidate csrng seeds have been checked, with no match
  UVM_INFO @ 6056635821 ps: (uvm_report_catcher.svh:705) [UVM/REPORT/CATCHER]
  --- UVM Report catcher Summary ---
```