Jobsub ID 250261.2@dunegpschedd01.fnal.gov

Jobsub ID	250261.2@dunegpschedd01.fnal.gov
Workflow ID	10147
Stage ID	1
User name	mdias@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-14 15:47:43
Site	US_UChicago
Entry	Engage_US_MWT2_iut2_gk02_condce_mcore
Last heartbeat	2025-11-14 16:15:39
From worker node	Hostname	iut2-c308.iu.edu
	cpuinfo	Intel(R) Xeon(R) Gold 6242 CPU @ 2.80GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	86400 (24 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-14 15:56:51
Input files	ehn1-beam-np04:H4_v34b_1GeV_-27.7_001940_220069_1_20250614T022718.root
Jobscript	Exit code	0
	Real time	13m (828s)
	CPU time	13m (806s = 97%)
	Max RSS bytes	4001169408 (3815 MiB)
Outputting started	2025-11-14 16:10:40
Output files	hd-protodune:pdhd_prod_beam__250261_2_1_20251114T155655Z_gen_g4_IonScintPDExt.root
Finished	2025-11-14 16:15:39
Saved logs	justin-logs:250261.2-dunegpschedd01.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)
Jobscript log (last 10,000 characters)

ebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 4th record. run: 20250614 subRun: 1 event: 413 at 14-Nov-2025 11:08:53 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 11:09:00 EST  run: 20250614 subRun: 1 event: 413
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 5th record. run: 20250614 subRun: 1 event: 414 at 14-Nov-2025 11:09:10 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 11:09:17 EST  run: 20250614 subRun: 1 event: 414
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 6th record. run: 20250614 subRun: 1 event: 415 at 14-Nov-2025 11:09:31 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 11:09:36 EST  run: 20250614 subRun: 1 event: 415
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 7th record. run: 20250614 subRun: 1 event: 416 at 14-Nov-2025 11:09:44 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 11:09:48 EST  run: 20250614 subRun: 1 event: 416
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 8th record. run: 20250614 subRun: 1 event: 417 at 14-Nov-2025 11:09:57 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 11:10:01 EST  run: 20250614 subRun: 1 event: 417
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 9th record. run: 20250614 subRun: 1 event: 418 at 14-Nov-2025 11:10:09 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 11:10:14 EST  run: 20250614 subRun: 1 event: 418
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 10th record. run: 20250614 subRun: 1 event: 419 at 14-Nov-2025 11:10:22 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 11:10:27 EST  run: 20250614 subRun: 1 event: 419
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
14-Nov-2025 11:10:38 EST  Closed output file "pdhd_prod_beam__250261_2_1_20251114T155655Z_gen_g4_IonScintPDExt.root"
14-Nov-2025 11:10:38 EST  Closed input file "temp_largeant.root"
IonAndScint endJob.
IonAndScint endJob.

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      7.67574       10.9478       22.2893       10.0608       4.17393        10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00027477    0.00052653    0.00142131    0.000309516   0.000415149      10     
simulate:rns:RandomNumberSaver                 4.019e-05    8.83176e-05   0.000422371   5.0695e-05    0.000111698      10     
simulate:IonAndScint:IonAndScint                1.40921       1.8896        2.82349       1.78303      0.465261        10     
simulate:IonAndScintExternal:IonAndScint      0.00212517    0.00392499    0.00617747    0.00385758    0.00104227       10     
simulate:PDFastSimExternal:PDFastSimPVS        0.296003       1.60651       11.283       0.577156       3.22816        10     
[art]:TriggerResults:TriggerResultInserter    1.3324e-05    2.17312e-05   7.2023e-05    1.6669e-05    1.68324e-05      10     
end_path:out1:RootOutput                       3.35e-06     6.2376e-06    2.7932e-05     3.855e-06    7.24004e-06      10     
end_path:out1:RootOutput(write)                 5.9506        7.44657       10.4017       7.5831        1.37057        10     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 14-Nov-2025 11:10:38 EST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 785756709
  seed within: [ 1 ; 900000000 ]
   Configured value          Last value   ModuleLabel.InstanceName
          668031380              (same)   IonAndScint.ISCalcAlg
          558897144              (same)   IonAndScintExternal.ISCalcAlg
          290827230              (same)   PDFastSimExternal.photon
          260474038              (same)   PDFastSimExternal.scinttime

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5065.2 MB
  Peak resident set size usage (VmHWM): 4001.17 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 166.796447 Real = 170.812717

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 5065.2 VmHWM = 4001.17

Art has completed and will exit with status 0.
ionscint pdext lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 1892112
-rw-r--r--. 1 dune osgvo     248783 Nov 14 11:10 jobscript.log
-rw-r--r--. 1 dune osgvo        150 Nov 14 11:10 justin-processed-pfns.txt
-rw-r--r--. 1 dune osgvo        519 Nov 14 11:10 g4_protodunehd_hist.root
-rw-r--r--. 1 dune osgvo 1936375260 Nov 14 11:10 pdhd_prod_beam__250261_2_1_20251114T155655Z_gen_g4_IonScintPDExt.root
-rw-r--r--. 1 dune osgvo        519 Nov 14 11:05 g4_protodunehd_stage1_hist.root
-rw-r--r--. 1 dune osgvo     715795 Nov 14 10:59 prod_cosmics_beam_protodunehd_hist.root
-rw-r--r--. 1 dune osgvo     122880 Nov 14 10:59 mem.db
-rw-r--r--. 1 dune osgvo      28672 Nov 14 10:59 time.db
-rw-r--r--. 1 dune osgvo        142 Nov 14 10:56 all-input-dids.txt