Jobsub ID 238479.18@dunegpschedd02.fnal.gov

Jobsub ID	238479.18@dunegpschedd02.fnal.gov
Workflow ID	9748
Stage ID	1
User name	higuera@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-06 09:05:37
Site	US_UChicago
Entry	Engage_US_MWT2_iut2_gk02_condce_mcore
Last heartbeat	2025-11-06 09:45:53
From worker node	Hostname	iut2-c403.iu.edu
	cpuinfo	AMD EPYC 7443 24-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	86400 (24 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-06 09:20:06
Input files	ehn1-beam-np04:H4_v34b_-5GeV_-27.7_008958_231505_89_20250627T174352.root
Jobscript	Exit code	0
	Real time	12m (777s)
	CPU time	12m (752s = 96%)
	Max RSS bytes	4135931904 (3944 MiB)
Outputting started	2025-11-06 09:33:03
Output files	hd-protodune:pdhd_prod_beam__238479_18_1_20251106T092010Z_gen_g4_IonScintPDExt.root
Finished	2025-11-06 09:45:53
Saved logs	justin-logs:238479.18-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs
Jobscript log (last 10,000 characters)

802
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 4th record. run: 20250627 subRun: 1 event: 803 at 06-Nov-2025 04:31:44 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 06-Nov-2025 04:31:46 EST  run: 20250627 subRun: 1 event: 803
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 5th record. run: 20250627 subRun: 1 event: 804 at 06-Nov-2025 04:31:53 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 06-Nov-2025 04:31:57 EST  run: 20250627 subRun: 1 event: 804
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 6th record. run: 20250627 subRun: 1 event: 805 at 06-Nov-2025 04:32:07 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 06-Nov-2025 04:32:10 EST  run: 20250627 subRun: 1 event: 805
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 7th record. run: 20250627 subRun: 1 event: 806 at 06-Nov-2025 04:32:18 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 06-Nov-2025 04:32:21 EST  run: 20250627 subRun: 1 event: 806
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 8th record. run: 20250627 subRun: 1 event: 807 at 06-Nov-2025 04:32:30 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 06-Nov-2025 04:32:33 EST  run: 20250627 subRun: 1 event: 807
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 9th record. run: 20250627 subRun: 1 event: 808 at 06-Nov-2025 04:32:40 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 06-Nov-2025 04:32:42 EST  run: 20250627 subRun: 1 event: 808
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 10th record. run: 20250627 subRun: 1 event: 809 at 06-Nov-2025 04:32:48 EST
%MSG-w PhotonBackTrackerService:  ProcessEvent 06-Nov-2025 04:32:52 EST  run: 20250627 subRun: 1 event: 809
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
06-Nov-2025 04:33:01 EST  Closed output file "pdhd_prod_beam__238479_18_1_20251106T092010Z_gen_g4_IonScintPDExt.root"
06-Nov-2025 04:33:02 EST  Closed input file "temp_largeant.root"
IonAndScint endJob.
IonAndScint endJob.

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      5.97501       8.70525       17.6579       8.09524       3.17106        10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000232467   0.000363446   0.000959795   0.000290907   0.00020837       10     
simulate:rns:RandomNumberSaver                3.6318e-05    7.94321e-05   0.000395253   4.39475e-05   0.000105506      10     
simulate:IonAndScint:IonAndScint                1.11913       1.63798       2.01766       1.7278       0.310095        10     
simulate:IonAndScintExternal:IonAndScint      0.00149156     0.0032256    0.00741492    0.00265164    0.00167387       10     
simulate:PDFastSimExternal:PDFastSimPVS        0.113657       1.17999       8.62781      0.310377       2.48917        10     
[art]:TriggerResults:TriggerResultInserter    1.1792e-05    2.18834e-05   7.5051e-05    1.57045e-05   1.80848e-05      10     
end_path:out1:RootOutput                       3.176e-06    5.6946e-06    2.4215e-05     3.497e-06    6.18973e-06      10     
end_path:out1:RootOutput(write)                 4.5818        5.88316       7.34919       5.88619      0.957755        10     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 06-Nov-2025 04:33:02 EST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 344186959
  seed within: [ 1 ; 900000000 ]
   Configured value          Last value   ModuleLabel.InstanceName
          788379271              (same)   IonAndScint.ISCalcAlg
          316305707              (same)   IonAndScintExternal.ISCalcAlg
           54249401              (same)   PDFastSimExternal.photon
          162866052              (same)   PDFastSimExternal.scinttime

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5201.48 MB
  Peak resident set size usage (VmHWM): 4135.93 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 119.512868 Real = 122.701918

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 5201.48 VmHWM = 4135.93

Art has completed and will exit with status 0.
ionscint pdext lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 1970908
-rw-r--r-- 1 dune osgvo     256432 Nov  6 04:33 jobscript.log
-rw-r--r-- 1 dune osgvo        152 Nov  6 04:33 justin-processed-pfns.txt
-rw-r--r-- 1 dune osgvo        519 Nov  6 04:33 g4_protodunehd_hist.root
-rw-r--r-- 1 dune osgvo 2017051005 Nov  6 04:33 pdhd_prod_beam__238479_18_1_20251106T092010Z_gen_g4_IonScintPDExt.root
-rw-r--r-- 1 dune osgvo        519 Nov  6 04:29 g4_protodunehd_stage1_hist.root
-rw-r--r-- 1 dune osgvo     716657 Nov  6 04:24 prod_cosmics_beam_protodunehd_hist.root
-rw-r--r-- 1 dune osgvo     122880 Nov  6 04:24 mem.db
-rw-r--r-- 1 dune osgvo      28672 Nov  6 04:24 time.db
-rw-r--r-- 1 dune osgvo        146 Nov  6 04:20 all-input-dids.txt