Jobsub ID 244333.3@dunegpschedd02.fnal.gov

Jobsub ID	244333.3@dunegpschedd02.fnal.gov
Workflow ID	10133
Stage ID	1
User name	mdias@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-14 13:28:52
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-11-14 13:41:52
From worker node	Hostname	dunegli-7596776-0-fnpc23039.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-14 13:30:34
Input files	ehn1-beam-np04:H4_v34b_1GeV_-27.7_004863_412731_2_20250614T004542.root
Jobscript	Exit code	0
	Real time	10m (639s)
	CPU time	7m (428s = 66%)
	Max RSS bytes	5198118912 (4957 MiB)
Outputting started	2025-11-14 13:41:14
Output files	hd-protodune:pdhd_prod_beam__244333_3_1_20251114T133037Z_gen_g4_IonScintPDExt.root
Finished	2025-11-14 13:41:52
Saved logs	justin-logs:244333.3-dunegpschedd02.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

xpected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 4th record. run: 20250614 subRun: 1 event: 273 at 14-Nov-2025 13:40:13 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 13:40:15 UTC  run: 20250614 subRun: 1 event: 273
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 5th record. run: 20250614 subRun: 1 event: 274 at 14-Nov-2025 13:40:21 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 13:40:23 UTC  run: 20250614 subRun: 1 event: 274
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 6th record. run: 20250614 subRun: 1 event: 275 at 14-Nov-2025 13:40:31 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 13:40:33 UTC  run: 20250614 subRun: 1 event: 275
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 7th record. run: 20250614 subRun: 1 event: 276 at 14-Nov-2025 13:40:39 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 13:40:42 UTC  run: 20250614 subRun: 1 event: 276
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 8th record. run: 20250614 subRun: 1 event: 277 at 14-Nov-2025 13:40:51 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 13:40:53 UTC  run: 20250614 subRun: 1 event: 277
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 9th record. run: 20250614 subRun: 1 event: 278 at 14-Nov-2025 13:40:58 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 13:41:00 UTC  run: 20250614 subRun: 1 event: 278
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 10th record. run: 20250614 subRun: 1 event: 279 at 14-Nov-2025 13:41:06 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Nov-2025 13:41:08 UTC  run: 20250614 subRun: 1 event: 279
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
14-Nov-2025 13:41:13 UTC  Closed output file "pdhd_prod_beam__244333_3_1_20251114T133037Z_gen_g4_IonScintPDExt.root"
14-Nov-2025 13:41:13 UTC  Closed input file "temp_largeant.root"
IonAndScint endJob.
IonAndScint endJob.

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      4.98932       6.70198       8.71099       6.37636       1.42693        10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000224255   0.000374842   0.000673978   0.000270132   0.00017794       10     
simulate:rns:RandomNumberSaver                3.6019e-05    6.13256e-05   0.000255244    3.967e-05    6.46905e-05      10     
simulate:IonAndScint:IonAndScint               0.832244       1.08836       1.47727       1.01014        0.229         10     
simulate:IonAndScintExternal:IonAndScint      0.00147796    0.00213684    0.00275965     0.0022299    0.000453434      10     
simulate:PDFastSimExternal:PDFastSimPVS        0.168041      0.631528       4.16809      0.218954       1.18004        10     
[art]:TriggerResults:TriggerResultInserter    1.0129e-05    1.32783e-05   3.1941e-05    1.11715e-05   6.28816e-06      10     
end_path:out1:RootOutput                       2.304e-06    3.8923e-06    1.3115e-05     2.74e-06     3.09732e-06      10     
end_path:out1:RootOutput(write)                 3.70658       4.9792        6.79549       4.51086       1.10154        10     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 14-Nov-2025 13:41:13 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 739514902
  seed within: [ 1 ; 900000000 ]
   Configured value          Last value   ModuleLabel.InstanceName
          769546363              (same)   IonAndScint.ISCalcAlg
          545450480              (same)   IonAndScintExternal.ISCalcAlg
          852270141              (same)   PDFastSimExternal.photon
          388325894              (same)   PDFastSimExternal.scinttime

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6169.65 MB
  Peak resident set size usage (VmHWM): 5198.12 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 88.968513 Real = 95.042192

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 6169.65 VmHWM = 5198.12

Art has completed and will exit with status 0.
ionscint pdext lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 2198860
-rw-r--r-- 1 dunegli fnalgrid     248503 Nov 14 13:41 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid        150 Nov 14 13:41 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid        519 Nov 14 13:41 g4_protodunehd_hist.root
-rw-r--r-- 1 dunegli fnalgrid 2250418370 Nov 14 13:41 pdhd_prod_beam__244333_3_1_20251114T133037Z_gen_g4_IonScintPDExt.root
-rw-r--r-- 1 dunegli fnalgrid        519 Nov 14 13:38 g4_protodunehd_stage1_hist.root
-rw-r--r-- 1 dunegli fnalgrid     716245 Nov 14 13:34 prod_cosmics_beam_protodunehd_hist.root
-rw-r--r-- 1 dunegli fnalgrid     122880 Nov 14 13:34 mem.db
-rw-r--r-- 1 dunegli fnalgrid      28672 Nov 14 13:34 time.db
-rw-r--r-- 1 dunegli fnalgrid        142 Nov 14 13:30 all-input-dids.txt