Jobsub ID 244929.41@dunegpschedd01.fnal.gov

Jobsub ID	244929.41@dunegpschedd01.fnal.gov
Workflow ID	9859
Stage ID	1
User name	mdias@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-07 02:13:17
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-11-07 04:42:11
From worker node	Hostname	dunegli-7510441-0-fnpc18007.fnal.gov
	cpuinfo	AMD EPYC 7551 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-07 02:15:17
Input files	ehn1-beam-np04:H4_v34b_-1GeV_-27.7_009172_227926_127_20250623T163527.root
Jobscript	Exit code	0
	Real time	2h (7992s)
	CPU time	11m (682s = 8%)
	Max RSS bytes	4420435968 (4215 MiB)
Outputting started	2025-11-07 04:28:31
Output files	hd-protodune:pdhd_prod_beam__244929_41_1_20251107T021521Z_gen_g4_IonScintPDExt.root
Finished	2025-11-07 04:42:11
Saved logs	justin-logs:244929.41-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 4th record. run: 20250623 subRun: 1 event: 93 at 07-Nov-2025 04:22:37 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 07-Nov-2025 04:22:42 UTC  run: 20250623 subRun: 1 event: 93
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 5th record. run: 20250623 subRun: 1 event: 94 at 07-Nov-2025 04:23:03 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 07-Nov-2025 04:23:07 UTC  run: 20250623 subRun: 1 event: 94
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 6th record. run: 20250623 subRun: 1 event: 95 at 07-Nov-2025 04:23:35 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 07-Nov-2025 04:23:38 UTC  run: 20250623 subRun: 1 event: 95
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 7th record. run: 20250623 subRun: 1 event: 96 at 07-Nov-2025 04:25:05 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 07-Nov-2025 04:25:09 UTC  run: 20250623 subRun: 1 event: 96
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 8th record. run: 20250623 subRun: 1 event: 97 at 07-Nov-2025 04:25:42 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 07-Nov-2025 04:25:46 UTC  run: 20250623 subRun: 1 event: 97
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 9th record. run: 20250623 subRun: 1 event: 98 at 07-Nov-2025 04:26:28 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 07-Nov-2025 04:26:32 UTC  run: 20250623 subRun: 1 event: 98
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 10th record. run: 20250623 subRun: 1 event: 99 at 07-Nov-2025 04:27:24 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 07-Nov-2025 04:27:28 UTC  run: 20250623 subRun: 1 event: 99
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
07-Nov-2025 04:28:29 UTC  Closed output file "pdhd_prod_beam__244929_41_1_20251107T021521Z_gen_g4_IonScintPDExt.root"
07-Nov-2025 04:28:29 UTC  Closed input file "temp_largeant.root"
IonAndScint endJob.
IonAndScint endJob.

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      19.8029       39.9416       86.9884       32.2971       19.8069        10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000256775    0.0132822     0.0439934    0.00551389     0.0151594       10     
simulate:rns:RandomNumberSaver                3.7841e-05    7.40359e-05   0.00029668    4.41685e-05   7.50871e-05      10     
simulate:IonAndScint:IonAndScint                1.41531       1.68787       2.24741       1.6018       0.254979        10     
simulate:IonAndScintExternal:IonAndScint       0.0026258     0.0488097     0.206812      0.0199583     0.0636246       10     
simulate:PDFastSimExternal:PDFastSimPVS        0.143197        1.133        8.50208      0.279281       2.4585         10     
[art]:TriggerResults:TriggerResultInserter    1.3655e-05    1.86451e-05   4.8903e-05    1.4898e-05    1.01915e-05      10     
end_path:out1:RootOutput                       3.086e-06    7.0804e-06    2.3945e-05    3.7825e-06    6.30903e-06      10     
end_path:out1:RootOutput(write)                 17.2712       37.0581       85.1182       28.1559       20.3943        10     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 07-Nov-2025 04:28:29 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 297358969
  seed within: [ 1 ; 900000000 ]
   Configured value          Last value   ModuleLabel.InstanceName
          258872707              (same)   IonAndScint.ISCalcAlg
           71717727              (same)   IonAndScintExternal.ISCalcAlg
          621511722              (same)   PDFastSimExternal.photon
          387052646              (same)   PDFastSimExternal.scinttime

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5444.35 MB
  Peak resident set size usage (VmHWM): 4420.44 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 143.743394 Real = 662.907161

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 5444.35 VmHWM = 4420.44

Art has completed and will exit with status 0.
ionscint pdext lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 1952968
-rw-r--r-- 1 dunegli fnalgrid     247923 Nov  7 04:28 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid        153 Nov  7 04:28 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid        519 Nov  7 04:28 g4_protodunehd_hist.root
-rw-r--r-- 1 dunegli fnalgrid 1998688547 Nov  7 04:28 pdhd_prod_beam__244929_41_1_20251107T021521Z_gen_g4_IonScintPDExt.root
-rw-r--r-- 1 dunegli fnalgrid        519 Nov  7 04:15 g4_protodunehd_stage1_hist.root
-rw-r--r-- 1 dunegli fnalgrid     716475 Nov  7 03:26 prod_cosmics_beam_protodunehd_hist.root
-rw-r--r-- 1 dunegli fnalgrid     122880 Nov  7 03:26 mem.db
-rw-r--r-- 1 dunegli fnalgrid      28672 Nov  7 03:26 time.db
-rw-r--r-- 1 dunegli fnalgrid        148 Nov  7 02:15 all-input-dids.txt