Jobsub ID 246615.2@dunegpschedd01.fnal.gov

Jobsub ID	246615.2@dunegpschedd01.fnal.gov
Workflow ID	9842
Stage ID	1
User name	mdias@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-10 12:02:57
Site	US_UChicago
Entry	Engage_US_MWT2_uct2_condce_mcore
Last heartbeat	2025-11-10 12:18:02
From worker node	Hostname	mwt2-c036.campuscluster.illinois.edu
	cpuinfo	AMD EPYC 7443 24-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	86400 (24 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-10 12:06:31
Input files	ehn1-beam-np04:H4_v34b_-1GeV_-27.7_008062_418831_80_20250620T144124.root
Jobscript	Exit code	0
	Real time	10m (635s)
	CPU time	9m (594s = 93%)
	Max RSS bytes	6477750272 (6177 MiB)
Outputting started	2025-11-10 12:17:07
Output files	hd-protodune:pdhd_prod_beam__246615_2_1_20251110T180640Z_gen_g4_IonScintPDExt.root
Finished	2025-11-10 12:18:02
Saved logs	justin-logs:246615.2-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs
Jobscript log (last 10,000 characters)

run: 20250620 subRun: 1 event: 2
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 4th record. run: 20250620 subRun: 1 event: 3 at 10-Nov-2025 12:15:26 CST
%MSG-w PhotonBackTrackerService:  ProcessEvent 10-Nov-2025 12:15:30 CST  run: 20250620 subRun: 1 event: 3
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 5th record. run: 20250620 subRun: 1 event: 4 at 10-Nov-2025 12:15:39 CST
%MSG-w PhotonBackTrackerService:  ProcessEvent 10-Nov-2025 12:15:43 CST  run: 20250620 subRun: 1 event: 4
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 6th record. run: 20250620 subRun: 1 event: 5 at 10-Nov-2025 12:15:54 CST
%MSG-w PhotonBackTrackerService:  ProcessEvent 10-Nov-2025 12:15:58 CST  run: 20250620 subRun: 1 event: 5
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 7th record. run: 20250620 subRun: 1 event: 6 at 10-Nov-2025 12:16:07 CST
%MSG-w PhotonBackTrackerService:  ProcessEvent 10-Nov-2025 12:16:10 CST  run: 20250620 subRun: 1 event: 6
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 8th record. run: 20250620 subRun: 1 event: 7 at 10-Nov-2025 12:16:16 CST
%MSG-w PhotonBackTrackerService:  ProcessEvent 10-Nov-2025 12:16:19 CST  run: 20250620 subRun: 1 event: 7
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 9th record. run: 20250620 subRun: 1 event: 8 at 10-Nov-2025 12:16:27 CST
%MSG-w PhotonBackTrackerService:  ProcessEvent 10-Nov-2025 12:16:32 CST  run: 20250620 subRun: 1 event: 8
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Begin processing the 10th record. run: 20250620 subRun: 1 event: 9 at 10-Nov-2025 12:16:52 CST
%MSG-w PhotonBackTrackerService:  ProcessEvent 10-Nov-2025 12:16:57 CST  run: 20250620 subRun: 1 event: 9
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
10-Nov-2025 12:17:06 CST  Closed output file "pdhd_prod_beam__246615_2_1_20251110T180640Z_gen_g4_IonScintPDExt.root"
10-Nov-2025 12:17:06 CST  Closed input file "temp_largeant.root"
IonAndScint endJob.
IonAndScint endJob.

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      5.61392        10.52         19.62        9.04665       3.87727        10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000226055   0.000310923   0.000562707   0.000280507   9.32729e-05      10     
simulate:rns:RandomNumberSaver                3.5156e-05    6.9152e-05    0.000300054   4.46035e-05   7.70586e-05      10     
simulate:IonAndScint:IonAndScint               0.919407       1.66914       3.0958        1.54744      0.552964        10     
simulate:IonAndScintExternal:IonAndScint      0.00201624    0.00403021     0.0053253    0.00431775    0.00102138       10     
simulate:PDFastSimExternal:PDFastSimPVS         0.18196       0.84092       5.35991      0.333048       1.5108         10     
[art]:TriggerResults:TriggerResultInserter    1.4137e-05    2.18612e-05   4.6428e-05    1.96675e-05   8.5797e-06       10     
end_path:out1:RootOutput                       2.345e-06    5.1638e-06    2.0779e-05    3.5165e-06    5.22125e-06      10     
end_path:out1:RootOutput(write)                 4.50986       8.0051        16.0791       7.10387       2.93938        10     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 10-Nov-2025 12:17:06 CST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 64526359
  seed within: [ 1 ; 900000000 ]
   Configured value          Last value   ModuleLabel.InstanceName
            7636989              (same)   IonAndScint.ISCalcAlg
          579597127              (same)   IonAndScintExternal.ISCalcAlg
          303082294              (same)   PDFastSimExternal.photon
           72896171              (same)   PDFastSimExternal.scinttime

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 7691.92 MB
  Peak resident set size usage (VmHWM): 6477.75 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 145.105645 Real = 148.685139

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 7691.92 VmHWM = 6477.75

Art has completed and will exit with status 0.
ionscint pdext lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 2266752
-rw-r--r-- 1 dune osgvo     247849 Nov 10 12:17 jobscript.log
-rw-r--r-- 1 dune osgvo        152 Nov 10 12:17 justin-processed-pfns.txt
-rw-r--r-- 1 dune osgvo        519 Nov 10 12:17 g4_protodunehd_hist.root
-rw-r--r-- 1 dune osgvo 2320007507 Nov 10 12:17 pdhd_prod_beam__246615_2_1_20251110T180640Z_gen_g4_IonScintPDExt.root
-rw-r--r-- 1 dune osgvo        519 Nov 10 12:13 g4_protodunehd_stage1_hist.root
-rw-r--r-- 1 dune osgvo     715489 Nov 10 12:08 prod_cosmics_beam_protodunehd_hist.root
-rw-r--r-- 1 dune osgvo     118784 Nov 10 12:08 mem.db
-rw-r--r-- 1 dune osgvo      28672 Nov 10 12:08 time.db
-rw-r--r-- 1 dune osgvo        146 Nov 10 12:06 all-input-dids.txt