Jobsub ID 19641.1@dunegpschedd01.fnal.gov
| Jobsub ID | 19641.1@dunegpschedd01.fnal.gov |
| Workflow ID | 165 |
| Stage ID | 1 |
| User name | szh2@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-07-30 23:17:07 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk |
| Last heartbeat | 2025-07-30 23:48:28 |
| From worker node | Hostname | wn-snel-028.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Started | 2025-07-30 23:18:24 |
| Input files | |
| Jobscript | Exit code | 11 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Max RSS bytes | 0 (0 MiB) |
| Outputting started | |
| Output files | |
| Finished | 2025-07-30 23:48:28 |
| Saved logs | justin-logs:19641.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
arg4Main:largeant@BeginModule 31-Jul-2025 01:33:10 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:10 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 4 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:11 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:11 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 19 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:11 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:11 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 0 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:11 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:11 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 473 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:11 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:11 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 1 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:11 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:11 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 0 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:12 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:12 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 39 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:12 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:12 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 19 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:12 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:12 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 50 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:12 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:12 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 4354 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:12 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:12 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 14 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:13 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:13 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 859 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:14 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:14 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 42 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:14 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:14 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 0 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:14 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:14 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 3 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:14 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 31-Jul-2025 01:33:14 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 1 particles
%MSG
%MSG-i NuRandomService: IonAndScint:IonAndScint@BeginModule 31-Jul-2025 01:33:15 CEST run: 1 subRun: 0 event: 2
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 417885995
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService: PDFastSimPVS:PDFastSim@BeginModule 31-Jul-2025 01:33:16 CEST run: 1 subRun: 0 event: 2
Random seed for this event, engine 'PDFastSim.photon': 504774245
%MSG
%MSG-i NuRandomService: PDFastSimPVS:PDFastSim@BeginModule 31-Jul-2025 01:33:16 CEST run: 1 subRun: 0 event: 2
Random seed for this event, engine 'PDFastSim.scinttime': 426254159
%MSG
IonAndScint endJob.
31-Jul-2025 01:48:07 CEST Closed input file "cosmic_gen_1_1.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 0.0734986 300.617 601.161 300.617 300.544 2
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000904267 0.0372014 0.0734986 0.0372014 0.0362972 2
simulate:rns:RandomNumberSaver 0.000233288 0.000995478 0.00175767 0.000995478 0.00076219 2
simulate:largeant:larg4Main 12.9882 14.5646 16.1409 14.5646 1.57637 2
simulate:IonAndScint:IonAndScint 0.507656 0.631148 0.75464 0.631148 0.123492 2
simulate:PDFastSim:PDFastSimPVS 557.913 557.913 557.913 557.913 0 1
[art]:TriggerResults:TriggerResultInserter 4.1398e-05 4.1398e-05 4.1398e-05 4.1398e-05 0 1
end_path:out1:RootOutput 1.8395e-05 1.8395e-05 1.8395e-05 1.8395e-05 0 1
end_path:out1:RootOutput(write) 29.7415 29.7415 29.7415 29.7415 0 1
================================================================================================================================
%MSG-i NuRandomService: RootOutput:out1@EndJob 31-Jul-2025 01:48:07 CEST ModuleEndJob
Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
algorithm version: EventTimestamp_v1
Configured value Last value ModuleLabel.InstanceName
(per event) 417885995 IonAndScint.ISCalcAlg
(per event) 504774245 PDFastSim.photon
(per event) 426254159 PDFastSim.scinttime
(per event) 615292905 largeant
%MSG
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 8588.66 MB
Peak resident set size usage (VmHWM): 7396.63 MB
====================================================================================================
TrigReport ---------- Event summary -------------
TrigReport Events total = 2 passed = 1 failed = 1
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 1 1 0 out1
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1508.426754 Real = 1527.148990
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 8588.66 VmHWM = 7396.63
%MSG-s ArtException: PostEndJob 31-Jul-2025 01:48:08 CEST ModuleEndJob
---- EventProcessorFailure BEGIN
EventProcessor: an exception occurred during current event processing
---- ScheduleExecutionFailure BEGIN
Path: ProcessingStopped.
---- BadAlloc BEGIN
A bad_alloc exception was thrown while processing module PDFastSimPVS/PDFastSim run: 1 subRun: 0 event: 2
The job has probably exhausted the virtual memory available to the process.
---- BadAlloc END
Exception going through path simulate
---- ScheduleExecutionFailure END
---- EventProcessorFailure END
---- FatalRootError BEGIN
Fatal Root Error: TTree::SetEntries
Tree branches have different numbers of entries, eg EventAuxiliary has 1 entries while simb::MCTruths_th232apa__SinglesGen. has 2 entries.
ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
G4 Stage failed 