Jobsub ID 12990.0@dunegpschedd02.fnal.gov
Jobsub ID | 12990.0@dunegpschedd02.fnal.gov |
Workflow ID | 162 |
Stage ID | 1 |
User name | szh2@fnal.gov |
HTCondor Group | group_dune |
Requested | Processors | 1 |
GPU | No |
RSS bytes | 2097152000 (2000 MiB) |
Wall seconds limit | 80000 (22 hours) |
Submitted time | 2025-07-30 19:44:56 |
Site | NL_NIKHEF |
Entry | VIRGO_NL_NIKHEF_dissel |
Last heartbeat | 2025-07-30 20:21:01 |
From worker node | Hostname | wn-sate-042.farm.nikhef.nl |
cpuinfo | AMD EPYC 7551P 32-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 2097152000 (2000 MiB) |
Wall seconds limit | 129600 (36 hours) |
GPU | |
Inner Apptainer? | True |
Job state | jobscript_error |
Started | 2025-07-30 19:46:08 |
Input files | |
Jobscript | Exit code | 11 |
Real time | 0m (0s) |
CPU time | 0m (0s = 0%) |
Max RSS bytes | 0 (0 MiB) |
Outputting started | |
Output files | |
Finished | 2025-07-30 20:21:01 |
Saved logs | justin-logs:12990.0-dunegpschedd02.fnal.gov.logs.tgz |
List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
5 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 0 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 42 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 0 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 478 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 3 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 0 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:07 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 29 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:08 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:08 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 9 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:08 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:08 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 23 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:08 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:08 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 4505 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:08 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:08 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 6 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:08 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:08 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 776 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:09 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:09 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 33 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:10 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:10 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 0 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:10 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:10 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 3 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:10 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 30-Jul-2025 21:48:10 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 2 particles
%MSG
%MSG-i NuRandomService: IonAndScint:IonAndScint@BeginModule 30-Jul-2025 21:48:10 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 264457651
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService: PDFastSimANN:PDFastSim@BeginModule 30-Jul-2025 21:48:12 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'PDFastSim.photon': 815159279
%MSG
%MSG-i NuRandomService: PDFastSimANN:PDFastSim@BeginModule 30-Jul-2025 21:48:12 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'PDFastSim.scinttime': 265633225
%MSG
PDFastSimANN Module Producer...
PDFastSimANN module produced 1236566 images...
30-Jul-2025 22:19:44 CEST Opened output file with pattern "cosmic_g4_1_1.root"
%MSG-i Root_Information: PostProcessEvent TClass::Init() 30-Jul-2025 22:19:45 CEST run: 1 subRun: 0 event: 1
no dictionary for class sim::IDE is available
ROOT severity: 2000
%MSG
%MSG-i FastCloning: PostProcessEvent 30-Jul-2025 22:19:45 CEST run: 1 subRun: 0 event: 1
Fast cloning event data products from input file.
%MSG
%MSG-e PassingThrough: PostProcessEvent 30-Jul-2025 22:20:27 CEST run: 1 subRun: 0 event: 1
an exception occurred during current event processing
%MSG
IonAndScint endJob.
PDFastSimANN endJob.
Close TF session.
30-Jul-2025 22:20:27 CEST Closed input file "cosmic_gen_1_1.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 1912.58 1912.58 1912.58 1912.58 0 1
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00119182 0.00119182 0.00119182 0.00119182 0 1
simulate:rns:RandomNumberSaver 0.000377347 0.000377347 0.000377347 0.000377347 0 1
simulate:largeant:larg4Main 19.2278 19.2278 19.2278 19.2278 0 1
simulate:IonAndScint:IonAndScint 1.16184 1.16184 1.16184 1.16184 0 1
simulate:PDFastSim:PDFastSimANN 1892.18 1892.18 1892.18 1892.18 0 1
[art]:TriggerResults:TriggerResultInserter 6.3649e-05 6.3649e-05 6.3649e-05 6.3649e-05 0 1
end_path:out1:RootOutput 3.4465e-05 3.4465e-05 3.4465e-05 3.4465e-05 0 1
================================================================================================================================
%MSG-i NuRandomService: RootOutput:out1@EndJob 30-Jul-2025 22:20:27 CEST ModuleEndJob
Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
algorithm version: EventTimestamp_v1
Configured value Last value ModuleLabel.InstanceName
(per event) 264457651 IonAndScint.ISCalcAlg
(per event) 815159279 PDFastSim.photon
(per event) 265633225 PDFastSim.scinttime
(per event) 611344208 largeant
%MSG
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 8439.1 MB
Peak resident set size usage (VmHWM): 6727.22 MB
====================================================================================================
TrigReport ---------- Event summary -------------
TrigReport Events total = 1 passed = 1 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 1 1 0 out1
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1942.446948 Real = 1974.839994
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 8439.1 VmHWM = 6727.22
%MSG-s ArtException: PostEndJob 30-Jul-2025 22:20:39 CEST ModuleEndJob
std::bad_alloc---- FatalRootError BEGIN
Fatal Root Error: TTree::SetEntries
Tree branches have different numbers of entries, eg EventAuxiliary has 0 entries while simb::MCTruths_th232apa__SinglesGen. has 2 entries.
ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
G4 Stage failed