justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258572.1@dunegpschedd01.fnal.gov

Jobsub ID258572.1@dunegpschedd01.fnal.gov
Workflow ID10783
Stage ID1
User nameykermaid@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-26 10:23:22
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2025-11-26 10:29:03
From worker nodeHostnamewn-pijl-021.farm.nikhef.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-11-26 10:24:03
Input filesvd-protodune-top:3429_1_a_pvdt.test
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-11-26 10:29:03
Saved logsjustin-logs:258572.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

window for channel 5131
wclsFrameSaver: no samples within desired window for channel 5132
wclsFrameSaver: no samples within desired window for channel 5133
wclsFrameSaver: no samples within desired window for channel 5133
wclsFrameSaver: no samples within desired window for channel 5134
wclsFrameSaver: no samples within desired window for channel 5134
wclsFrameSaver: no samples within desired window for channel 5135
wclsFrameSaver: no samples within desired window for channel 5136
wclsFrameSaver: no samples within desired window for channel 5136
wclsFrameSaver: no samples within desired window for channel 5137
wclsFrameSaver: no samples within desired window for channel 5137
wclsFrameSaver: no samples within desired window for channel 5138
wclsFrameSaver: no samples within desired window for channel 5138
wclsFrameSaver: no samples within desired window for channel 5138
wclsFrameSaver: no samples within desired window for channel 5139
wclsFrameSaver: no samples within desired window for channel 5139
wclsFrameSaver: no samples within desired window for channel 5140
wclsFrameSaver: no samples within desired window for channel 5141
wclsFrameSaver: no samples within desired window for channel 5141
wclsFrameSaver: no samples within desired window for channel 5142
wclsFrameSaver: no samples within desired window for channel 5142
wclsFrameSaver: no samples within desired window for channel 5143
wclsFrameSaver: no samples within desired window for channel 5144
wclsFrameSaver: no samples within desired window for channel 5145
wclsFrameSaver: no samples within desired window for channel 5145
wclsFrameSaver: no samples within desired window for channel 5146
wclsFrameSaver: no samples within desired window for channel 5146
wclsFrameSaver: no samples within desired window for channel 5147
wclsFrameSaver: no samples within desired window for channel 5234
wclsFrameSaver: no samples within desired window for channel 5235
wclsFrameSaver: no samples within desired window for channel 5235
wclsFrameSaver: no samples within desired window for channel 5236
wclsFrameSaver: no samples within desired window for channel 5237
wclsFrameSaver: no samples within desired window for channel 5237
wclsFrameSaver: no samples within desired window for channel 5237
wclsFrameSaver: no samples within desired window for channel 5238
wclsFrameSaver: no samples within desired window for channel 5238
wclsFrameSaver: no samples within desired window for channel 5239
wclsFrameSaver: no samples within desired window for channel 5239
wclsFrameSaver: no samples within desired window for channel 5240
wclsFrameSaver: no samples within desired window for channel 5241
wclsFrameSaver: no samples within desired window for channel 5241
wclsFrameSaver: no samples within desired window for channel 5241
wclsFrameSaver: no samples within desired window for channel 5242
wclsFrameSaver: no samples within desired window for channel 5243
wclsFrameSaver: no samples within desired window for channel 5243
wclsFrameSaver: no samples within desired window for channel 5244
wclsFrameSaver: no samples within desired window for channel 5244
wclsFrameSaver: no samples within desired window for channel 5245
wclsFrameSaver: no samples within desired window for channel 5245
wclsFrameSaver: no samples within desired window for channel 5246
wclsFrameSaver: no samples within desired window for channel 5247
wclsFrameSaver: no samples within desired window for channel 5248
wclsFrameSaver: no samples within desired window for channel 5249
wclsFrameSaver: no samples within desired window for channel 5249
wclsFrameSaver: no samples within desired window for channel 5250
wclsFrameSaver: no samples within desired window for channel 5597
wclsFrameSaver: no samples within desired window for channel 5600
wclsFrameSaver: no samples within desired window for channel 5601
wclsFrameSaver: no samples within desired window for channel 5601
wclsFrameSaver: no samples within desired window for channel 5602
wclsFrameSaver: no samples within desired window for channel 5603
wclsFrameSaver: no samples within desired window for channel 5604
wclsFrameSaver: no samples within desired window for channel 5604
wclsFrameSaver: no samples within desired window for channel 5605
wclsFrameSaver: no samples within desired window for channel 5605
wclsFrameSaver: no samples within desired window for channel 5606
wclsFrameSaver: no samples within desired window for channel 5606
wclsFrameSaver: no samples within desired window for channel 5606
wclsFrameSaver: no samples within desired window for channel 5607
wclsFrameSaver: no samples within desired window for channel 5607
wclsFrameSaver: no samples within desired window for channel 5608
wclsFrameSaver: no samples within desired window for channel 5608
wclsFrameSaver: no samples within desired window for channel 5608
wclsFrameSaver: no samples within desired window for channel 5609
wclsFrameSaver: no samples within desired window for channel 5609
wclsFrameSaver: no samples within desired window for channel 5610
wclsFrameSaver: no samples within desired window for channel 5610
wclsFrameSaver: no samples within desired window for channel 5611
wclsFrameSaver: no samples within desired window for channel 5611
wclsFrameSaver: no samples within desired window for channel 5612
wclsFrameSaver: no samples within desired window for channel 5613
wclsFrameSaver: no samples within desired window for channel 5613
wclsFrameSaver: no samples within desired window for channel 5613
wclsFrameSaver: no samples within desired window for channel 5614
wclsFrameSaver: no samples within desired window for channel 5614
wclsFrameSaver: no samples within desired window for channel 5615
wclsFrameSaver: no samples within desired window for channel 5615
wclsFrameSaver: no samples within desired window for channel 5615
wclsFrameSaver: no samples within desired window for channel 5616
wclsFrameSaver: no samples within desired window for channel 5617
wclsFrameSaver: no samples within desired window for channel 5617
FrameSaver: q=1.44429e+08 n=2313132 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 4232 XUs and 9252 XVs -> 82 XUVs
C:0 T:1 936 XUs and 2025 XVs -> 18 XUVs
C:0 T:2 1431 XUs and 1720 XVs -> 5 XUVs
C:0 T:3 1649 XUs and 4135 XVs -> 9 XUVs
C:0 T:4 119 XUs and 295 XVs -> 0 XUVs
C:0 T:5 270 XUs and 350 XVs -> 2 XUVs
C:0 T:6 862 XUs and 713 XVs -> 1 XUVs
C:0 T:7 601 XUs and 571 XVs -> 0 XUVs
117 XUVs total
105 collection wire objects
117 potential space points
Neighbour search...
405 tests to find 190 neighbours
Iterating with no regularization...
Begin: 1.66108e+12
0 1.66101e+12
Now with regularization...
Begin: 1.661e+12
0 1.661e+12
26-Nov-2025 11:28:23 CET  Opened output file with pattern "%ifb_reco_stage1_%tc_laser_reco.root"
26-Nov-2025 11:28:32 CET  Closed output file "3429_1_a_pvdt_reco_stage1_20251126T102832_laser_reco.root"
DataPrepModule::endJob: # events processed: 1
DataPrepModule::endJob:   # events skipped: 0

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        136.705       136.705       136.705       136.705          0            1     
----------------------------------------------------------------------------------------------------------------------------------
source:VDColdboxTDERawInput(read)               0.000474607   0.000474607   0.000474607   0.000474607        0            1     
produce:caldata:DataPrepModule                   0.984663      0.984663      0.984663      0.984663          0            1     
produce:wclsdatavd:WireCellToolkit                71.5667       71.5667       71.5667       71.5667          0            1     
produce:gaushit:GausHitFinder                     6.36476       6.36476       6.36476       6.36476          0            1     
produce:reco3d:SpacePointSolver                   10.3931       10.3931       10.3931       10.3931          0            1     
produce:hitpdune:DisambigFromSpacePoints         0.0998605     0.0998605     0.0998605     0.0998605         0            1     
produce:pandora:StandardPandora                   43.0874       43.0874       43.0874       43.0874          0            1     
produce:pandoraTrack:LArPandoraTrackCreation     0.483385      0.483385      0.483385      0.483385          0            1     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0255716     0.0255716     0.0255716     0.0255716         0            1     
[art]:TriggerResults:TriggerResultInserter      0.000160052   0.000160052   0.000160052   0.000160052        0            1     
end_path:out1:RootOutput                         4.662e-05     4.662e-05     4.662e-05     4.662e-05         0            1     
end_path:out1:RootOutput(write)                   3.6369        3.6369        3.6369        3.6369           0            1     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4411.44 MB
  Peak resident set size usage (VmHWM): 2155.77 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: 3429_1_a_pvdt_reco_stage1_20251126T102832_laser_reco.root
\tHists: 
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
justIN time: 2026-02-08 07:19:53 UTC       justIN version: 01.06.00