justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258581.0@dunegpschedd01.fnal.gov

Jobsub ID258581.0@dunegpschedd01.fnal.gov
Workflow ID10783
Stage ID1
User nameykermaid@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-26 10:29:27
SiteUK_Oxford
EntryDUNE_UK_SGrid_Oxford_arc01
Last heartbeat2025-11-26 11:03:10
From worker nodeHostnamet2wn170.physics.ox.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-11-26 10:55:06
Input filesvd-protodune-top:3429_1_a_pvdt.test
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-11-26 11:03:10
Saved logsjustin-logs:258581.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

window for channel 5131
wclsFrameSaver: no samples within desired window for channel 5132
wclsFrameSaver: no samples within desired window for channel 5133
wclsFrameSaver: no samples within desired window for channel 5133
wclsFrameSaver: no samples within desired window for channel 5134
wclsFrameSaver: no samples within desired window for channel 5134
wclsFrameSaver: no samples within desired window for channel 5135
wclsFrameSaver: no samples within desired window for channel 5136
wclsFrameSaver: no samples within desired window for channel 5136
wclsFrameSaver: no samples within desired window for channel 5137
wclsFrameSaver: no samples within desired window for channel 5137
wclsFrameSaver: no samples within desired window for channel 5138
wclsFrameSaver: no samples within desired window for channel 5138
wclsFrameSaver: no samples within desired window for channel 5138
wclsFrameSaver: no samples within desired window for channel 5139
wclsFrameSaver: no samples within desired window for channel 5139
wclsFrameSaver: no samples within desired window for channel 5140
wclsFrameSaver: no samples within desired window for channel 5141
wclsFrameSaver: no samples within desired window for channel 5141
wclsFrameSaver: no samples within desired window for channel 5142
wclsFrameSaver: no samples within desired window for channel 5142
wclsFrameSaver: no samples within desired window for channel 5143
wclsFrameSaver: no samples within desired window for channel 5144
wclsFrameSaver: no samples within desired window for channel 5145
wclsFrameSaver: no samples within desired window for channel 5145
wclsFrameSaver: no samples within desired window for channel 5146
wclsFrameSaver: no samples within desired window for channel 5146
wclsFrameSaver: no samples within desired window for channel 5147
wclsFrameSaver: no samples within desired window for channel 5234
wclsFrameSaver: no samples within desired window for channel 5235
wclsFrameSaver: no samples within desired window for channel 5235
wclsFrameSaver: no samples within desired window for channel 5236
wclsFrameSaver: no samples within desired window for channel 5237
wclsFrameSaver: no samples within desired window for channel 5237
wclsFrameSaver: no samples within desired window for channel 5237
wclsFrameSaver: no samples within desired window for channel 5238
wclsFrameSaver: no samples within desired window for channel 5238
wclsFrameSaver: no samples within desired window for channel 5239
wclsFrameSaver: no samples within desired window for channel 5239
wclsFrameSaver: no samples within desired window for channel 5240
wclsFrameSaver: no samples within desired window for channel 5241
wclsFrameSaver: no samples within desired window for channel 5241
wclsFrameSaver: no samples within desired window for channel 5241
wclsFrameSaver: no samples within desired window for channel 5242
wclsFrameSaver: no samples within desired window for channel 5243
wclsFrameSaver: no samples within desired window for channel 5243
wclsFrameSaver: no samples within desired window for channel 5244
wclsFrameSaver: no samples within desired window for channel 5244
wclsFrameSaver: no samples within desired window for channel 5245
wclsFrameSaver: no samples within desired window for channel 5245
wclsFrameSaver: no samples within desired window for channel 5246
wclsFrameSaver: no samples within desired window for channel 5247
wclsFrameSaver: no samples within desired window for channel 5248
wclsFrameSaver: no samples within desired window for channel 5249
wclsFrameSaver: no samples within desired window for channel 5249
wclsFrameSaver: no samples within desired window for channel 5250
wclsFrameSaver: no samples within desired window for channel 5597
wclsFrameSaver: no samples within desired window for channel 5600
wclsFrameSaver: no samples within desired window for channel 5601
wclsFrameSaver: no samples within desired window for channel 5601
wclsFrameSaver: no samples within desired window for channel 5602
wclsFrameSaver: no samples within desired window for channel 5603
wclsFrameSaver: no samples within desired window for channel 5604
wclsFrameSaver: no samples within desired window for channel 5604
wclsFrameSaver: no samples within desired window for channel 5605
wclsFrameSaver: no samples within desired window for channel 5605
wclsFrameSaver: no samples within desired window for channel 5606
wclsFrameSaver: no samples within desired window for channel 5606
wclsFrameSaver: no samples within desired window for channel 5606
wclsFrameSaver: no samples within desired window for channel 5607
wclsFrameSaver: no samples within desired window for channel 5607
wclsFrameSaver: no samples within desired window for channel 5608
wclsFrameSaver: no samples within desired window for channel 5608
wclsFrameSaver: no samples within desired window for channel 5608
wclsFrameSaver: no samples within desired window for channel 5609
wclsFrameSaver: no samples within desired window for channel 5609
wclsFrameSaver: no samples within desired window for channel 5610
wclsFrameSaver: no samples within desired window for channel 5610
wclsFrameSaver: no samples within desired window for channel 5611
wclsFrameSaver: no samples within desired window for channel 5611
wclsFrameSaver: no samples within desired window for channel 5612
wclsFrameSaver: no samples within desired window for channel 5613
wclsFrameSaver: no samples within desired window for channel 5613
wclsFrameSaver: no samples within desired window for channel 5613
wclsFrameSaver: no samples within desired window for channel 5614
wclsFrameSaver: no samples within desired window for channel 5614
wclsFrameSaver: no samples within desired window for channel 5615
wclsFrameSaver: no samples within desired window for channel 5615
wclsFrameSaver: no samples within desired window for channel 5615
wclsFrameSaver: no samples within desired window for channel 5616
wclsFrameSaver: no samples within desired window for channel 5617
wclsFrameSaver: no samples within desired window for channel 5617
FrameSaver: q=1.44429e+08 n=2313132 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 4232 XUs and 9252 XVs -> 82 XUVs
C:0 T:1 936 XUs and 2025 XVs -> 18 XUVs
C:0 T:2 1431 XUs and 1720 XVs -> 5 XUVs
C:0 T:3 1649 XUs and 4135 XVs -> 9 XUVs
C:0 T:4 119 XUs and 295 XVs -> 0 XUVs
C:0 T:5 270 XUs and 350 XVs -> 2 XUVs
C:0 T:6 862 XUs and 713 XVs -> 1 XUVs
C:0 T:7 601 XUs and 571 XVs -> 0 XUVs
117 XUVs total
105 collection wire objects
117 potential space points
Neighbour search...
405 tests to find 190 neighbours
Iterating with no regularization...
Begin: 1.66108e+12
0 1.66101e+12
Now with regularization...
Begin: 1.661e+12
0 1.661e+12
26-Nov-2025 10:58:29 GMT  Opened output file with pattern "%ifb_reco_stage1_%tc_laser_reco.root"
26-Nov-2025 10:58:34 GMT  Closed output file "3429_1_a_pvdt_reco_stage1_20251126T105834_laser_reco.root"
DataPrepModule::endJob: # events processed: 1
DataPrepModule::endJob:   # events skipped: 0

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        91.9411       91.9411       91.9411       91.9411          0            1     
----------------------------------------------------------------------------------------------------------------------------------
source:VDColdboxTDERawInput(read)               0.000145484   0.000145484   0.000145484   0.000145484        0            1     
produce:caldata:DataPrepModule                   0.438351      0.438351      0.438351      0.438351          0            1     
produce:wclsdatavd:WireCellToolkit                44.6144       44.6144       44.6144       44.6144          0            1     
produce:gaushit:GausHitFinder                     4.35926       4.35926       4.35926       4.35926          0            1     
produce:reco3d:SpacePointSolver                   7.45608       7.45608       7.45608       7.45608          0            1     
produce:hitpdune:DisambigFromSpacePoints         0.0775123     0.0775123     0.0775123     0.0775123         0            1     
produce:pandora:StandardPandora                   32.0813       32.0813       32.0813       32.0813          0            1     
produce:pandoraTrack:LArPandoraTrackCreation     0.131787      0.131787      0.131787      0.131787          0            1     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0127315     0.0127315     0.0127315     0.0127315         0            1     
[art]:TriggerResults:TriggerResultInserter      4.3021e-05    4.3021e-05    4.3021e-05    4.3021e-05         0            1     
end_path:out1:RootOutput                        1.7844e-05    1.7844e-05    1.7844e-05    1.7844e-05         0            1     
end_path:out1:RootOutput(write)                   2.76389       2.76389       2.76389       2.76389          0            1     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4469.44 MB
  Peak resident set size usage (VmHWM): 2142.28 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: 3429_1_a_pvdt_reco_stage1_20251126T105834_laser_reco.root
\tHists: 
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
justIN time: 2026-02-08 07:19:20 UTC       justIN version: 01.06.00