justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 39217.16@dunegpschedd01.fnal.gov

Jobsub ID39217.16@dunegpschedd01.fnal.gov
Workflow ID2135
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod.mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-02 20:11:05
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce03
Last heartbeat2025-09-02 21:00:41
From worker nodeHostnameccwcondor0051
cpuinfoAMD EPYC 9334 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-09-02 20:11:55
Input filesvd-protodune:np02vd_raw_run039275_0434_df-s05-d4_dw_0_20250902T045523.hdf5
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-09-02 21:00:41
Saved logsjustin-logs:39217.16-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

l 9129
wclsFrameSaver: no samples within desired window for channel 9130
wclsFrameSaver: no samples within desired window for channel 9130
wclsFrameSaver: no samples within desired window for channel 9130
wclsFrameSaver: no samples within desired window for channel 9156
wclsFrameSaver: no samples within desired window for channel 9157
wclsFrameSaver: no samples within desired window for channel 9158
wclsFrameSaver: no samples within desired window for channel 9158
wclsFrameSaver: no samples within desired window for channel 9159
wclsFrameSaver: no samples within desired window for channel 9551
wclsFrameSaver: no samples within desired window for channel 9573
wclsFrameSaver: no samples within desired window for channel 9576
wclsFrameSaver: no samples within desired window for channel 9802
wclsFrameSaver: no samples within desired window for channel 9803
wclsFrameSaver: no samples within desired window for channel 9803
wclsFrameSaver: no samples within desired window for channel 9848
wclsFrameSaver: no samples within desired window for channel 9866
wclsFrameSaver: no samples within desired window for channel 10090
wclsFrameSaver: no samples within desired window for channel 10092
wclsFrameSaver: no samples within desired window for channel 10093
wclsFrameSaver: no samples within desired window for channel 10277
wclsFrameSaver: no samples within desired window for channel 10352
wclsFrameSaver: no samples within desired window for channel 10398
wclsFrameSaver: no samples within desired window for channel 10542
wclsFrameSaver: no samples within desired window for channel 10543
wclsFrameSaver: no samples within desired window for channel 10544
wclsFrameSaver: no samples within desired window for channel 10546
wclsFrameSaver: no samples within desired window for channel 10549
wclsFrameSaver: no samples within desired window for channel 10550
wclsFrameSaver: no samples within desired window for channel 10568
wclsFrameSaver: no samples within desired window for channel 10739
wclsFrameSaver: no samples within desired window for channel 10746
wclsFrameSaver: no samples within desired window for channel 11077
wclsFrameSaver: no samples within desired window for channel 11077
wclsFrameSaver: no samples within desired window for channel 11078
wclsFrameSaver: no samples within desired window for channel 11078
wclsFrameSaver: no samples within desired window for channel 11078
wclsFrameSaver: no samples within desired window for channel 11079
wclsFrameSaver: no samples within desired window for channel 11079
wclsFrameSaver: no samples within desired window for channel 11080
wclsFrameSaver: no samples within desired window for channel 11080
wclsFrameSaver: no samples within desired window for channel 11080
wclsFrameSaver: no samples within desired window for channel 11081
wclsFrameSaver: no samples within desired window for channel 11081
wclsFrameSaver: no samples within desired window for channel 11081
wclsFrameSaver: no samples within desired window for channel 11082
wclsFrameSaver: no samples within desired window for channel 11102
wclsFrameSaver: no samples within desired window for channel 11488
wclsFrameSaver: no samples within desired window for channel 11489
wclsFrameSaver: no samples within desired window for channel 11530
wclsFrameSaver: no samples within desired window for channel 11531
wclsFrameSaver: no samples within desired window for channel 11531
wclsFrameSaver: no samples within desired window for channel 11531
wclsFrameSaver: no samples within desired window for channel 11860
wclsFrameSaver: no samples within desired window for channel 11861
wclsFrameSaver: no samples within desired window for channel 11861
wclsFrameSaver: no samples within desired window for channel 12084
wclsFrameSaver: no samples within desired window for channel 12084
wclsFrameSaver: no samples within desired window for channel 12084
wclsFrameSaver: no samples within desired window for channel 12085
wclsFrameSaver: no samples within desired window for channel 12086
wclsFrameSaver: no samples within desired window for channel 12086
wclsFrameSaver: no samples within desired window for channel 12087
wclsFrameSaver: no samples within desired window for channel 12087
wclsFrameSaver: no samples within desired window for channel 12088
wclsFrameSaver: no samples within desired window for channel 12088
wclsFrameSaver: no samples within desired window for channel 12088
wclsFrameSaver: no samples within desired window for channel 12089
wclsFrameSaver: no samples within desired window for channel 12089
wclsFrameSaver: no samples within desired window for channel 12090
wclsFrameSaver: no samples within desired window for channel 12090
wclsFrameSaver: no samples within desired window for channel 12091
wclsFrameSaver: no samples within desired window for channel 12091
wclsFrameSaver: no samples within desired window for channel 12092
FrameSaver: q=7.52904e+06 n=993831 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 2227 XUs and 2022 XVs -> 74 XUVs
C:0 T:1 2738 XUs and 3430 XVs -> 91 XUVs
C:0 T:2 1672 XUs and 1571 XVs -> 98 XUVs
C:0 T:3 900 XUs and 974 XVs -> 39 XUVs
C:0 T:4 291 XUs and 562 XVs -> 14 XUVs
C:0 T:5 197 XUs and 200 XVs -> 8 XUVs
C:0 T:6 544 XUs and 792 XVs -> 22 XUVs
C:0 T:7 441 XUs and 442 XVs -> 11 XUVs
C:0 T:8 6268 XUs and 5922 XVs -> 252 XUVs
C:0 T:9 1049 XUs and 1086 XVs -> 57 XUVs
C:0 T:10 1241 XUs and 1683 XVs -> 77 XUVs
C:0 T:11 2019 XUs and 1806 XVs -> 80 XUVs
C:0 T:12 215 XUs and 190 XVs -> 18 XUVs
C:0 T:13 277 XUs and 256 XVs -> 20 XUVs
C:0 T:14 1777 XUs and 1846 XVs -> 105 XUVs
C:0 T:15 222 XUs and 267 XVs -> 16 XUVs
982 XUVs total
856 collection wire objects
982 potential space points
Neighbour search...
5200 tests to find 2876 neighbours
Iterating with no regularization...
Begin: 2.48842e+08
0 2.45198e+08
1 2.44964e+08
Now with regularization...
Begin: 2.41475e+08
0 2.41464e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
02-Sep-2025 23:00:19 CEST  Closed output file "np02vd_raw_run039275_0434_df-s05-d4_dw_0_20250902T045523_reco_stage1_20250902T210019_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        104.793       159.341       216.691       154.175       31.1123        18     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      6.6411e-05    0.000113806   0.000220063   0.000110553   3.70449e-05      18     
produce:tpcrawdecoder:PDVDTPCReader               7.31004       8.48324       12.2183       8.1091        1.31697        18     
produce:triggerrawdecoder:PDVDTriggerReader4    0.00561323    0.00616033    0.00703928    0.00612877    0.000316275      18     
produce:pdvddaphne:DAPHNEReaderPDVD               3.49183       4.07422       5.34309       4.02246      0.425264        18     
produce:ophit:OpHitFinder                        0.0538249     0.0639717     0.075419      0.0635054    0.00588194       18     
produce:opflash:OpFlashFinderVerticalDrift      0.00666215     0.0150476     0.0218499     0.0158392    0.00373646       18     
produce:wclsdatavd:WireCellToolkit                54.9794       65.7385       82.503        64.5839       6.4513         18     
produce:gaushit:GausHitFinder                    0.739168       1.39072       2.00745       1.47884      0.330953        18     
produce:nhitsfilter:NumberOfHitsFilter          0.000156827   0.000343893   0.000794094   0.000320511   0.000136141      18     
produce:reco3d:SpacePointSolver                    7.546        15.7094       22.9907       16.4048       3.98104        18     
produce:hitpdune:DisambigFromSpacePoints         0.136396      0.280446      0.477885      0.288311      0.0983807       18     
produce:pandora:StandardPandora                   17.9725       56.2785       108.917       54.0397       23.9551        18     
produce:pandoraTrack:LArPandoraTrackCreation     0.689391       1.38588       2.3273        1.35689      0.472899        18     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0192274     0.037004      0.0573111     0.0397504     0.0110049       18     
[art]:TriggerResults:TriggerResultInserter      2.4266e-05    5.15632e-05   0.000101935   5.1513e-05    2.17682e-05      18     
end_path:out1:RootOutput                         4.657e-06    1.06077e-05   3.1157e-05    8.8535e-06    6.06193e-06      18     
end_path:out1:RootOutput(write)                   4.63239       5.8101        6.66799       5.87288      0.510263        18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5053.17 MB
  Peak resident set size usage (VmHWM): 3117.52 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039275_0434_df-s05-d4_dw_0_20250902T045523_reco_stage1_20250902T210019_keepup.root
\tHists: np02vd_raw_run039275_0434_df-s05-d4_dw_0_20250902T045523_reco_stage1_20250902T210019_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
justIN time: 2025-11-05 09:25:34 UTC       justIN version: 01.05.01