justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 39145.2@dunegpschedd01.fnal.gov

Jobsub ID39145.2@dunegpschedd01.fnal.gov
Workflow ID2178
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod.mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-02 18:12:58
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce03
Last heartbeat2025-09-02 19:09:57
From worker nodeHostnameccwcondor0051
cpuinfoAMD EPYC 9334 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-09-02 18:15:07
Input filesvd-protodune:np02vd_raw_run039275_0243_df-s01-d2_dw_0_20250901T225517.hdf5
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-09-02 19:09:57
Saved logsjustin-logs:39145.2-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

amples within desired window for channel 9137
wclsFrameSaver: no samples within desired window for channel 9137
wclsFrameSaver: no samples within desired window for channel 9138
wclsFrameSaver: no samples within desired window for channel 9138
wclsFrameSaver: no samples within desired window for channel 9138
wclsFrameSaver: no samples within desired window for channel 9139
wclsFrameSaver: no samples within desired window for channel 9139
wclsFrameSaver: no samples within desired window for channel 9139
wclsFrameSaver: no samples within desired window for channel 9140
wclsFrameSaver: no samples within desired window for channel 9140
wclsFrameSaver: no samples within desired window for channel 9141
wclsFrameSaver: no samples within desired window for channel 9142
wclsFrameSaver: no samples within desired window for channel 9144
wclsFrameSaver: no samples within desired window for channel 9146
wclsFrameSaver: no samples within desired window for channel 9149
wclsFrameSaver: no samples within desired window for channel 9332
wclsFrameSaver: no samples within desired window for channel 9473
wclsFrameSaver: no samples within desired window for channel 9474
wclsFrameSaver: no samples within desired window for channel 9475
wclsFrameSaver: no samples within desired window for channel 9475
wclsFrameSaver: no samples within desired window for channel 9476
wclsFrameSaver: no samples within desired window for channel 9476
wclsFrameSaver: no samples within desired window for channel 9477
wclsFrameSaver: no samples within desired window for channel 9478
wclsFrameSaver: no samples within desired window for channel 9479
wclsFrameSaver: no samples within desired window for channel 9479
wclsFrameSaver: no samples within desired window for channel 9495
wclsFrameSaver: no samples within desired window for channel 9583
wclsFrameSaver: no samples within desired window for channel 9605
wclsFrameSaver: no samples within desired window for channel 9631
wclsFrameSaver: no samples within desired window for channel 9631
wclsFrameSaver: no samples within desired window for channel 9632
wclsFrameSaver: no samples within desired window for channel 9633
wclsFrameSaver: no samples within desired window for channel 9634
wclsFrameSaver: no samples within desired window for channel 10205
wclsFrameSaver: no samples within desired window for channel 10274
wclsFrameSaver: no samples within desired window for channel 10333
wclsFrameSaver: no samples within desired window for channel 10444
wclsFrameSaver: no samples within desired window for channel 10490
wclsFrameSaver: no samples within desired window for channel 10491
wclsFrameSaver: no samples within desired window for channel 10492
wclsFrameSaver: no samples within desired window for channel 10503
wclsFrameSaver: no samples within desired window for channel 10503
wclsFrameSaver: no samples within desired window for channel 10505
wclsFrameSaver: no samples within desired window for channel 10505
wclsFrameSaver: no samples within desired window for channel 10506
wclsFrameSaver: no samples within desired window for channel 10507
wclsFrameSaver: no samples within desired window for channel 10507
wclsFrameSaver: no samples within desired window for channel 10508
wclsFrameSaver: no samples within desired window for channel 10509
wclsFrameSaver: no samples within desired window for channel 10509
wclsFrameSaver: no samples within desired window for channel 10510
wclsFrameSaver: no samples within desired window for channel 10511
wclsFrameSaver: no samples within desired window for channel 10708
wclsFrameSaver: no samples within desired window for channel 10830
wclsFrameSaver: no samples within desired window for channel 10996
wclsFrameSaver: no samples within desired window for channel 11088
wclsFrameSaver: no samples within desired window for channel 11089
wclsFrameSaver: no samples within desired window for channel 11353
wclsFrameSaver: no samples within desired window for channel 11353
wclsFrameSaver: no samples within desired window for channel 11353
wclsFrameSaver: no samples within desired window for channel 11436
wclsFrameSaver: no samples within desired window for channel 11436
wclsFrameSaver: no samples within desired window for channel 11437
wclsFrameSaver: no samples within desired window for channel 11465
wclsFrameSaver: no samples within desired window for channel 11465
wclsFrameSaver: no samples within desired window for channel 11466
wclsFrameSaver: no samples within desired window for channel 11469
wclsFrameSaver: no samples within desired window for channel 11469
wclsFrameSaver: no samples within desired window for channel 11678
wclsFrameSaver: no samples within desired window for channel 11678
wclsFrameSaver: no samples within desired window for channel 11679
wclsFrameSaver: no samples within desired window for channel 11679
wclsFrameSaver: no samples within desired window for channel 11680
wclsFrameSaver: no samples within desired window for channel 11681
wclsFrameSaver: no samples within desired window for channel 11682
FrameSaver: q=5.66354e+06 n=605484 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 629 XUs and 958 XVs -> 65 XUVs
C:0 T:1 718 XUs and 1139 XVs -> 52 XUVs
C:0 T:2 285 XUs and 469 XVs -> 20 XUVs
C:0 T:3 424 XUs and 425 XVs -> 27 XUVs
C:0 T:4 134 XUs and 117 XVs -> 3 XUVs
C:0 T:5 26 XUs and 22 XVs -> 0 XUVs
C:0 T:6 343 XUs and 616 XVs -> 26 XUVs
C:0 T:7 352 XUs and 482 XVs -> 17 XUVs
C:0 T:8 991 XUs and 761 XVs -> 61 XUVs
C:0 T:9 2290 XUs and 1387 XVs -> 129 XUVs
C:0 T:10 431 XUs and 491 XVs -> 26 XUVs
C:0 T:11 1577 XUs and 1560 XVs -> 132 XUVs
C:0 T:12 2780 XUs and 2081 XVs -> 153 XUVs
C:0 T:13 2397 XUs and 3005 XVs -> 130 XUVs
C:0 T:14 4976 XUs and 3905 XVs -> 327 XUVs
C:0 T:15 2291 XUs and 1851 XVs -> 107 XUVs
1275 XUVs total
1109 collection wire objects
1275 potential space points
Neighbour search...
10803 tests to find 5124 neighbours
Iterating with no regularization...
Begin: 4.81774e+08
0 4.70474e+08
1 4.70352e+08
Now with regularization...
Begin: 4.65523e+08
0 4.65514e+08
02-Sep-2025 21:09:27 CEST  Closed output file "np02vd_raw_run039275_0243_df-s01-d2_dw_0_20250901T225517_reco_stage1_20250902T190927_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        113.14        178.648        273.6        165.829       46.3865        18     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      7.4543e-05    0.000107393   0.000266885   0.000100348   4.29015e-05      18     
produce:tpcrawdecoder:PDVDTPCReader               6.49244       7.35115       8.25371       7.31485      0.494896        18     
produce:triggerrawdecoder:PDVDTriggerReader4    0.00584471    0.00692761     0.0174717    0.00623137     0.0025787       18     
produce:pdvddaphne:DAPHNEReaderPDVD               3.56568       3.96571       4.5766        3.90355      0.307847        18     
produce:ophit:OpHitFinder                        0.0467137     0.0618379     0.0848768     0.0610999    0.00768039       18     
produce:opflash:OpFlashFinderVerticalDrift      0.00589834     0.0142543     0.0207175     0.0143525    0.00392371       18     
produce:wclsdatavd:WireCellToolkit                65.0446       71.2828       79.6162       70.8635       3.86597        18     
produce:gaushit:GausHitFinder                    0.735466       1.4032        1.90168       1.40152      0.298128        18     
produce:nhitsfilter:NumberOfHitsFilter          0.000141755   0.000335095   0.000569163   0.000315097   0.00010134       18     
produce:reco3d:SpacePointSolver                   8.42367       16.4766       24.1575       16.5064       4.7845         18     
produce:hitpdune:DisambigFromSpacePoints         0.121323      0.293797      0.465571       0.2902        0.10264        18     
produce:pandora:StandardPandora                   20.0955       70.4304       161.502       59.9432       42.2977        18     
produce:pandoraTrack:LArPandoraTrackCreation     0.560902       1.33377       2.66316       1.32763      0.580683        18     
produce:pandoraGnocalo:GnocchiCalorimetry        0.019796      0.0382596     0.052362      0.0390529     0.0100154       18     
[art]:TriggerResults:TriggerResultInserter      2.7692e-05    4.68938e-05   9.3601e-05     3.959e-05    1.69991e-05      18     
end_path:out1:RootOutput                         4.257e-06    1.05048e-05   3.1047e-05    9.5395e-06    5.65288e-06      18     
end_path:out1:RootOutput(write)                   4.81157       5.92349       6.70456       6.02835      0.468956        18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5226.66 MB
  Peak resident set size usage (VmHWM): 3305.56 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039275_0243_df-s01-d2_dw_0_20250901T225517_reco_stage1_20250902T190927_keepup.root
\tHists: np02vd_raw_run039275_0243_df-s01-d2_dw_0_20250901T225517_reco_stage1_20250902T190927_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
justIN time: 2025-11-05 10:38:16 UTC       justIN version: 01.05.01