justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 38819.159@dunegpschedd01.fnal.gov

Jobsub ID38819.159@dunegpschedd01.fnal.gov
Workflow ID2128
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod.mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-02 09:12:38
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2025-09-02 11:20:35
From worker nodeHostnameccwcondor0564
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-09-02 09:31:55
Input filesvd-protodune:np02vd_raw_run039273_1533_df-s05-d5_dw_0_20250901T065508.hdf5
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-09-02 11:20:35
Saved logsjustin-logs:38819.159-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

annel 8709
wclsFrameSaver: no samples within desired window for channel 8710
wclsFrameSaver: no samples within desired window for channel 8718
wclsFrameSaver: no samples within desired window for channel 8842
wclsFrameSaver: no samples within desired window for channel 8864
wclsFrameSaver: no samples within desired window for channel 8868
wclsFrameSaver: no samples within desired window for channel 8869
wclsFrameSaver: no samples within desired window for channel 8871
wclsFrameSaver: no samples within desired window for channel 8872
wclsFrameSaver: no samples within desired window for channel 9086
wclsFrameSaver: no samples within desired window for channel 9086
wclsFrameSaver: no samples within desired window for channel 9088
wclsFrameSaver: no samples within desired window for channel 9170
wclsFrameSaver: no samples within desired window for channel 9170
wclsFrameSaver: no samples within desired window for channel 9171
wclsFrameSaver: no samples within desired window for channel 9171
wclsFrameSaver: no samples within desired window for channel 9171
wclsFrameSaver: no samples within desired window for channel 9174
wclsFrameSaver: no samples within desired window for channel 9258
wclsFrameSaver: no samples within desired window for channel 9258
wclsFrameSaver: no samples within desired window for channel 9258
wclsFrameSaver: no samples within desired window for channel 9272
wclsFrameSaver: no samples within desired window for channel 9386
wclsFrameSaver: no samples within desired window for channel 9386
wclsFrameSaver: no samples within desired window for channel 9387
wclsFrameSaver: no samples within desired window for channel 9711
wclsFrameSaver: no samples within desired window for channel 9712
wclsFrameSaver: no samples within desired window for channel 9864
wclsFrameSaver: no samples within desired window for channel 9864
wclsFrameSaver: no samples within desired window for channel 9865
wclsFrameSaver: no samples within desired window for channel 9866
wclsFrameSaver: no samples within desired window for channel 9866
wclsFrameSaver: no samples within desired window for channel 9867
wclsFrameSaver: no samples within desired window for channel 9869
wclsFrameSaver: no samples within desired window for channel 9903
wclsFrameSaver: no samples within desired window for channel 10262
wclsFrameSaver: no samples within desired window for channel 10293
wclsFrameSaver: no samples within desired window for channel 10293
wclsFrameSaver: no samples within desired window for channel 10296
wclsFrameSaver: no samples within desired window for channel 10353
wclsFrameSaver: no samples within desired window for channel 10354
wclsFrameSaver: no samples within desired window for channel 10431
wclsFrameSaver: no samples within desired window for channel 10432
wclsFrameSaver: no samples within desired window for channel 10433
wclsFrameSaver: no samples within desired window for channel 10725
wclsFrameSaver: no samples within desired window for channel 10726
wclsFrameSaver: no samples within desired window for channel 10728
wclsFrameSaver: no samples within desired window for channel 10728
wclsFrameSaver: no samples within desired window for channel 10729
wclsFrameSaver: no samples within desired window for channel 10737
wclsFrameSaver: no samples within desired window for channel 10852
wclsFrameSaver: no samples within desired window for channel 11064
wclsFrameSaver: no samples within desired window for channel 11141
wclsFrameSaver: no samples within desired window for channel 11208
wclsFrameSaver: no samples within desired window for channel 11208
wclsFrameSaver: no samples within desired window for channel 11208
wclsFrameSaver: no samples within desired window for channel 11243
wclsFrameSaver: no samples within desired window for channel 11243
wclsFrameSaver: no samples within desired window for channel 11244
wclsFrameSaver: no samples within desired window for channel 11244
wclsFrameSaver: no samples within desired window for channel 11245
wclsFrameSaver: no samples within desired window for channel 11245
wclsFrameSaver: no samples within desired window for channel 11626
wclsFrameSaver: no samples within desired window for channel 11627
wclsFrameSaver: no samples within desired window for channel 11627
wclsFrameSaver: no samples within desired window for channel 11733
wclsFrameSaver: no samples within desired window for channel 11734
wclsFrameSaver: no samples within desired window for channel 11735
wclsFrameSaver: no samples within desired window for channel 11736
wclsFrameSaver: no samples within desired window for channel 11737
wclsFrameSaver: no samples within desired window for channel 11986
wclsFrameSaver: no samples within desired window for channel 11986
wclsFrameSaver: no samples within desired window for channel 11988
FrameSaver: q=1.43708e+07 n=1594136 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1725 XUs and 2241 XVs -> 98 XUVs
C:0 T:1 2266 XUs and 2756 XVs -> 121 XUVs
C:0 T:2 1734 XUs and 1337 XVs -> 66 XUVs
C:0 T:3 2276 XUs and 2831 XVs -> 231 XUVs
C:0 T:4 2322 XUs and 2525 XVs -> 101 XUVs
C:0 T:5 1267 XUs and 1351 XVs -> 61 XUVs
C:0 T:6 289 XUs and 258 XVs -> 10 XUVs
C:0 T:7 1062 XUs and 899 XVs -> 29 XUVs
C:0 T:8 9739 XUs and 21935 XVs -> 4031 XUVs
C:0 T:9 11371 XUs and 26250 XVs -> 3606 XUVs
C:0 T:10 9875 XUs and 21205 XVs -> 2414 XUVs
C:0 T:11 15434 XUs and 34873 XVs -> 5434 XUVs
C:0 T:12 12482 XUs and 24601 XVs -> 2843 XUVs
C:0 T:13 13112 XUs and 36155 XVs -> 4022 XUVs
C:0 T:14 13955 XUs and 25584 XVs -> 3521 XUVs
C:0 T:15 6573 XUs and 8271 XVs -> 1335 XUVs
27923 XUVs total
3372 collection wire objects
27923 potential space points
Neighbour search...
4066669 tests to find 1696910 neighbours
Iterating with no regularization...
Begin: 8.03607e+08
0 7.0508e+08
1 6.99413e+08
2 6.98319e+08
3 6.9791e+08
Now with regularization...
Begin: 6.80822e+08
0 6.80368e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
02-Sep-2025 13:19:54 CEST  Closed output file "np02vd_raw_run039273_1533_df-s05-d5_dw_0_20250901T065508_reco_stage1_20250902T111954_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        182.767       354.372       709.944       343.025       118.82         18     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      9.5368e-05    0.000150631   0.000377064   0.000124352   7.80608e-05      18     
produce:tpcrawdecoder:PDVDTPCReader               10.6898       12.8959       16.5868       12.633        1.81311        18     
produce:triggerrawdecoder:PDVDTriggerReader4    0.00806612     0.0140163     0.0276749     0.0118306    0.00603591       18     
produce:pdvddaphne:DAPHNEReaderPDVD               5.39837       6.39644       8.03931       6.39945       0.7538         18     
produce:ophit:OpHitFinder                        0.0551612     0.0679696     0.0872209     0.0677292    0.00885193       18     
produce:opflash:OpFlashFinderVerticalDrift       0.0126606     0.0203972     0.0295433     0.0197899    0.00397161       18     
produce:wclsdatavd:WireCellToolkit                81.1692       99.1143       118.422       96.9484       9.64548        18     
produce:gaushit:GausHitFinder                     1.62349       2.49667       3.53461       2.50214      0.447408        18     
produce:nhitsfilter:NumberOfHitsFilter          0.000462494   0.00146489     0.0138503    0.000671415   0.00301844       18     
produce:reco3d:SpacePointSolver                   15.7635       28.1511       39.3613       28.6105       6.60596        18     
produce:hitpdune:DisambigFromSpacePoints         0.271235      0.557705       0.79737      0.601181      0.155915        18     
produce:pandora:StandardPandora                   57.2345       192.636       529.569       178.123       108.294        18     
produce:pandoraTrack:LArPandoraTrackCreation      1.42957       4.56492       9.53444       4.07764       2.16487        18     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0458237     0.0705996     0.141246      0.0623168     0.0232753       18     
[art]:TriggerResults:TriggerResultInserter      3.5146e-05    9.39161e-05   0.000327131   7.85815e-05   6.72369e-05      18     
end_path:out1:RootOutput                         1.04e-05     2.86192e-05   0.000145442   1.5895e-05    3.64047e-05      18     
end_path:out1:RootOutput(write)                   6.33801       7.26004       9.55977       7.15452      0.640278        18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5218.03 MB
  Peak resident set size usage (VmHWM): 3287.59 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039273_1533_df-s05-d5_dw_0_20250901T065508_reco_stage1_20250902T111954_keepup.root
\tHists: np02vd_raw_run039273_1533_df-s05-d5_dw_0_20250901T065508_reco_stage1_20250902T111954_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
justIN time: 2025-09-19 01:29:23 UTC       justIN version: 01.05.00