justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 38789.123@dunegpschedd02.fnal.gov

Jobsub ID38789.123@dunegpschedd02.fnal.gov
Workflow ID2523
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-12 06:29:32
SiteUK_Bristol
EntryCMSHTPC_T2_UK_SGrid_Bristol_lcgce02
Last heartbeat2025-09-12 08:51:07
From worker nodeHostnamehd79.dice.priv
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit259200 (72 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2025-09-12 06:57:20
Input filesvd-protodune:np02vd_raw_run039273_0776_df-s04-d3_dw_0_20250831T203302.hdf5
JobscriptExit code4
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-09-12 08:51:07
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 20.83 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 17.72 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 15.69 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 15.05 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 11.44 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 10.91 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 10.88 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 10.73 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::Aux::Resampler : 1.29 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::Aux::Resampler : 1.26 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::Aux::Resampler : 1.26 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::Aux::Resampler : 1.23 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::Gen::FrameFanin : 0.03 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::Gen::Retagger : 0.01 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::Gen::DumpFrames : 0 sec
[08:49:25.018] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[08:49:25.019] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[08:49:25.019] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[08:49:25.019] I [ timer  ] Timer: WireCell::Gen::FrameFanout : 0 sec
[08:49:25.019] I [ timer  ] Timer: wcls::RawFrameSource : 0 sec
[08:49:25.019] I [ timer  ] Timer: wcls::FrameSaver : 0 sec
[08:49:25.019] I [ timer  ] Timer: Total node execution : 118.33999805338681 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 46466 traces tagged "gauss"
wclsFrameSaver: no samples within desired window for channel 6166
wclsFrameSaver: no samples within desired window for channel 6279
wclsFrameSaver: no samples within desired window for channel 6335
wclsFrameSaver: no samples within desired window for channel 6337
wclsFrameSaver: no samples within desired window for channel 6769
wclsFrameSaver: no samples within desired window for channel 7135
wclsFrameSaver: no samples within desired window for channel 7136
wclsFrameSaver: no samples within desired window for channel 7363
wclsFrameSaver: no samples within desired window for channel 7363
wclsFrameSaver: no samples within desired window for channel 7444
wclsFrameSaver: no samples within desired window for channel 7536
wclsFrameSaver: no samples within desired window for channel 7821
wclsFrameSaver: no samples within desired window for channel 7831
wclsFrameSaver: no samples within desired window for channel 8081
wclsFrameSaver: no samples within desired window for channel 8082
wclsFrameSaver: no samples within desired window for channel 8103
wclsFrameSaver: no samples within desired window for channel 8104
wclsFrameSaver: no samples within desired window for channel 8105
wclsFrameSaver: no samples within desired window for channel 8106
wclsFrameSaver: no samples within desired window for channel 8107
wclsFrameSaver: no samples within desired window for channel 8107
wclsFrameSaver: no samples within desired window for channel 8336
wclsFrameSaver: no samples within desired window for channel 8336
wclsFrameSaver: no samples within desired window for channel 9534
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9859
wclsFrameSaver: no samples within desired window for channel 9860
wclsFrameSaver: no samples within desired window for channel 10253
wclsFrameSaver: no samples within desired window for channel 10267
wclsFrameSaver: no samples within desired window for channel 10283
wclsFrameSaver: no samples within desired window for channel 10380
wclsFrameSaver: no samples within desired window for channel 10724
wclsFrameSaver: no samples within desired window for channel 10726
wclsFrameSaver: no samples within desired window for channel 10972
wclsFrameSaver: no samples within desired window for channel 10984
wclsFrameSaver: no samples within desired window for channel 11865
wclsFrameSaver: no samples within desired window for channel 11865
wclsFrameSaver: no samples within desired window for channel 11866
wclsFrameSaver: no samples within desired window for channel 11867
wclsFrameSaver: no samples within desired window for channel 11884
wclsFrameSaver: no samples within desired window for channel 11884
wclsFrameSaver: no samples within desired window for channel 11885
wclsFrameSaver: no samples within desired window for channel 11885
FrameSaver: q=7.83887e+06 n=989746 tag=gauss
wclsFrameSaver: saving 58867 traces tagged "wiener"
wclsFrameSaver: no samples within desired window for channel 6166
wclsFrameSaver: no samples within desired window for channel 6277
wclsFrameSaver: no samples within desired window for channel 6279
wclsFrameSaver: no samples within desired window for channel 6335
wclsFrameSaver: no samples within desired window for channel 6769
wclsFrameSaver: no samples within desired window for channel 7135
wclsFrameSaver: no samples within desired window for channel 7135
wclsFrameSaver: no samples within desired window for channel 7195
wclsFrameSaver: no samples within desired window for channel 7363
wclsFrameSaver: no samples within desired window for channel 7444
wclsFrameSaver: no samples within desired window for channel 7536
wclsFrameSaver: no samples within desired window for channel 7821
wclsFrameSaver: no samples within desired window for channel 7831
wclsFrameSaver: no samples within desired window for channel 8081
wclsFrameSaver: no samples within desired window for channel 8081
wclsFrameSaver: no samples within desired window for channel 8082
wclsFrameSaver: no samples within desired window for channel 8083
wclsFrameSaver: no samples within desired window for channel 8103
wclsFrameSaver: no samples within desired window for channel 8103
wclsFrameSaver: no samples within desired window for channel 8104
wclsFrameSaver: no samples within desired window for channel 8105
wclsFrameSaver: no samples within desired window for channel 8106
wclsFrameSaver: no samples within desired window for channel 8106
wclsFrameSaver: no samples within desired window for channel 8106
wclsFrameSaver: no samples within desired window for channel 8107
wclsFrameSaver: no samples within desired window for channel 8107
wclsFrameSaver: no samples within desired window for channel 8335
wclsFrameSaver: no samples within desired window for channel 8336
wclsFrameSaver: no samples within desired window for channel 8336
wclsFrameSaver: no samples within desired window for channel 9534
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9859
wclsFrameSaver: no samples within desired window for channel 9860
wclsFrameSaver: no samples within desired window for channel 10253
wclsFrameSaver: no samples within desired window for channel 10267
wclsFrameSaver: no samples within desired window for channel 10283
wclsFrameSaver: no samples within desired window for channel 10380
wclsFrameSaver: no samples within desired window for channel 10724
wclsFrameSaver: no samples within desired window for channel 10725
wclsFrameSaver: no samples within desired window for channel 10726
wclsFrameSaver: no samples within desired window for channel 10972
wclsFrameSaver: no samples within desired window for channel 10984
wclsFrameSaver: no samples within desired window for channel 11865
wclsFrameSaver: no samples within desired window for channel 11865
wclsFrameSaver: no samples within desired window for channel 11866
wclsFrameSaver: no samples within desired window for channel 11867
wclsFrameSaver: no samples within desired window for channel 11867
wclsFrameSaver: no samples within desired window for channel 11884
wclsFrameSaver: no samples within desired window for channel 11885
wclsFrameSaver: no samples within desired window for channel 11885
wclsFrameSaver: no samples within desired window for channel 11885
FrameSaver: q=8.53664e+06 n=943075 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 507 XUs and 627 XVs -> 18 XUVs
C:0 T:1 736 XUs and 614 XVs -> 34 XUVs
C:0 T:2 1645 XUs and 1656 XVs -> 112 XUVs
C:0 T:3 197 XUs and 151 XVs -> 2 XUVs
C:0 T:4 645 XUs and 867 XVs -> 45 XUVs
C:0 T:5 166 XUs and 300 XVs -> 11 XUVs
C:0 T:6 2759 XUs and 2980 XVs -> 168 XUVs
C:0 T:7 164 XUs and 167 XVs -> 5 XUVs
C:0 T:8 21217 XUs and 44732 XVs -> 10302 XUVs
C:0 T:9 10606 XUs and 33938 XVs -> 4350 XUVs
C:0 T:10 12799 XUs and 22922 XVs -> 6240 XUVs
C:0 T:11 3910 XUs and 5123 XVs -> 886 XUVs
C:0 T:12 1861 XUs and 2716 XVs -> 253 XUVs
C:0 T:13 1978 XUs and 2980 XVs -> 377 XUVs
C:0 T:14 3800 XUs and 5379 XVs -> 755 XUVs
C:0 T:15 102 XUs and 154 XVs -> 10 XUVs
23568 XUVs total
2211 collection wire objects
23568 potential space points
Neighbour search...
4527986 tests to find 1791266 neighbours
Iterating with no regularization...
Begin: 4.00697e+08
0 3.45022e+08
1 3.41085e+08
2 3.40447e+08
3 3.40209e+08
Now with regularization...
Begin: 3.29572e+08
0 3.29291e+08
PcaShowerParticleBuildingAlgorithm::OpeningAngle - principal eigenvalue less than or equal to 0.
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
../justin-jobscript: line 158:  1145 Bus error               (core dumped) LD_PRELOAD=$XROOTD_LIB/libXrdPosixPreload.so lar -c ${FCL1} -n ${nevents} ${extra_line} ${pfn}
../justin-jobscript: line 160: date: command not found
Error in reco1
../justin-jobscript: line 164: cat: command not found
justIN time: 2025-11-03 18:51:11 UTC       justIN version: 01.05.01