Jobsub ID 38977.169@dunegpschedd01.fnal.gov
| Jobsub ID | 38977.169@dunegpschedd01.fnal.gov |
| Workflow ID | 2183 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod.mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-02 14:40:49 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce01 |
| Last heartbeat | 2025-09-02 15:19:38 |
| From worker node | Hostname | ccwcondor0564 |
| cpuinfo | AMD EPYC 7453 28-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Started | 2025-09-02 14:42:34 |
| Input files | vd-protodune:np02vd_raw_run038563_0010_df-s05-d2_dw_0_20250804T180434.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Max RSS bytes | 0 (0 MiB) |
| Outputting started | |
| Output files | |
| Finished | 2025-09-02 15:19:38 |
| Saved logs | justin-logs:38977.169-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
roi2":3980 [0] "mp3_roi2":1541 [0] "wiener2":6407 [6407] ] cmm:[ ] input 3: frame: ident=2174 time=196 tick=500 with 8044 traces. frame tags:[ "sigproc" ] 4 tagged trace sets:[ "gauss3":2586 [0] "mp2_roi3":1650 [0] "mp3_roi3":609 [0] "wiener3":3199 [3199] ] cmm:[ ] input 4: frame: ident=2174 time=196 tick=512 with 0 traces. frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] input 5: frame: ident=2174 time=196 tick=512 with 0 traces. frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] input 6: frame: ident=2174 time=196 tick=512 with 0 traces. frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] input 7: frame: ident=2174 time=196 tick=512 with 0 traces. frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] output: frame: ident=2174 time=196 tick=500 with 71123 traces. frame tags:[ "framefanin" ] 8 tagged trace sets:[ "gauss0":8602 [0] "gauss1":4205 [0] "gauss2":5370 [0] "gauss3":2586 [0] "wiener0":10824 [10824] "wiener1":5315 [5315] "wiener2":6407 [6407] "wiener3":3199 [3199] ] cmm:[ ]
Retagger: tagging trace set: wiener with 25745 traces, 25745 summary
Retagger: tagging trace set: gauss with 20763 traces, 0 summary
[17:18:57.087] D [ glue ] sink frame: #2174 @0.000196 with 71123 traces, frame tags:[retagger], trace tags:[gauss, wiener]
[17:18:57.088] D [ glue ] <FrameFanout:nfsp> call=65: see EOS
[17:18:57.088] D [ glue ] <ChannelSelector:chsel7> see EOS at call=32
[17:18:57.088] D [sigproc ] <OmnibusSigProc:anode7sigproc7> EOS at call=65 anode=7
[17:18:57.088] D [ glue ] <ChannelSelector:chsel6> see EOS at call=32
[17:18:57.088] D [sigproc ] <OmnibusSigProc:anode6sigproc6> EOS at call=65 anode=6
[17:18:57.088] D [ glue ] <ChannelSelector:chsel5> see EOS at call=32
[17:18:57.088] D [sigproc ] <OmnibusSigProc:anode5sigproc5> EOS at call=65 anode=5
[17:18:57.088] D [ glue ] <ChannelSelector:chsel4> see EOS at call=32
[17:18:57.088] D [sigproc ] <OmnibusSigProc:anode4sigproc4> EOS at call=65 anode=4
[17:18:57.088] D [ glue ] <ChannelSelector:chsel3> see EOS at call=32
[17:18:57.088] D [ aux ] <Resampler:resmp3> EOS at call=65
[17:18:57.088] D [sigproc ] <OmnibusSigProc:anode3sigproc3> EOS at call=65 anode=3
[17:18:57.088] D [ glue ] <ChannelSelector:chsel2> see EOS at call=32
[17:18:57.088] D [ aux ] <Resampler:resmp2> EOS at call=65
[17:18:57.088] D [sigproc ] <OmnibusSigProc:anode2sigproc2> EOS at call=65 anode=2
[17:18:57.088] D [ glue ] <ChannelSelector:chsel1> see EOS at call=32
[17:18:57.088] D [ aux ] <Resampler:resmp1> EOS at call=65
[17:18:57.088] D [sigproc ] <OmnibusSigProc:anode1sigproc1> EOS at call=65 anode=1
[17:18:57.088] D [ glue ] <ChannelSelector:chsel0> see EOS at call=32
[17:18:57.088] D [ aux ] <Resampler:resmp0> EOS at call=65
[17:18:57.088] D [sigproc ] <OmnibusSigProc:anode0sigproc0> EOS at call=65 anode=0
[17:18:57.088] D [ glue ] <FrameFanin:nfsp> EOS at call=65 with 8
[17:18:57.088] D [ glue ] frame sink sees EOS
[17:18:57.088] D [ pgraph ] <Pgrapher:> graph execution complete
[17:18:57.088] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 9.29 sec
[17:18:57.088] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 8.03 sec
[17:18:57.088] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 7.35 sec
[17:18:57.088] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 7.05 sec
[17:18:57.088] I [ timer ] Timer: WireCell::Aux::Resampler : 1.12 sec
[17:18:57.088] I [ timer ] Timer: WireCell::Aux::Resampler : 1.08 sec
[17:18:57.088] I [ timer ] Timer: WireCell::Aux::Resampler : 1.07 sec
[17:18:57.089] I [ timer ] Timer: WireCell::Aux::Resampler : 1.05 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.02 sec
[17:18:57.089] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.01 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::Gen::Retagger : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::Gen::FrameFanout : 0 sec
[17:18:57.089] I [ timer ] Timer: wcls::RawFrameSource : 0 sec
[17:18:57.089] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[17:18:57.089] I [ timer ] Timer: wcls::FrameSaver : 0 sec
[17:18:57.089] I [ timer ] Timer: Total node execution : 36.069999841973186 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 20763 traces tagged "gauss"
FrameSaver: q=2.65637e+06 n=449495 tag=gauss
wclsFrameSaver: saving 25745 traces tagged "wiener"
FrameSaver: q=2.76844e+06 n=430607 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1093 XUs and 1552 XVs -> 53 XUVs
C:0 T:1 2773 XUs and 2307 XVs -> 110 XUVs
C:0 T:2 893 XUs and 938 XVs -> 43 XUVs
C:0 T:3 519 XUs and 403 XVs -> 15 XUVs
C:0 T:4 546 XUs and 910 XVs -> 38 XUVs
C:0 T:5 516 XUs and 595 XVs -> 32 XUVs
C:0 T:6 470 XUs and 466 XVs -> 15 XUVs
C:0 T:7 201 XUs and 284 XVs -> 16 XUVs
322 XUVs total
285 collection wire objects
322 potential space points
Neighbour search...
1732 tests to find 770 neighbours
Iterating with no regularization...
Begin: 6.47327e+07
0 6.32942e+07
1 6.32931e+07
Now with regularization...
Begin: 6.21701e+07
0 6.21699e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
02-Sep-2025 17:19:14 CEST Closed output file "np02vd_raw_run038563_0010_df-s05-d2_dw_0_20250804T180434_reco_stage1_20250902T151914_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 47.906 65.2328 83.0031 63.0612 8.73787 33
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.5443e-05 0.000118822 0.000285053 0.000108603 4.16989e-05 33
produce:tpcrawdecoder:PDVDTPCReader 3.65443 4.1006 6.93853 3.9613 0.541704 33
produce:triggerrawdecoder:PDVDTriggerReader4 0.00594034 0.00663632 0.0122489 0.00640953 0.00104336 33
produce:pdvddaphne:DAPHNEReaderPDVD 3.62452 5.04202 5.96776 5.06059 0.389717 33
produce:ophit:OpHitFinder 0.0485943 0.0715071 0.0880112 0.0724045 0.00946081 33
produce:opflash:OpFlashFinderVerticalDrift 0.00676246 0.0156819 0.0276711 0.015406 0.00446234 33
produce:wclsdatavd:WireCellToolkit 29.1569 36.6738 40.7109 36.9191 2.2846 33
produce:gaushit:GausHitFinder 0.243446 0.590544 0.891742 0.582026 0.152706 33
produce:nhitsfilter:NumberOfHitsFilter 9.1341e-05 0.000158628 0.000520252 0.000144811 7.113e-05 33
produce:reco3d:SpacePointSolver 1.06791 4.33686 7.66715 3.8507 1.67948 33
produce:hitpdune:DisambigFromSpacePoints 0.0111254 0.039653 0.0796233 0.0325487 0.0181095 33
produce:pandora:StandardPandora 1.6605 10.7177 25.2849 9.30378 5.82358 33
produce:pandoraTrack:LArPandoraTrackCreation 0.0528074 0.204573 0.54054 0.177086 0.0950923 33
produce:pandoraGnocalo:GnocchiCalorimetry 0.00845371 0.0157432 0.0249634 0.0152776 0.00420413 33
[art]:TriggerResults:TriggerResultInserter 2.4435e-05 4.00223e-05 6.8478e-05 3.9353e-05 9.40126e-06 33
end_path:out1:RootOutput 3.506e-06 1.00796e-05 3.6758e-05 9.217e-06 6.08941e-06 33
end_path:out1:RootOutput(write) 2.47202 3.39537 6.56526 3.32731 0.635803 33
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4062.5 MB
Peak resident set size usage (VmHWM): 2133.03 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run038563_0010_df-s05-d2_dw_0_20250804T180434_reco_stage1_20250902T151914_keepup.root
\tHists: np02vd_raw_run038563_0010_df-s05-d2_dw_0_20250804T180434_reco_stage1_20250902T151914_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
