justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263476.1@dunegpschedd02.fnal.gov

Jobsub ID263476.1@dunegpschedd02.fnal.gov
Workflow ID11284
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-19 20:07:18
SiteIT_CNAF
EntryCMSHTPC_T1_IT_CNAF_condor_ce02
Last heartbeat2025-12-19 23:01:24
From worker nodeHostnamewn-s04-05-38-02.cr.cnaf.infn.it
cpuinfoAMD EPYC 7313 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-19 20:07:52
Input filesmonte-carlo-011284-000001
JobscriptExit code0
Real time2h (10067s)
CPU time2h (9722s = 96%)
Max RSS bytes4331425792 (4130 MiB)
Outputting started2025-12-19 22:55:40
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11284/1/001/reco_stage1.root
Finished2025-12-19 23:01:24
Saved logsjustin-logs:263476.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

essing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 141267 traces, 0 summary
Retagger: tagging trace set: gauss with 107696 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 107696 traces tagged "gauss"
FrameSaver: q=3.57583e+06 n=1892826 tag=gauss
wclsFrameSaver: saving 141267 traces tagged "wiener"
FrameSaver: q=3.80854e+06 n=1670955 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38456 XUs and 23317 XVs -> 454 XUVs
C:0 T:1 159254 XUs and 71146 XVs -> 9143 XUVs
C:0 T:2 79525 XUs and 111095 XVs -> 3729 XUVs
C:0 T:3 39283 XUs and 47578 XVs -> 287 XUVs
C:0 T:4 16882 XUs and 15372 XVs -> 298 XUVs
C:0 T:5 136305 XUs and 57020 XVs -> 8565 XUVs
C:0 T:6 88073 XUs and 109418 XVs -> 3612 XUVs
C:0 T:7 37505 XUs and 42891 XVs -> 341 XUVs
C:0 T:8 9143 XUs and 12550 XVs -> 175 XUVs
C:0 T:9 80718 XUs and 121558 XVs -> 6650 XUVs
C:0 T:10 31771 XUs and 35760 XVs -> 4637 XUVs
C:0 T:11 129 XUs and 95 XVs -> 16 XUVs
37907 XUVs total
14246 collection wire objects
34663 potential space points
Neighbour search...
2343063 tests to find 1187426 neighbours
Iterating with no regularization...
Begin: 6.64076e+07
0 4.60835e+07
1 4.50681e+07
2 4.49187e+07
3 4.48747e+07
Now with regularization...
Begin: 3.53395e+07
0 3.52902e+07
1 3.52694e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411219563
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411219563
fLifetime: 30000 [us]
19-Dec-2025 23:55:38 CET  Closed output file "reco_stage1.root"
19-Dec-2025 23:55:38 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          189.697       228.291       284.492       218.85        32.242         10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000992925   0.00318316    0.00464407    0.00351372    0.00124617       10     
reco:ophit:OpHitFinder                             0.208577      0.234988      0.343621      0.220505      0.0387795       10     
reco:opflash:OpFlashFinder                         0.135981      0.158747      0.188445      0.157232      0.0154179       10     
reco:opslicer:OpSlicer                             0.403308      0.486472      0.675862      0.475242      0.069953        10     
reco:caldata:DataPrepModule                         3.44501       4.0794        6.57468       3.50515       1.13244        10     
reco:wclsdatasp:WireCellToolkit                     22.5124       24.0098       28.7657       23.2734       1.81054        10     
reco:gaushit:GausHitFinder                         0.644398      0.788586      0.911899      0.788811      0.0825341       10     
reco:nhitsfilter:NumberOfHitsFilter               0.000296116   0.000373789   0.000601881   0.000349732   8.46089e-05      10     
reco:reco3d:SpacePointSolver                        5.46205       9.42103       15.9668       9.21226       2.94849        10     
reco:hitpdune:DisambigFromSpacePoints              0.853763       1.12794       1.56837       1.06315      0.225318        10     
reco:pandora:StandardPandora                        14.3427       23.2355       32.5505       22.7983       6.61357        10     
reco:pandoraWriter:StandardPandora                 0.227684      0.285905      0.370666       0.2763       0.0483305       10     
reco:pandoraTrack:LArPandoraTrackCreation           1.7479        2.40718       3.31713       2.30878       0.49433        10     
reco:pandoraShower:LArPandoraShowerCreation         1.81356       2.73612       3.86936       2.56768      0.712935        10     
reco:pandoracalo:Calorimetry                        1.15055       1.46406       1.92387       1.41325      0.268946        10     
reco:pandoracalonosce:Calorimetry                   1.05782       1.37185       1.80297       1.32965       0.25485        10     
reco:pandorapid:Chi2ParticleID                     0.0030648    0.00381123     0.0051974     0.0036923    0.000576021      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0300573     0.0340479     0.040045      0.0336105    0.00311924       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID           0.0028486    0.00329069    0.00398323    0.00323364    0.000355306      10     
reco:pandoraShowercalo:ShowerCalorimetry            2.08833       3.13871       4.24635       3.01094       0.78366        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.03855       3.07472       4.17302       2.93133      0.781644        10     
reco:emtrkmichelid:EmTrackMichelId                  103.869       120.837       149.025       117.976       14.3714        10     
reco:crttag:SingleCRTMatchingProducer             0.00727607     0.0103653     0.0194433    0.00895997    0.00363921       10     
reco:crtreco:TwoCRTMatchingProducer               0.00467555    0.00527177    0.00610973    0.00507465    0.000506729      10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.512709       0.6114       0.742041       0.58497      0.0782785       10     
reco:pandora2Track:LArPandoraTrackCreation          5.63965       7.91115       10.9692       7.28099        1.96          10     
reco:pandora2calo:Calorimetry                       3.15901       4.39676       5.87031       4.19711      0.999532        10     
reco:pandora2calonosce:Calorimetry                  3.03435       4.19273       5.60683       3.95423      0.957485        10     
reco:pandora2pid:Chi2ParticleID                   0.00745873    0.00887784     0.0108739    0.00858162    0.00117761       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0355041     0.0422721     0.0508434     0.0416526    0.00481897       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00692352    0.00840619    0.00998851    0.00819072     0.0011919       10     
reco:pandora2Shower:LArPandoraShowerCreation         2.143        2.86094       3.81982       2.65727       0.62339        10     
reco:pandora2Showercalo:ShowerCalorimetry           2.83425       3.82026       5.0963        3.60709      0.829952        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      2.63167       3.47281       4.65762       3.29486      0.711756        10     
[art]:TriggerResults:TriggerResultInserter        3.0237e-05    5.38542e-05   0.000130295   4.24495e-05   2.89256e-05      10     
end_path:out1:RootOutput                           8.135e-06    1.31687e-05   1.8445e-05    1.2639e-05    3.0124e-06       10     
end_path:out1:RootOutput(write)                     1.66621       1.98912       2.42563       1.97897       0.24659        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5135.16 MB
  Peak resident set size usage (VmHWM): 4331.43 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.18 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.51 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.10 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10874620
-rw-r--r-- 1 neutrino002 neutrino 2530112216 Dec 19 23:16 detsim_stage2.root
-rw-r--r-- 1 neutrino002 neutrino 2400367668 Dec 19 23:14 detsim_stage1.root
-rw-r--r-- 1 neutrino002 neutrino 2240522064 Dec 19 23:55 reco_stage1.root
-rw-r--r-- 1 neutrino002 neutrino 1989828390 Dec 19 21:27 g4_stage2.root
-rw-r--r-- 1 neutrino002 neutrino 1893070329 Dec 19 21:16 g4_stage1.root
-rw-r--r-- 1 neutrino002 neutrino   81078930 Dec 19 23:52 Pandora_Events.pndr
-rw-r--r-- 1 neutrino002 neutrino     242763 Dec 19 23:55 jobscript.log
-rw-r--r-- 1 neutrino002 neutrino     217088 Dec 19 23:55 mem.db
-rw-r--r-- 1 neutrino002 neutrino      62376 Dec 19 23:55 Pandora_Geometry.xml
-rw-r--r-- 1 neutrino002 neutrino      36864 Dec 19 23:55 time.db
-rw-r--r-- 1 neutrino002 neutrino        519 Dec 19 23:16 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 neutrino002 neutrino        519 Dec 19 21:27 g4_protoDUNE_hist.root
-rw-r--r-- 1 neutrino002 neutrino        519 Dec 19 23:55 protoDUNE_reco1_hist.root
-rw-r--r-- 1 neutrino002 neutrino         52 Dec 19 21:07 all-input-dids.txt
-rw-r--r-- 1 neutrino002 neutrino          7 Dec 19 23:55 justin-processed-pfns.txt
-rw-r--r-- 1 neutrino002 neutrino          0 Dec 19 23:19 ProtoDUNE.log
-rw-r--r-- 1 neutrino002 neutrino          0 Dec 19 23:16 debugprod.log
justIN time: 2026-02-07 06:28:52 UTC       justIN version: 01.06.00