justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 246857.0@dunegpschedd02.fnal.gov

Jobsub ID246857.0@dunegpschedd02.fnal.gov
Workflow ID10242
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-11-16 04:28:32
SiteIT_CNAF
EntryCMSHTPC_T1_IT_CNAF_condor_ce02
Last heartbeat2025-11-16 09:40:41
From worker nodeHostnamewn-f01-15-01-07.cr.cnaf.infn.it
cpuinfoIntel(R) Xeon(R) CPU E5-2697 v4 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-16 04:29:52
Input filesmonte-carlo-010242-000001
JobscriptExit code0
Real time5h (18585s)
CPU time5h (18227s = 98%)
Max RSS bytes3973234688 (3789 MiB)
Outputting started2025-11-16 09:39:38
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10242/1/001/reco_stage1.root
Finished2025-11-16 09:40:41
Saved logsjustin-logs:246857.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

re:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 123500 traces, 0 summary
Retagger: tagging trace set: gauss with 91317 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 91317 traces tagged "gauss"
FrameSaver: q=3.24058e+06 n=1545976 tag=gauss
wclsFrameSaver: saving 123500 traces tagged "wiener"
FrameSaver: q=3.45294e+06 n=1352391 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 34400 XUs and 32106 XVs -> 419 XUVs
C:0 T:1 97963 XUs and 64836 XVs -> 7782 XUVs
C:0 T:2 45326 XUs and 43953 XVs -> 4230 XUVs
C:0 T:3 18783 XUs and 17272 XVs -> 487 XUVs
C:0 T:4 16902 XUs and 18789 XVs -> 211 XUVs
C:0 T:5 95214 XUs and 64895 XVs -> 11102 XUVs
C:0 T:6 41273 XUs and 58916 XVs -> 2893 XUVs
C:0 T:7 16513 XUs and 26579 XVs -> 125 XUVs
C:0 T:8 7098 XUs and 6843 XVs -> 36 XUVs
C:0 T:9 78985 XUs and 67556 XVs -> 7584 XUVs
C:0 T:10 25341 XUs and 20248 XVs -> 4283 XUVs
C:0 T:11 295 XUs and 208 XVs -> 48 XUVs
39200 XUVs total
9669 collection wire objects
35470 potential space points
Neighbour search...
4254424 tests to find 2079788 neighbours
Iterating with no regularization...
Begin: 7.82267e+07
0 6.64671e+07
1 6.57086e+07
2 6.5604e+07
3 6.55684e+07
Now with regularization...
Begin: 5.57291e+07
0 5.56686e+07
1 5.56356e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410542594
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410542594
fLifetime: 30000 [us]
16-Nov-2025 10:39:35 CET  Closed output file "reco_stage1.root"
16-Nov-2025 10:39:35 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          430.702       662.593       859.921       668.993       133.265        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00181114    0.00383424    0.00599034    0.00391396    0.00122811       10     
reco:ophit:OpHitFinder                             0.274474      0.361647      0.488028      0.358563      0.0665788       10     
reco:opflash:OpFlashFinder                         0.143341      0.198097      0.276555      0.191065      0.0376756       10     
reco:opslicer:OpSlicer                             0.704339      0.983148       1.30118       0.93213      0.160207        10     
reco:caldata:DataPrepModule                         6.70121       8.93098       9.86968       9.36803       1.0153         10     
reco:wclsdatasp:WireCellToolkit                     53.8275       62.9216       73.9654       62.6379       5.90191        10     
reco:gaushit:GausHitFinder                          1.19585       2.10195       2.89589       2.15314      0.597538        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000540235   0.000925561   0.00147751    0.000924818   0.00026497       10     
reco:reco3d:SpacePointSolver                        7.63919       17.4742       23.821        17.3762       4.92558        10     
reco:hitpdune:DisambigFromSpacePoints               1.46446       3.7095        5.12453       3.70936       1.03342        10     
reco:pandora:StandardPandora                        27.2847       57.3622       85.3085       53.8527       18.0583        10     
reco:pandoraWriter:StandardPandora                  0.5459       0.731097       0.92987      0.733404      0.121042        10     
reco:pandoraTrack:LArPandoraTrackCreation           7.55576       11.2515       14.2605       11.5183       1.81126        10     
reco:pandoraShower:LArPandoraShowerCreation         6.20878       13.1238       19.7234       13.5408       4.13649        10     
reco:pandoracalo:Calorimetry                        3.58421        5.814        7.97689       6.05959       1.32851        10     
reco:pandoracalonosce:Calorimetry                   3.18887       5.26138       7.34385       5.49529       1.27845        10     
reco:pandorapid:Chi2ParticleID                     0.0077792     0.0107951     0.0123539     0.0112008     0.0012141       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0785822      0.10136      0.124924      0.102101      0.0149028       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00590856    0.00958155     0.0115856    0.00993217    0.00164293       10     
reco:pandoraShowercalo:ShowerCalorimetry            5.83741       13.4367       21.3876       14.6315       4.73715        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       5.6148        13.0957       21.4031       14.1385       4.70805        10     
reco:emtrkmichelid:EmTrackMichelId                  226.881       321.639       399.048       331.189       55.4568        10     
reco:crttag:SingleCRTMatchingProducer              0.029019      0.0403219     0.0527882     0.0410023    0.00790447       10     
reco:crtreco:TwoCRTMatchingProducer                0.0220959     0.0315798     0.0411312     0.0303386    0.00604475       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.57208       2.2815        2.96778       2.34754      0.417283        10     
reco:pandora2Track:LArPandoraTrackCreation          21.0433       40.3334       58.0239       39.5545       12.1418        10     
reco:pandora2calo:Calorimetry                       8.87847       18.0508       27.0587       16.8703       5.96437        10     
reco:pandora2calonosce:Calorimetry                  8.47135       16.4181       25.8228       14.329        5.30254        10     
reco:pandora2pid:Chi2ParticleID                    0.0154452     0.0281327     0.0355509     0.0295048    0.00592488       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0904924     0.137766      0.170126      0.137164      0.0251611       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.014826      0.0276583     0.0365809     0.0284373    0.00591957       10     
reco:pandora2Shower:LArPandoraShowerCreation        7.85053       12.8988       18.3907       12.2203       3.28829        10     
reco:pandora2Showercalo:ShowerCalorimetry           6.93256       15.2909       24.151        14.6313       5.23709        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      5.51455       14.5313       23.2104       14.7221       5.26572        10     
[art]:TriggerResults:TriggerResultInserter        7.5427e-05    0.000106767   0.000200658   9.97025e-05   3.37919e-05      10     
end_path:out1:RootOutput                          1.0979e-05    1.46957e-05   2.1264e-05    1.43155e-05   2.75113e-06      10     
end_path:out1:RootOutput(write)                     2.08142       3.81314       5.69575       3.49812       1.15855        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4783.82 MB
  Peak resident set size usage (VmHWM): 3973.23 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.13 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.37 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   5.60 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.30 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9044848
-rw-r--r-- 1 neutrino002 neutrino 2155817035 Nov 16 08:46 detsim_stage2.root
-rw-r--r-- 1 neutrino002 neutrino 2044244927 Nov 16 08:43 detsim_stage1.root
-rw-r--r-- 1 neutrino002 neutrino 1816397616 Nov 16 10:39 reco_stage1.root
-rw-r--r-- 1 neutrino002 neutrino 1622230088 Nov 16 05:59 g4_stage2.root
-rw-r--r-- 1 neutrino002 neutrino 1554161015 Nov 16 05:38 g4_stage1.root
-rw-r--r-- 1 neutrino002 neutrino   68442680 Nov 16 10:31 Pandora_Events.pndr
-rw-r--r-- 1 neutrino002 neutrino     242656 Nov 16 10:39 jobscript.log
-rw-r--r-- 1 neutrino002 neutrino     217088 Nov 16 10:39 mem.db
-rw-r--r-- 1 neutrino002 neutrino      62376 Nov 16 10:39 Pandora_Geometry.xml
-rw-r--r-- 1 neutrino002 neutrino      36864 Nov 16 10:39 time.db
-rw-r--r-- 1 neutrino002 neutrino        519 Nov 16 08:46 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 neutrino002 neutrino        519 Nov 16 05:59 g4_protoDUNE_hist.root
-rw-r--r-- 1 neutrino002 neutrino        519 Nov 16 10:39 protoDUNE_reco1_hist.root
-rw-r--r-- 1 neutrino002 neutrino         52 Nov 16 05:29 all-input-dids.txt
-rw-r--r-- 1 neutrino002 neutrino          7 Nov 16 10:39 justin-processed-pfns.txt
-rw-r--r-- 1 neutrino002 neutrino          0 Nov 16 08:57 ProtoDUNE.log
-rw-r--r-- 1 neutrino002 neutrino          0 Nov 16 08:46 debugprod.log
justIN time: 2026-02-09 10:52:27 UTC       justIN version: 01.06.00