justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265175.0@dunegpschedd02.fnal.gov

Jobsub ID265175.0@dunegpschedd02.fnal.gov
Workflow ID11429
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-30 21:37:07
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce505
Last heartbeat2025-12-31 01:28:33
From worker nodeHostnameb9p02p2870.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-30 21:37:52
Input filesmonte-carlo-011429-000001
JobscriptExit code0
Real time3h (13756s)
CPU time3h (12408s = 90%)
Max RSS bytes4193587200 (3999 MiB)
Outputting started2025-12-31 01:27:10
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11429/1/001/reco_stage1.root
Finished2025-12-31 01:28:33
Saved logsjustin-logs:265175.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

rvice:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 135920 traces, 0 summary
Retagger: tagging trace set: gauss with 104982 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 104982 traces tagged "gauss"
FrameSaver: q=3.52776e+06 n=1828084 tag=gauss
wclsFrameSaver: saving 135920 traces tagged "wiener"
FrameSaver: q=3.71555e+06 n=1611634 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 19922 XUs and 16570 XVs -> 258 XUVs
C:0 T:1 18858 XUs and 16943 XVs -> 852 XUVs
C:0 T:2 172179 XUs and 285496 XVs -> 12510 XUVs
C:0 T:3 70824 XUs and 97522 XVs -> 1022 XUVs
C:0 T:4 2611 XUs and 3408 XVs -> 18 XUVs
C:0 T:5 12191 XUs and 14988 XVs -> 2171 XUVs
C:0 T:6 98086 XUs and 132517 XVs -> 5807 XUVs
C:0 T:7 35482 XUs and 49079 XVs -> 434 XUVs
C:0 T:8 8592 XUs and 8690 XVs -> 59 XUVs
C:0 T:9 52619 XUs and 68015 XVs -> 3797 XUVs
C:0 T:10 43203 XUs and 39370 XVs -> 7170 XUVs
C:0 T:11 569 XUs and 460 XVs -> 68 XUVs
34166 XUVs total
12907 collection wire objects
30887 potential space points
Neighbour search...
2129567 tests to find 1069010 neighbours
Iterating with no regularization...
Begin: 7.05441e+07
0 6.22504e+07
1 6.15258e+07
2 6.14247e+07
3 6.13934e+07
Now with regularization...
Begin: 5.109e+07
0 5.10794e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411441894
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411441894
fLifetime: 30000 [us]
31-Dec-2025 02:27:06 CET  Closed output file "reco_stage1.root"
31-Dec-2025 02:27:06 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          261.621       354.884       489.111       347.506       57.9025        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                             0.0010857    0.00447356     0.0096304    0.00401637     0.0026036       10     
reco:ophit:OpHitFinder                             0.234969      0.308957      0.419458      0.295264      0.0528824       10     
reco:opflash:OpFlashFinder                         0.127284      0.177347      0.224268      0.178559      0.0289601       10     
reco:opslicer:OpSlicer                             0.492443       0.66099      0.993054      0.655709      0.151532        10     
reco:caldata:DataPrepModule                         4.36787       5.76418       7.49004       5.50212       1.07294        10     
reco:wclsdatasp:WireCellToolkit                     32.3836       34.9344       37.2969       35.2404       1.82682        10     
reco:gaushit:GausHitFinder                         0.819122       1.20702       1.94896       1.13466       0.33601        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000409765   0.000579106   0.000981772   0.000575402   0.000155368      10     
reco:reco3d:SpacePointSolver                        9.05815       16.4462       27.8887       14.828        5.73024        10     
reco:hitpdune:DisambigFromSpacePoints              0.912683       1.63026       2.12824       1.68016       0.36485        10     
reco:pandora:StandardPandora                        15.9273       33.4835       54.5675       32.2527       10.8525        10     
reco:pandoraWriter:StandardPandora                 0.239241       0.44598      0.676915       0.4464        0.12339        10     
reco:pandoraTrack:LArPandoraTrackCreation           1.87164       3.58455       6.39722       3.23957       1.19416        10     
reco:pandoraShower:LArPandoraShowerCreation         2.07095       3.79912       6.86427       3.66052       1.24061        10     
reco:pandoracalo:Calorimetry                        1.30003       2.31507       3.61713       2.19366      0.583144        10     
reco:pandoracalonosce:Calorimetry                   1.17886       1.9324        2.56054       1.9333       0.419137        10     
reco:pandorapid:Chi2ParticleID                    0.00393649     0.0066511    0.00869025    0.00683259    0.00125444       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0396952     0.0610359     0.0707791     0.0639092    0.00901014       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00385389    0.00595473    0.00725154    0.00666391    0.00126388       10     
reco:pandoraShowercalo:ShowerCalorimetry            2.11711       3.99122       6.94778       3.80654       1.24394        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.13713       3.88692       7.59941       3.60077       1.4052         10     
reco:emtrkmichelid:EmTrackMichelId                  158.51        198.483       258.165       196.817       25.2271        10     
reco:crttag:SingleCRTMatchingProducer             0.00899244     0.0133855     0.0260338     0.0127703    0.00446211       10     
reco:crtreco:TwoCRTMatchingProducer               0.00603908    0.00934994     0.0152399    0.00905654    0.00270232       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.714455      0.982668       1.35706      0.976989      0.176596        10     
reco:pandora2Track:LArPandoraTrackCreation           4.318        11.6871       21.2325       11.6383       4.37022        10     
reco:pandora2calo:Calorimetry                       2.99424       6.04656       10.2689       5.55891       1.96821        10     
reco:pandora2calonosce:Calorimetry                  3.25056       5.9082        10.4289       5.4748        1.89435        10     
reco:pandora2pid:Chi2ParticleID                   0.00857692     0.0157321     0.0233103     0.0160797    0.00448874       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0495881     0.0815666      0.1174       0.0832517     0.0195233       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00893374     0.016707      0.0289387     0.0165872    0.00582074       10     
reco:pandora2Shower:LArPandoraShowerCreation        2.53693       4.18211       6.16398       4.02096       1.0359         10     
reco:pandora2Showercalo:ShowerCalorimetry           2.98323       5.16685       7.75662       5.05527       1.28457        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      2.74821        4.534        5.90594       4.58789      0.992594        10     
[art]:TriggerResults:TriggerResultInserter        5.9061e-05    8.83682e-05   0.000165562   7.9896e-05    2.93859e-05      10     
end_path:out1:RootOutput                           1.013e-05    1.71202e-05    3.609e-05    1.44105e-05   7.2918e-06       10     
end_path:out1:RootOutput(write)                     2.15421       3.00717       4.50147       2.81788      0.655377        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5018.62 MB
  Peak resident set size usage (VmHWM): 4193.59 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.26 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.52 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.14 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9871344
-rw-r--r--. 1 duneprd np-comp 2330737465 Dec 31 01:24 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2209377580 Dec 31 01:22 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 2009425063 Dec 31 02:27 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 1785060675 Dec 30 23:10 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1699776921 Dec 30 22:46 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp   73268710 Dec 31 02:22 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp     242552 Dec 31 02:27 jobscript.log
-rw-r--r--. 1 duneprd np-comp     217088 Dec 31 02:27 mem.db
-rw-r--r--. 1 duneprd np-comp      62376 Dec 31 02:27 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp      36864 Dec 31 02:27 time.db
-rw-r--r--. 1 duneprd np-comp        519 Dec 31 01:24 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Dec 30 23:10 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Dec 31 02:27 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp         52 Dec 30 22:37 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp          7 Dec 31 02:27 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp          0 Dec 31 01:33 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp          0 Dec 31 01:24 debugprod.log
justIN time: 2026-02-07 00:49:51 UTC       justIN version: 01.06.00