justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 275791.0@dunegpschedd01.fnal.gov

Jobsub ID275791.0@dunegpschedd01.fnal.gov
Workflow ID11742
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-12 08:41:55
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2026-01-12 12:25:03
From worker nodeHostnameccwcondor0568
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-12 08:42:45
Input filesmonte-carlo-011742-000001
JobscriptExit code0
Real time3h (13237s)
CPU time3h (12760s = 96%)
Max RSS bytes4389466112 (4186 MiB)
Outputting started2026-01-12 12:23:23
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11742/1/001/reco_stage1.root
Finished2026-01-12 12:25:03
Saved logsjustin-logs:275791.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 153442 traces, 0 summary
Retagger: tagging trace set: gauss with 115023 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 115023 traces tagged "gauss"
FrameSaver: q=4.10416e+06 n=2060176 tag=gauss
wclsFrameSaver: saving 153442 traces tagged "wiener"
FrameSaver: q=4.35327e+06 n=1823555 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 29667 XUs and 32962 XVs -> 528 XUVs
C:0 T:1 58554 XUs and 60383 XVs -> 6061 XUVs
C:0 T:2 93139 XUs and 136791 XVs -> 7049 XUVs
C:0 T:3 47537 XUs and 56706 XVs -> 299 XUVs
C:0 T:4 15869 XUs and 15490 XVs -> 139 XUVs
C:0 T:5 71005 XUs and 55929 XVs -> 4597 XUVs
C:0 T:6 144633 XUs and 182854 XVs -> 16231 XUVs
C:0 T:7 48780 XUs and 59018 XVs -> 1206 XUVs
C:0 T:8 6416 XUs and 6340 XVs -> 61 XUVs
C:0 T:9 37851 XUs and 60657 XVs -> 4879 XUVs
C:0 T:10 58503 XUs and 131078 XVs -> 16028 XUVs
C:0 T:11 153 XUs and 95 XVs -> 17 XUVs
57095 XUVs total
14247 collection wire objects
51905 potential space points
Neighbour search...
6419899 tests to find 3101292 neighbours
Iterating with no regularization...
Begin: 8.76236e+07
0 7.07963e+07
1 6.97517e+07
2 6.95789e+07
3 6.95202e+07
Now with regularization...
Begin: 5.75272e+07
0 5.74601e+07
1 5.74163e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411692774
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411692774
fLifetime: 30000 [us]
12-Jan-2026 13:23:20 CET  Closed output file "reco_stage1.root"
12-Jan-2026 13:23:20 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          311.252       417.781       559.995       395.024       79.2787        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00172304    0.00450528    0.00698722    0.00453401    0.00167906       10     
reco:ophit:OpHitFinder                              0.24782      0.323847       0.40505      0.335178      0.0487703       10     
reco:opflash:OpFlashFinder                         0.162316      0.199471      0.256075      0.188011      0.0320898       10     
reco:opslicer:OpSlicer                             0.472132      0.731192      0.991415      0.763283      0.194022        10     
reco:caldata:DataPrepModule                         5.15581       6.28634       7.12117       6.49501       0.72613        10     
reco:wclsdatasp:WireCellToolkit                     32.505        38.3164       44.2001       38.4554       3.26583        10     
reco:gaushit:GausHitFinder                         0.809418       1.42682       1.93316       1.49039      0.282226        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000460513   0.000662789   0.00114409    0.000605285   0.000190708      10     
reco:reco3d:SpacePointSolver                        12.1825       18.4114       26.5424       17.4131       5.26699        10     
reco:hitpdune:DisambigFromSpacePoints               1.17799       1.89852       3.07369       1.77964      0.610246        10     
reco:pandora:StandardPandora                        22.3921       40.851        69.1615       39.6615       15.7291        10     
reco:pandoraWriter:StandardPandora                 0.332537      0.494134      0.675029      0.510034      0.0956636       10     
reco:pandoraTrack:LArPandoraTrackCreation           4.9455        6.37143       9.06839       5.75186       1.30294        10     
reco:pandoraShower:LArPandoraShowerCreation         4.77245       7.63388       13.0576       6.64817       2.78926        10     
reco:pandoracalo:Calorimetry                        2.75878       3.89271       5.72292       3.78704      0.876945        10     
reco:pandoracalonosce:Calorimetry                   2.26662       3.64364       5.54619       3.39982       1.10357        10     
reco:pandorapid:Chi2ParticleID                     0.003993     0.00710912    0.00859448    0.00773954    0.00156126       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0349128     0.0638314     0.0841333     0.0705831     0.0163128       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00380642    0.00675343    0.00837274    0.00722803    0.00145342       10     
reco:pandoraShowercalo:ShowerCalorimetry            4.11364       7.93736       13.0178        7.515        3.09099        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       3.38044       7.83322       13.7019       7.13851       3.2563         10     
reco:emtrkmichelid:EmTrackMichelId                  159.728       201.704       256.381       196.673       28.5628        10     
reco:crttag:SingleCRTMatchingProducer              0.0117488     0.0191839     0.025262      0.0181537    0.00402206       10     
reco:crtreco:TwoCRTMatchingProducer               0.00755052     0.0147483     0.0221454     0.014438     0.00392368       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.696363      0.951293       1.20423      0.970518      0.145322        10     
reco:pandora2Track:LArPandoraTrackCreation          12.4748       20.2238       32.7311       19.6321       6.18547        10     
reco:pandora2calo:Calorimetry                       4.85316       10.9558       17.7497       10.5575       3.90861        10     
reco:pandora2calonosce:Calorimetry                  5.17487       10.6098       16.8799       10.1788       3.52837        10     
reco:pandora2pid:Chi2ParticleID                   0.00994594     0.0170959     0.0268106     0.018091     0.00488509       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0498928     0.0821625     0.117661      0.0831442     0.0221358       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00953088     0.0168251     0.0260793     0.0178018    0.00487789       10     
reco:pandora2Shower:LArPandoraShowerCreation        4.35144       6.98458       10.8063       6.58179       2.07917        10     
reco:pandora2Showercalo:ShowerCalorimetry           4.62587       8.80115       15.6786       8.95725       2.95552        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.19495       7.98607       13.0332       8.23733       2.45653        10     
[art]:TriggerResults:TriggerResultInserter         4.829e-05    8.88915e-05   0.00021319    7.3713e-05    4.50983e-05      10     
end_path:out1:RootOutput                           9.358e-06    1.28873e-05   2.1129e-05    1.2313e-05    3.15491e-06      10     
end_path:out1:RootOutput(write)                     2.38277       2.91072       4.05411       2.78615      0.520112        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5211.27 MB
  Peak resident set size usage (VmHWM): 4389.47 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.29 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.93 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.17 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10473820
-rw-r--r-- 1 dune001 lbno 2461614143 Jan 12 12:11 detsim_stage2.root
-rw-r--r-- 1 dune001 lbno 2338265645 Jan 12 12:09 detsim_stage1.root
-rw-r--r-- 1 dune001 lbno 2145604946 Jan 12 13:23 reco_stage1.root
-rw-r--r-- 1 dune001 lbno 1883389080 Jan 12 10:04 g4_stage2.root
-rw-r--r-- 1 dune001 lbno 1821209204 Jan 12 09:51 g4_stage1.root
-rw-r--r-- 1 dune001 lbno   74486960 Jan 12 13:16 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno     242720 Jan 12 13:23 jobscript.log
-rw-r--r-- 1 dune001 lbno     217088 Jan 12 13:23 mem.db
-rw-r--r-- 1 dune001 lbno      62376 Jan 12 13:23 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno      36864 Jan 12 13:23 time.db
-rw-r--r-- 1 dune001 lbno        519 Jan 12 12:11 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno        519 Jan 12 10:04 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno        519 Jan 12 13:23 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 lbno         52 Jan 12 09:42 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno          7 Jan 12 13:23 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno          0 Jan 12 12:16 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno          0 Jan 12 12:11 debugprod.log
justIN time: 2026-02-06 10:22:29 UTC       justIN version: 01.06.00