Jobsub ID 302182.0@dunegpschedd01.fnal.gov
| Jobsub ID | 302182.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12541 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-29 21:26:32 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce01 |
| Last heartbeat | 2026-01-30 01:51:20 |
| From worker node | Hostname | wn2209251.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-29 21:41:29 |
| Input files | monte-carlo-012541-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (14896s) |
| CPU time | 4h (14506s = 97%) |
| Max RSS bytes | 4126949376 (3935 MiB) |
| Outputting started | 2026-01-30 01:49:46 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12541/1/001/reco_stage1.root
|
| Finished | 2026-01-30 01:51:20 |
| Saved logs | justin-logs:302182.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
g tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 114118 traces, 0 summary
Retagger: tagging trace set: gauss with 88903 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 88903 traces tagged "gauss"
FrameSaver: q=3.10736e+06 n=1584441 tag=gauss
wclsFrameSaver: saving 114118 traces tagged "wiener"
FrameSaver: q=3.27725e+06 n=1411485 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 24713 XUs and 24364 XVs -> 144 XUVs
C:0 T:1 38833 XUs and 37959 XVs -> 2053 XUVs
C:0 T:2 146923 XUs and 215361 XVs -> 16987 XUVs
C:0 T:3 68092 XUs and 80083 XVs -> 1946 XUVs
C:0 T:4 3436 XUs and 4496 XVs -> 76 XUVs
C:0 T:5 15865 XUs and 10741 XVs -> 1401 XUVs
C:0 T:6 63883 XUs and 72065 XVs -> 2668 XUVs
C:0 T:7 32313 XUs and 32564 XVs -> 320 XUVs
C:0 T:8 6475 XUs and 7699 XVs -> 36 XUVs
C:0 T:9 35454 XUs and 50864 XVs -> 3242 XUVs
C:0 T:10 35981 XUs and 24473 XVs -> 3700 XUVs
C:0 T:11 264 XUs and 771 XVs -> 44 XUVs
32617 XUVs total
9174 collection wire objects
27702 potential space points
Neighbour search...
2194906 tests to find 1120342 neighbours
Iterating with no regularization...
Begin: 5.50191e+07
0 4.75065e+07
1 4.69071e+07
2 4.68232e+07
3 4.67977e+07
Now with regularization...
Begin: 3.83821e+07
0 3.8367e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 412045446
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412045446
fLifetime: 30000 [us]
30-Jan-2026 01:49:44 GMT Closed output file "reco_stage1.root"
30-Jan-2026 01:49:44 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 217.261 375.497 579.734 360.368 106.353 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00118327 0.00407463 0.00568904 0.00446172 0.0012176 10
reco:ophit:OpHitFinder 0.221231 0.310719 0.388072 0.3214 0.0552196 10
reco:opflash:OpFlashFinder 0.127518 0.185594 0.220411 0.194103 0.0303683 10
reco:opslicer:OpSlicer 0.508284 0.658224 0.884635 0.628038 0.123509 10
reco:caldata:DataPrepModule 4.32476 5.12123 6.25427 5.06417 0.557306 10
reco:wclsdatasp:WireCellToolkit 29.9197 37.6471 45.723 37.2761 4.66547 10
reco:gaushit:GausHitFinder 0.822835 1.22626 1.71571 1.18367 0.28449 10
reco:nhitsfilter:NumberOfHitsFilter 0.000369105 0.000496792 0.000777573 0.000471352 0.000124036 10
reco:reco3d:SpacePointSolver 6.97744 22.0201 44.9791 18.3897 11.895 10
reco:hitpdune:DisambigFromSpacePoints 0.977435 1.74134 2.9656 1.87549 0.63268 10
reco:pandora:StandardPandora 10.3622 36.2392 59.2761 38.281 15.1145 10
reco:pandoraWriter:StandardPandora 0.339292 0.53421 0.827216 0.470863 0.17247 10
reco:pandoraTrack:LArPandoraTrackCreation 2.11358 4.38756 7.63634 3.92364 1.86418 10
reco:pandoraShower:LArPandoraShowerCreation 1.36922 4.94062 8.76282 4.56035 2.32776 10
reco:pandoracalo:Calorimetry 1.05616 2.58225 4.5373 2.44051 0.933734 10
reco:pandoracalonosce:Calorimetry 0.757534 2.18661 3.75183 1.82997 0.853656 10
reco:pandorapid:Chi2ParticleID 0.00338355 0.00488273 0.00769805 0.00427913 0.00135311 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0293578 0.0475823 0.0858029 0.0423128 0.0157169 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00387143 0.00485787 0.00746703 0.00413984 0.00128273 10
reco:pandoraShowercalo:ShowerCalorimetry 1.34068 5.21804 10.0681 4.52019 2.62263 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.3756 5.20187 10.4713 4.21941 2.74612 10
reco:emtrkmichelid:EmTrackMichelId 125.158 195.624 296.703 187.138 49.1245 10
reco:crttag:SingleCRTMatchingProducer 0.0123605 0.0173164 0.0320044 0.0149824 0.00605687 10
reco:crtreco:TwoCRTMatchingProducer 0.0071355 0.0113227 0.0205722 0.00963673 0.00411753 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.543544 0.913185 1.18532 0.910925 0.179546 10
reco:pandora2Track:LArPandoraTrackCreation 4.41078 14.8434 29.1659 14.1629 7.14139 10
reco:pandora2calo:Calorimetry 2.14144 7.74026 14.3103 7.53884 3.31918 10
reco:pandora2calonosce:Calorimetry 2.08401 6.7017 11.5335 6.79579 2.66242 10
reco:pandora2pid:Chi2ParticleID 0.00598424 0.0126487 0.0264207 0.0107104 0.0054579 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0325623 0.0580506 0.0943927 0.0577032 0.0162259 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00597491 0.0105337 0.013721 0.0104985 0.00203728 10
reco:pandora2Shower:LArPandoraShowerCreation 1.62548 5.02396 10.401 4.68902 2.31774 10
reco:pandora2Showercalo:ShowerCalorimetry 2.33887 5.89534 10.811 5.5827 2.25564 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.18575 5.2336 10.3912 4.85323 2.09787 10
[art]:TriggerResults:TriggerResultInserter 5.1036e-05 8.87511e-05 0.000252214 5.96875e-05 5.85852e-05 10
end_path:out1:RootOutput 1.066e-05 1.64411e-05 3.4926e-05 1.30445e-05 7.86133e-06 10
end_path:out1:RootOutput(write) 2.11029 3.01881 4.6155 2.88262 0.661688 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4952.2 MB
Peak resident set size usage (VmHWM): 4126.95 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10140256
-rw-r--r-- 1 dune01 dune01 2366672013 Jan 30 00:45 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2244639533 Jan 30 00:43 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 2063305625 Jan 30 01:49 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 1853418161 Jan 29 22:03 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1777504104 Jan 29 21:48 g4_stage1.root
-rw-r--r-- 1 dune01 dune01 77455750 Jan 30 01:45 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 243011 Jan 30 01:49 jobscript.log
-rw-r--r-- 1 dune01 dune01 217088 Jan 30 01:49 mem.db
-rw-r--r-- 1 dune01 dune01 62376 Jan 30 01:49 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01 36864 Jan 30 01:49 time.db
-rw-r--r-- 1 dune01 dune01 519 Jan 30 00:45 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Jan 29 22:03 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Jan 30 01:49 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01 52 Jan 29 21:41 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01 7 Jan 30 01:49 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 0 Jan 30 00:53 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01 0 Jan 30 00:45 debugprod.log
