Jobsub ID 296769.1@dunegpschedd02.fnal.gov
| Jobsub ID | 296769.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12573 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-30 13:59:13 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-30 17:04:18 |
| From worker node | Hostname | td807.pic.es |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-30 14:00:30 |
| Input files | monte-carlo-012573-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (10938s) |
| CPU time | 2h (10377s = 94%) |
| Max RSS bytes | 4010196992 (3824 MiB) |
| Outputting started | 2026-01-30 17:02:49 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12573/1/001/reco_stage1.root
|
| Finished | 2026-01-30 17:04:18 |
| Saved logs | justin-logs:296769.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 150179 traces, 0 summary
Retagger: tagging trace set: gauss with 109635 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 109635 traces tagged "gauss"
FrameSaver: q=3.89562e+06 n=1944934 tag=gauss
wclsFrameSaver: saving 150179 traces tagged "wiener"
FrameSaver: q=4.15382e+06 n=1714310 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38993 XUs and 31803 XVs -> 376 XUVs
C:0 T:1 65805 XUs and 59757 XVs -> 4389 XUVs
C:0 T:2 75337 XUs and 99956 XVs -> 9467 XUVs
C:0 T:3 37877 XUs and 41175 XVs -> 348 XUVs
C:0 T:4 21315 XUs and 16180 XVs -> 180 XUVs
C:0 T:5 90089 XUs and 60619 XVs -> 8139 XUVs
C:0 T:6 131848 XUs and 216138 XVs -> 15575 XUVs
C:0 T:7 40308 XUs and 62598 XVs -> 765 XUVs
C:0 T:9 60947 XUs and 68493 XVs -> 6073 XUVs
C:0 T:10 80239 XUs and 128241 XVs -> 28075 XUVs
C:0 T:11 38 XUs and 26 XVs -> 2 XUVs
73389 XUVs total
13316 collection wire objects
69150 potential space points
Neighbour search...
15674614 tests to find 6583504 neighbours
Iterating with no regularization...
Begin: 7.7982e+07
0 6.59073e+07
1 6.48864e+07
2 6.47111e+07
3 6.46538e+07
Now with regularization...
Begin: 5.31435e+07
0 5.30427e+07
1 5.29666e+07
2 5.29042e+07
3 5.28475e+07
4 5.27976e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 412059335
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412059335
fLifetime: 30000 [us]
30-Jan-2026 18:02:47 CET Closed output file "reco_stage1.root"
30-Jan-2026 18:02:47 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 232.524 346.539 474.88 337.505 61.8921 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000740766 0.00333147 0.0056882 0.00350053 0.00160029 10
reco:ophit:OpHitFinder 0.192528 0.269453 0.312333 0.268608 0.0311168 10
reco:opflash:OpFlashFinder 0.101449 0.157018 0.201096 0.155335 0.0242545 10
reco:opslicer:OpSlicer 0.432081 0.65288 0.801807 0.643915 0.11037 10
reco:caldata:DataPrepModule 4.32371 4.82996 5.31273 4.90967 0.327406 10
reco:wclsdatasp:WireCellToolkit 27.5373 35.046 42.4695 36.0978 5.12596 10
reco:gaushit:GausHitFinder 0.748802 1.10857 1.44734 1.0807 0.200402 10
reco:nhitsfilter:NumberOfHitsFilter 0.000410074 0.000587493 0.000806188 0.000547735 0.000122582 10
reco:reco3d:SpacePointSolver 8.39175 14.1635 23.3413 13.5958 4.6463 10
reco:hitpdune:DisambigFromSpacePoints 0.834397 1.37808 2.04067 1.35421 0.29975 10
reco:pandora:StandardPandora 20.2946 28.3598 47.0923 28.314 7.58524 10
reco:pandoraWriter:StandardPandora 0.291607 0.435732 0.631414 0.40939 0.0845943 10
reco:pandoraTrack:LArPandoraTrackCreation 2.02365 3.68305 6.91974 3.08451 1.45334 10
reco:pandoraShower:LArPandoraShowerCreation 1.57183 4.33863 8.14717 3.81942 1.89555 10
reco:pandoracalo:Calorimetry 1.05396 2.21869 3.85574 1.81747 0.957831 10
reco:pandoracalonosce:Calorimetry 0.92031 1.84438 3.177 1.55924 0.672732 10
reco:pandorapid:Chi2ParticleID 0.00410899 0.00501419 0.00608141 0.00501304 0.000584655 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0370785 0.0499885 0.0621616 0.0507806 0.00827257 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00417194 0.00503538 0.00650562 0.00509186 0.000673819 10
reco:pandoraShowercalo:ShowerCalorimetry 1.43086 4.3241 7.54564 3.8639 1.76206 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.40492 3.9514 6.76887 3.79138 1.49037 10
reco:emtrkmichelid:EmTrackMichelId 141.818 197.702 249.428 195.771 27.5677 10
reco:crttag:SingleCRTMatchingProducer 0.0076354 0.0127633 0.0179477 0.0121223 0.00304 10
reco:crtreco:TwoCRTMatchingProducer 0.00492652 0.00865648 0.0166572 0.00776457 0.00330549 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.58722 0.85506 1.05348 0.840556 0.14361 10
reco:pandora2Track:LArPandoraTrackCreation 5.34576 12.2972 20.0885 11.0338 4.2102 10
reco:pandora2calo:Calorimetry 2.37505 5.7513 10.6234 4.77158 2.54373 10
reco:pandora2calonosce:Calorimetry 2.25302 5.41364 11.6263 4.54153 2.60059 10
reco:pandora2pid:Chi2ParticleID 0.00988163 0.0128508 0.0172444 0.0118194 0.00233354 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0460363 0.0617823 0.075712 0.0629428 0.00998944 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00969023 0.0125148 0.0174805 0.0123076 0.00224229 10
reco:pandora2Shower:LArPandoraShowerCreation 2.13918 4.5167 6.71361 4.06378 1.54155 10
reco:pandora2Showercalo:ShowerCalorimetry 2.10276 5.26518 11.7657 4.20124 2.78066 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.91371 4.70832 8.7284 3.90576 2.04515 10
[art]:TriggerResults:TriggerResultInserter 3.142e-05 5.33415e-05 9.7621e-05 4.95355e-05 1.70964e-05 10
end_path:out1:RootOutput 8.71e-06 1.04153e-05 1.477e-05 1.007e-05 1.63991e-06 10
end_path:out1:RootOutput(write) 2.1242 2.96766 4.2102 3.01332 0.525722 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4854.03 MB
Peak resident set size usage (VmHWM): 4010.2 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.93 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9840016
-rw-r--r-- 1 dune001 dune 2313699609 Jan 30 17:03 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2195510549 Jan 30 17:01 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 1997185363 Jan 30 18:02 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1784894269 Jan 30 15:20 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1710201275 Jan 30 15:09 g4_stage1.root
-rw-r--r-- 1 dune001 dune 74046080 Jan 30 17:56 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242782 Jan 30 18:02 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 30 18:02 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 30 18:02 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 30 18:02 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 30 17:03 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 30 15:20 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 30 18:02 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 30 15:00 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 30 18:02 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 30 17:08 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 30 17:03 debugprod.log
