Jobsub ID 271721.1@dunegpschedd02.fnal.gov
| Jobsub ID | 271721.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11858 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-13 21:59:53 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc01 |
| Last heartbeat | 2026-01-14 02:48:00 |
| From worker node | Hostname | wn-lb-08.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-13 22:01:21 |
| Input files | monte-carlo-011858-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (17085s) |
| CPU time | 4h (16911s = 98%) |
| Max RSS bytes | 4459581440 (4252 MiB) |
| Outputting started | 2026-01-14 02:46:07 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11858/1/001/reco_stage1.root
|
| Finished | 2026-01-14 02:48:00 |
| Saved logs | justin-logs:271721.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
alFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 155197 traces, 0 summary
Retagger: tagging trace set: gauss with 112226 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 112226 traces tagged "gauss"
FrameSaver: q=3.92609e+06 n=1910806 tag=gauss
wclsFrameSaver: saving 155197 traces tagged "wiener"
FrameSaver: q=4.1806e+06 n=1659363 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35194 XUs and 37647 XVs -> 553 XUVs
C:0 T:1 67532 XUs and 67955 XVs -> 8027 XUVs
C:0 T:2 179828 XUs and 169214 XVs -> 20850 XUVs
C:0 T:3 64388 XUs and 61110 XVs -> 828 XUVs
C:0 T:4 15636 XUs and 13062 XVs -> 106 XUVs
C:0 T:5 60756 XUs and 42712 XVs -> 5030 XUVs
C:0 T:6 120293 XUs and 120457 XVs -> 5765 XUVs
C:0 T:7 43507 XUs and 42896 XVs -> 354 XUVs
C:0 T:8 5251 XUs and 6733 XVs -> 65 XUVs
C:0 T:9 84249 XUs and 58113 XVs -> 6046 XUVs
C:0 T:10 38473 XUs and 21674 XVs -> 4067 XUVs
C:0 T:11 130 XUs and 102 XVs -> 8 XUVs
51699 XUVs total
14325 collection wire objects
45253 potential space points
Neighbour search...
5688605 tests to find 2679190 neighbours
Iterating with no regularization...
Begin: 8.82519e+07
0 6.86933e+07
1 6.76664e+07
2 6.75081e+07
3 6.74554e+07
Now with regularization...
Begin: 5.57151e+07
0 5.56381e+07
1 5.56026e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411724001
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411724001
fLifetime: 30000 [us]
14-Jan-2026 03:46:04 CET Closed output file "reco_stage1.root"
14-Jan-2026 03:46:04 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 396.094 476.406 565.78 470.91 52.543 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00137858 0.00690487 0.0122777 0.00657496 0.00357155 10
reco:ophit:OpHitFinder 0.402159 0.455202 0.501621 0.452935 0.0287825 10
reco:opflash:OpFlashFinder 0.291532 0.333767 0.405585 0.31709 0.0381829 10
reco:opslicer:OpSlicer 0.773934 0.955701 1.1289 0.954226 0.109385 10
reco:caldata:DataPrepModule 6.32666 6.51629 7.06957 6.43463 0.211254 10
reco:wclsdatasp:WireCellToolkit 44.6072 64.2437 73.2755 72.1001 12.21 10
reco:gaushit:GausHitFinder 1.32221 1.49151 1.66992 1.49839 0.119539 10
reco:nhitsfilter:NumberOfHitsFilter 0.000441372 0.000602824 0.000789623 0.000595388 0.000111729 10
reco:reco3d:SpacePointSolver 14.4996 22.494 29.9449 23.9063 4.94428 10
reco:hitpdune:DisambigFromSpacePoints 1.50857 1.99558 2.34441 2.00232 0.240469 10
reco:pandora:StandardPandora 36.0953 44.4809 59.2983 41.9854 6.77796 10
reco:pandoraWriter:StandardPandora 0.439335 0.53125 0.585264 0.535357 0.0450769 10
reco:pandoraTrack:LArPandoraTrackCreation 5.52851 7.75112 11.7517 7.36568 1.83174 10
reco:pandoraShower:LArPandoraShowerCreation 5.93277 8.89702 13.9603 8.24474 2.30293 10
reco:pandoracalo:Calorimetry 3.0829 4.19966 5.62698 4.28386 0.761526 10
reco:pandoracalonosce:Calorimetry 3.13701 4.02245 5.51726 3.96236 0.740159 10
reco:pandorapid:Chi2ParticleID 0.00608093 0.00678227 0.00775545 0.00674686 0.000484157 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0472332 0.0598125 0.0668945 0.0607767 0.00546286 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0057595 0.00652275 0.00718801 0.00652474 0.000460175 10
reco:pandoraShowercalo:ShowerCalorimetry 5.69589 9.01625 12.2948 8.52579 2.11982 10
reco:pandoraShowercalonosce:ShowerCalorimetry 5.52653 8.64496 12.5405 7.9527 2.15735 10
reco:emtrkmichelid:EmTrackMichelId 179.466 211.055 237.417 209.328 17.3478 10
reco:crttag:SingleCRTMatchingProducer 0.01179 0.0193204 0.0262029 0.0179222 0.00464638 10
reco:crtreco:TwoCRTMatchingProducer 0.0106208 0.0165509 0.0227668 0.0172133 0.00363861 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.02167 1.21773 1.34982 1.22478 0.104777 10
reco:pandora2Track:LArPandoraTrackCreation 16.1178 24.6984 35.3969 24.2754 6.27925 10
reco:pandora2calo:Calorimetry 8.13692 11.9573 16.6833 11.396 2.8108 10
reco:pandora2calonosce:Calorimetry 8.2199 11.3565 15.6586 11.0398 2.44965 10
reco:pandora2pid:Chi2ParticleID 0.0129481 0.01555 0.0207878 0.015299 0.00198413 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0680178 0.0751946 0.0843395 0.0746993 0.00581731 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0129987 0.0149553 0.0163823 0.0151665 0.00101011 10
reco:pandora2Shower:LArPandoraShowerCreation 5.36704 8.82514 13.3894 8.51363 2.49612 10
reco:pandora2Showercalo:ShowerCalorimetry 5.80645 9.38005 12.6581 9.32833 2.12884 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.95705 7.7763 10.0572 7.88216 1.62784 10
[art]:TriggerResults:TriggerResultInserter 3.5092e-05 5.23062e-05 0.000135723 4.5283e-05 2.81427e-05 10
end_path:out1:RootOutput 7.45e-06 8.8003e-06 1.4513e-05 8.3175e-06 1.93311e-06 10
end_path:out1:RootOutput(write) 3.05052 3.63931 4.12876 3.74973 0.323895 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5262.03 MB
Peak resident set size usage (VmHWM): 4456.38 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.29 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11262808
-rw-r--r--. 1 dune009 dune 2602300260 Jan 14 02:24 detsim_stage2.root
-rw-r--r--. 1 dune009 dune 2466622108 Jan 14 02:21 detsim_stage1.root
-rw-r--r--. 1 dune009 dune 2308350403 Jan 14 03:46 reco_stage1.root
-rw-r--r--. 1 dune009 dune 2084721490 Jan 13 23:26 g4_stage2.root
-rw-r--r--. 1 dune009 dune 1990973316 Jan 13 23:09 g4_stage1.root
-rw-r--r--. 1 dune009 dune 79529030 Jan 14 03:40 Pandora_Events.pndr
-rw-r--r--. 1 dune009 dune 242751 Jan 14 03:46 jobscript.log
-rw-r--r--. 1 dune009 dune 217088 Jan 14 03:46 mem.db
-rw-r--r--. 1 dune009 dune 62376 Jan 14 03:46 Pandora_Geometry.xml
-rw-r--r--. 1 dune009 dune 36864 Jan 14 03:46 time.db
-rw-r--r--. 1 dune009 dune 519 Jan 14 02:24 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Jan 13 23:26 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Jan 14 03:46 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune009 dune 52 Jan 13 23:01 all-input-dids.txt
-rw-r--r--. 1 dune009 dune 7 Jan 14 03:46 justin-processed-pfns.txt
-rw-r--r--. 1 dune009 dune 0 Jan 14 02:31 ProtoDUNE.log
-rw-r--r--. 1 dune009 dune 0 Jan 14 02:24 debugprod.log
