Jobsub ID 270214.1@dunegpschedd01.fnal.gov
| Jobsub ID | 270214.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11335 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-26 09:03:18 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-26 11:42:30 |
| From worker node | Hostname | dunegli-8004228-0-fnpc22010.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-26 09:15:30 |
| Input files | monte-carlo-011335-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8805s) |
| CPU time | 2h (8701s = 98%) |
| Max RSS bytes | 4592685056 (4379 MiB) |
| Outputting started | 2025-12-26 11:42:16 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11335/1/001/reco_stage1.root
|
| Finished | 2025-12-26 11:42:30 |
| Saved logs | justin-logs:270214.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
BasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 170651 traces, 0 summary
Retagger: tagging trace set: gauss with 122111 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 122111 traces tagged "gauss"
FrameSaver: q=4.15864e+06 n=2066317 tag=gauss
wclsFrameSaver: saving 170651 traces tagged "wiener"
FrameSaver: q=4.44992e+06 n=1779208 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 42872 XUs and 37789 XVs -> 1221 XUVs
C:0 T:1 192613 XUs and 114441 XVs -> 30038 XUVs
C:0 T:2 173672 XUs and 305924 XVs -> 45101 XUVs
C:0 T:3 59385 XUs and 74584 XVs -> 967 XUVs
C:0 T:4 18375 XUs and 16130 XVs -> 393 XUVs
C:0 T:5 145451 XUs and 89156 XVs -> 24135 XUVs
C:0 T:6 131827 XUs and 147360 XVs -> 7304 XUVs
C:0 T:7 48596 XUs and 51812 XVs -> 528 XUVs
C:0 T:8 9858 XUs and 6969 XVs -> 127 XUVs
C:0 T:9 80101 XUs and 67035 XVs -> 9696 XUVs
C:0 T:10 35528 XUs and 33580 XVs -> 6528 XUVs
C:0 T:11 111 XUs and 67 XVs -> 20 XUVs
126058 XUVs total
16282 collection wire objects
114317 potential space points
Neighbour search...
30432149 tests to find 12654924 neighbours
Iterating with no regularization...
Begin: 6.89456e+07
0 5.22382e+07
1 5.11712e+07
2 5.09923e+07
3 5.09336e+07
4 5.09053e+07
Now with regularization...
Begin: 3.9564e+07
0 3.942e+07
1 3.93198e+07
2 3.92417e+07
3 3.91768e+07
4 3.91217e+07
5 3.90749e+07
6 3.90338e+07
7 3.89978e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411351075
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411351075
fLifetime: 30000 [us]
26-Dec-2025 11:42:15 UTC Closed output file "reco_stage1.root"
26-Dec-2025 11:42:15 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 218.82 261.868 306.412 266.934 29.7115 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000843886 0.00357824 0.00668381 0.00368107 0.00173155 10
reco:ophit:OpHitFinder 0.209254 0.239364 0.270071 0.237579 0.0175803 10
reco:opflash:OpFlashFinder 0.142658 0.175936 0.2189 0.176727 0.0203776 10
reco:opslicer:OpSlicer 0.424618 0.495047 0.622576 0.476203 0.0564155 10
reco:caldata:DataPrepModule 3.52995 3.64271 3.79672 3.58966 0.106275 10
reco:wclsdatasp:WireCellToolkit 23.4966 24.6998 25.5221 24.8968 0.655158 10
reco:gaushit:GausHitFinder 0.77039 0.84118 0.890032 0.847372 0.0385497 10
reco:nhitsfilter:NumberOfHitsFilter 0.00034911 0.000449132 0.000716455 0.000421086 9.80643e-05 10
reco:reco3d:SpacePointSolver 11.6323 20.7244 37.3316 17.6636 9.14899 10
reco:hitpdune:DisambigFromSpacePoints 1.1537 1.30862 1.71324 1.27954 0.157123 10
reco:pandora:StandardPandora 17.6037 26.7232 41.4868 26.7083 6.99269 10
reco:pandoraWriter:StandardPandora 0.283616 0.364737 0.831144 0.317911 0.156817 10
reco:pandoraTrack:LArPandoraTrackCreation 2.47281 3.01148 3.97789 2.83354 0.488497 10
reco:pandoraShower:LArPandoraShowerCreation 2.47745 3.2339 4.26368 3.21 0.532306 10
reco:pandoracalo:Calorimetry 1.48897 1.76899 2.22143 1.70802 0.251222 10
reco:pandoracalonosce:Calorimetry 1.34694 1.63878 2.08997 1.58992 0.253302 10
reco:pandorapid:Chi2ParticleID 0.00307224 0.00404903 0.00582197 0.0038655 0.000684596 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0339041 0.0374322 0.041116 0.0376749 0.00237401 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00300368 0.00371945 0.00441179 0.00364865 0.000375478 10
reco:pandoraShowercalo:ShowerCalorimetry 2.86436 3.61401 4.59199 3.56878 0.52619 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.77873 3.55779 4.63268 3.52439 0.562747 10
reco:emtrkmichelid:EmTrackMichelId 116.198 130.088 147.408 131.372 8.9305 10
reco:crttag:SingleCRTMatchingProducer 0.00898847 0.0117868 0.0196861 0.00996654 0.00345428 10
reco:crtreco:TwoCRTMatchingProducer 0.0051865 0.00625531 0.00749806 0.00620175 0.000592987 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.669131 0.740512 0.80728 0.760766 0.054824 10
reco:pandora2Track:LArPandoraTrackCreation 7.35056 10.1374 13.9641 10.3224 2.02058 10
reco:pandora2calo:Calorimetry 4.10397 5.21115 6.75425 5.49066 0.787954 10
reco:pandora2calonosce:Calorimetry 3.95349 5.00429 6.48888 5.17438 0.807063 10
reco:pandora2pid:Chi2ParticleID 0.008165 0.00968784 0.011337 0.00987138 0.00104737 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0426577 0.0489667 0.0596276 0.0495216 0.00505642 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00803676 0.00940364 0.0110126 0.0093938 0.00104045 10
reco:pandora2Shower:LArPandoraShowerCreation 2.66048 3.47647 4.71805 3.4307 0.570477 10
reco:pandora2Showercalo:ShowerCalorimetry 3.70835 4.47505 6.02602 4.43669 0.666738 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.40257 4.14581 5.52879 4.03665 0.613182 10
[art]:TriggerResults:TriggerResultInserter 3.8373e-05 6.82961e-05 0.000172686 5.2454e-05 4.02338e-05 10
end_path:out1:RootOutput 1.1131e-05 1.44463e-05 2.2292e-05 1.3325e-05 3.28839e-06 10
end_path:out1:RootOutput(write) 2.0263 2.33132 2.68576 2.35521 0.195285 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5408.08 MB
Peak resident set size usage (VmHWM): 4592.69 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.26 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11876184
-rw-r--r-- 1 dunegli fnalgrid 2712611563 Dec 26 10:57 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2575053767 Dec 26 10:55 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2452416490 Dec 26 11:42 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2207304297 Dec 26 09:28 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2125870312 Dec 26 09:19 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 87340240 Dec 26 11:39 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243355 Dec 26 11:42 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 26 11:42 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 26 11:42 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 26 11:42 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 26 10:57 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 26 09:28 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 26 11:42 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 26 09:15 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 26 11:42 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 26 11:01 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 26 10:57 debugprod.log
