Jobsub ID 244868.1@dunegpschedd02.fnal.gov
| Jobsub ID | 244868.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10196 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-14 18:39:16 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 20:40:31 |
| From worker node | Hostname | dunegli-7598402-0-fnpc23038.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 18:40:25 |
| Input files | monte-carlo-010196-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (7187s) |
| CPU time | 1h (7083s = 98%) |
| Max RSS bytes | 4014641152 (3828 MiB) |
| Outputting started | 2025-11-14 20:40:12 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10196/1/001/reco_stage1.root
|
| Finished | 2025-11-14 20:40:31 |
| Saved logs | justin-logs:244868.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
vice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 141320 traces, 0 summary
Retagger: tagging trace set: gauss with 107574 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 107574 traces tagged "gauss"
FrameSaver: q=3.75752e+06 n=1922899 tag=gauss
wclsFrameSaver: saving 141320 traces tagged "wiener"
FrameSaver: q=3.95714e+06 n=1699984 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 27702 XUs and 27746 XVs -> 185 XUVs
C:0 T:1 57962 XUs and 56533 XVs -> 3889 XUVs
C:0 T:2 43659 XUs and 57125 XVs -> 1898 XUVs
C:0 T:3 21789 XUs and 24957 XVs -> 177 XUVs
C:0 T:4 13741 XUs and 13305 XVs -> 252 XUVs
C:0 T:5 81372 XUs and 59515 XVs -> 7848 XUVs
C:0 T:6 85691 XUs and 112306 XVs -> 3804 XUVs
C:0 T:7 35896 XUs and 45919 XVs -> 284 XUVs
C:0 T:8 13862 XUs and 6484 XVs -> 176 XUVs
C:0 T:9 91026 XUs and 64861 XVs -> 4908 XUVs
C:0 T:10 74605 XUs and 48462 XVs -> 6658 XUVs
C:0 T:11 414 XUs and 289 XVs -> 55 XUVs
30134 XUVs total
12677 collection wire objects
28082 potential space points
Neighbour search...
1306538 tests to find 722486 neighbours
Iterating with no regularization...
Begin: 9.14409e+07
0 7.65754e+07
1 7.56676e+07
2 7.55449e+07
3 7.5508e+07
Now with regularization...
Begin: 6.57228e+07
0 6.56878e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410511955
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410511955
fLifetime: 30000 [us]
14-Nov-2025 20:40:11 UTC Closed output file "reco_stage1.root"
14-Nov-2025 20:40:11 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 155.769 205.88 262.126 210.611 36.8277 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00083075 0.00365124 0.0148985 0.00280073 0.00388968 10
reco:ophit:OpHitFinder 0.187032 0.238466 0.272157 0.241222 0.0251968 10
reco:opflash:OpFlashFinder 0.0861851 0.12557 0.177182 0.118032 0.0279399 10
reco:opslicer:OpSlicer 0.322757 0.440591 0.576098 0.442657 0.0712562 10
reco:caldata:DataPrepModule 3.63719 3.7558 3.93266 3.74599 0.091581 10
reco:wclsdatasp:WireCellToolkit 23.0495 24.3417 28.4664 23.9969 1.51523 10
reco:gaushit:GausHitFinder 0.53277 0.783281 0.961746 0.812808 0.120046 10
reco:nhitsfilter:NumberOfHitsFilter 0.000266547 0.000334543 0.000420319 0.000330529 5.05758e-05 10
reco:reco3d:SpacePointSolver 4.68047 8.1458 15.5311 7.0306 2.854 10
reco:hitpdune:DisambigFromSpacePoints 0.596046 0.998407 1.43199 1.00083 0.270889 10
reco:pandora:StandardPandora 9.55032 17.5915 27.527 17.5416 6.47349 10
reco:pandoraWriter:StandardPandora 0.198313 0.259358 0.353557 0.25464 0.0474109 10
reco:pandoraTrack:LArPandoraTrackCreation 1.09241 1.75258 2.56207 1.87638 0.486359 10
reco:pandoraShower:LArPandoraShowerCreation 1.18382 2.22409 3.64047 2.14573 0.730289 10
reco:pandoracalo:Calorimetry 0.706256 1.12711 1.65514 1.2094 0.302789 10
reco:pandoracalonosce:Calorimetry 0.620152 1.02562 1.52112 1.10809 0.293086 10
reco:pandorapid:Chi2ParticleID 0.00224955 0.00308407 0.00355909 0.00326311 0.000446721 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.025946 0.032781 0.0375873 0.031904 0.00385416 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00238018 0.00288806 0.00357912 0.00303624 0.00039043 10
reco:pandoraShowercalo:ShowerCalorimetry 1.20901 2.54653 4.26094 2.49371 0.926258 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.16115 2.47013 3.99206 2.46281 0.88005 10
reco:emtrkmichelid:EmTrackMichelId 89.2382 113.762 136.187 115.186 17.4567 10
reco:crttag:SingleCRTMatchingProducer 0.00577137 0.0144113 0.0670991 0.00877564 0.0176528 10
reco:crtreco:TwoCRTMatchingProducer 0.00421003 0.00515452 0.00604659 0.00535413 0.000699516 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.367182 0.583833 0.748506 0.606997 0.121907 10
reco:pandora2Track:LArPandoraTrackCreation 3.4371 6.30135 9.81585 6.29029 2.0374 10
reco:pandora2calo:Calorimetry 1.80815 3.51077 5.31406 3.56629 1.15485 10
reco:pandora2calonosce:Calorimetry 1.70917 3.32807 5.09355 3.3586 1.10671 10
reco:pandora2pid:Chi2ParticleID 0.00511363 0.00739463 0.00949977 0.00747247 0.00137267 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0298457 0.0447925 0.0738914 0.0407237 0.0132369 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00498158 0.00718618 0.00906032 0.00721525 0.0013295 10
reco:pandora2Shower:LArPandoraShowerCreation 1.39535 2.39218 3.73768 2.40469 0.714578 10
reco:pandora2Showercalo:ShowerCalorimetry 1.61726 3.09622 4.77182 3.17025 1.02174 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.459 2.85771 4.44176 2.93251 0.947065 10
[art]:TriggerResults:TriggerResultInserter 2.8995e-05 4.01534e-05 0.000103837 3.43155e-05 2.14016e-05 10
end_path:out1:RootOutput 5.47e-06 9.006e-06 1.3656e-05 8.5415e-06 2.01075e-06 10
end_path:out1:RootOutput(write) 1.50383 2.04579 3.36625 2.00621 0.517954 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4824.8 MB
Peak resident set size usage (VmHWM): 4014.64 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9589328
-rw-r--r-- 1 dunegli fnalgrid 2264143726 Nov 14 20:04 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2148065186 Nov 14 20:03 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1948910045 Nov 14 20:40 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1722317122 Nov 14 18:50 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1661088465 Nov 14 18:43 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 74261790 Nov 14 20:37 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242755 Nov 14 20:40 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 20:40 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 20:40 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 20:40 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 20:04 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 18:50 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 20:40 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 18:40 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 20:40 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 20:07 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 20:04 debugprod.log
