Jobsub ID 242441.0@dunegpschedd01.fnal.gov
| Jobsub ID | 242441.0@dunegpschedd01.fnal.gov |
| Workflow ID | 9562 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-03 17:01:07 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-03 19:08:55 |
| From worker node | Hostname | dunegli-7629104-0-fnpc23120.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-03 17:05:37 |
| Input files | monte-carlo-009562-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7387s) |
| CPU time | 2h (7305s = 98%) |
| Max RSS bytes | 4215681024 (4020 MiB) |
| Outputting started | 2025-11-03 19:08:45 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09562/1/001/reco_stage1.root
|
| Finished | 2025-11-03 19:08:55 |
| Saved logs | justin-logs:242441.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 128275 traces, 0 summary
Retagger: tagging trace set: gauss with 95495 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95495 traces tagged "gauss"
FrameSaver: q=3.14432e+06 n=1675363 tag=gauss
wclsFrameSaver: saving 128275 traces tagged "wiener"
FrameSaver: q=3.34036e+06 n=1463381 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 18355 XUs and 17494 XVs -> 218 XUVs
C:0 T:1 42966 XUs and 31430 XVs -> 3230 XUVs
C:0 T:2 108704 XUs and 112119 XVs -> 7986 XUVs
C:0 T:3 42208 XUs and 35891 XVs -> 367 XUVs
C:0 T:4 12632 XUs and 10434 XVs -> 85 XUVs
C:0 T:5 94881 XUs and 42522 XVs -> 8735 XUVs
C:0 T:6 199846 XUs and 269352 XVs -> 40283 XUVs
C:0 T:7 49240 XUs and 45272 XVs -> 1120 XUVs
C:0 T:8 9900 XUs and 7016 XVs -> 136 XUVs
C:0 T:9 73653 XUs and 67507 XVs -> 4385 XUVs
C:0 T:10 66889 XUs and 33567 XVs -> 12597 XUVs
C:0 T:11 43 XUs and 22 XVs -> 4 XUVs
79146 XUVs total
12895 collection wire objects
73380 potential space points
Neighbour search...
19502540 tests to find 7982714 neighbours
Iterating with no regularization...
Begin: 5.10329e+07
0 3.66003e+07
1 3.57511e+07
2 3.56432e+07
3 3.56065e+07
4 3.55891e+07
Now with regularization...
Begin: 2.79896e+07
0 2.79142e+07
1 2.78537e+07
2 2.78035e+07
3 2.77627e+07
4 2.77287e+07
5 2.77004e+07
6 2.76765e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410291531
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410291531
fLifetime: 30000 [us]
03-Nov-2025 19:08:44 UTC Closed output file "reco_stage1.root"
03-Nov-2025 19:08:44 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 150.745 201.984 243.37 205.382 26.5398 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000565087 0.0029448 0.0043477 0.0032831 0.00128648 10
reco:ophit:OpHitFinder 0.182218 0.208072 0.242449 0.194654 0.0239605 10
reco:opflash:OpFlashFinder 0.120413 0.150642 0.190136 0.139325 0.0267666 10
reco:opslicer:OpSlicer 0.322306 0.412209 0.542516 0.372881 0.0827959 10
reco:caldata:DataPrepModule 3.06896 3.15284 3.28569 3.1343 0.0696863 10
reco:wclsdatasp:WireCellToolkit 20.363 21.1149 22.1251 21.2728 0.55271 10
reco:gaushit:GausHitFinder 0.431707 0.619711 0.747959 0.651629 0.0872527 10
reco:nhitsfilter:NumberOfHitsFilter 0.00018422 0.000243267 0.000360015 0.000233634 4.38558e-05 10
reco:reco3d:SpacePointSolver 5.24077 9.62919 14.617 9.36628 3.09605 10
reco:hitpdune:DisambigFromSpacePoints 0.527559 0.825473 1.1483 0.827044 0.194654 10
reco:pandora:StandardPandora 10.476 19.5837 27.5132 20.0743 6.27692 10
reco:pandoraWriter:StandardPandora 0.18 0.265414 0.498691 0.241093 0.0867791 10
reco:pandoraTrack:LArPandoraTrackCreation 1.54427 2.13666 2.56815 2.17763 0.346445 10
reco:pandoraShower:LArPandoraShowerCreation 1.17126 2.14248 2.91833 2.1948 0.504051 10
reco:pandoracalo:Calorimetry 0.997931 1.26918 1.49586 1.32532 0.196375 10
reco:pandoracalonosce:Calorimetry 0.921929 1.19396 1.41864 1.23046 0.190672 10
reco:pandorapid:Chi2ParticleID 0.00277526 0.00312723 0.00369642 0.00314103 0.00026652 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0232794 0.0283063 0.0337294 0.0280365 0.00295382 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00242246 0.00290427 0.00320369 0.00293499 0.000253445 10
reco:pandoraShowercalo:ShowerCalorimetry 1.1548 2.42932 3.42072 2.44597 0.609967 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.13361 2.37707 3.36201 2.39596 0.597878 10
reco:emtrkmichelid:EmTrackMichelId 87.1352 110.251 129.678 111.446 12.1787 10
reco:crttag:SingleCRTMatchingProducer 0.00560017 0.00786833 0.0106252 0.00790056 0.00145437 10
reco:crtreco:TwoCRTMatchingProducer 0.00335617 0.00463938 0.00581933 0.00467986 0.00066512 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.40401 0.520571 0.664453 0.516458 0.076356 10
reco:pandora2Track:LArPandoraTrackCreation 4.13315 6.56367 8.85141 6.39375 1.44803 10
reco:pandora2calo:Calorimetry 2.12487 3.52351 4.36915 3.54696 0.72753 10
reco:pandora2calonosce:Calorimetry 1.97998 3.36018 4.2556 3.38393 0.707284 10
reco:pandora2pid:Chi2ParticleID 0.00593331 0.0068066 0.00802954 0.00674512 0.000742286 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0260235 0.0348681 0.0431525 0.0347071 0.00448536 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00578661 0.0071303 0.00932581 0.00703404 0.00110101 10
reco:pandora2Shower:LArPandoraShowerCreation 1.57193 2.38964 3.00787 2.342 0.438326 10
reco:pandora2Showercalo:ShowerCalorimetry 1.82641 3.05494 3.93807 3.03434 0.632974 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.70182 2.777 3.49011 2.75639 0.546173 10
[art]:TriggerResults:TriggerResultInserter 2.9034e-05 3.9521e-05 9.5335e-05 3.35665e-05 1.879e-05 10
end_path:out1:RootOutput 6.57e-06 8.9626e-06 1.32e-05 9.0635e-06 1.6553e-06 10
end_path:out1:RootOutput(write) 1.40255 1.87038 2.36879 1.87974 0.287806 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5029.12 MB
Peak resident set size usage (VmHWM): 4215.68 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 1.91 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10707692
-rw-r--r-- 1 dunegli fnalgrid 2492031640 Nov 3 18:33 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2362873539 Nov 3 18:32 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2186276037 Nov 3 19:08 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1961059667 Nov 3 17:16 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1884691176 Nov 3 17:08 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 77131360 Nov 3 19:06 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242971 Nov 3 19:08 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 3 19:08 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 3 19:08 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 3 19:08 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 18:33 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 17:16 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 19:08 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 3 17:05 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 3 19:08 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 18:37 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 18:34 debugprod.log
