Jobsub ID 267294.1@dunegpschedd01.fnal.gov
| Jobsub ID | 267294.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11153 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-12 09:47:15 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 14:48:46 |
| From worker node | Hostname | dunegli-7890432-0-fnpc23039.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:36:09 |
| Input files | monte-carlo-011153-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11534s) |
| CPU time | 3h (11430s = 99%) |
| Max RSS bytes | 4527779840 (4318 MiB) |
| Outputting started | 2025-12-12 14:48:24 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11153/1/001/reco_stage1.root
|
| Finished | 2025-12-12 14:48:46 |
| Saved logs | justin-logs:267294.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ce:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 159040 traces, 0 summary
Retagger: tagging trace set: gauss with 121900 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 121900 traces tagged "gauss"
FrameSaver: q=4.3307e+06 n=2199672 tag=gauss
wclsFrameSaver: saving 159040 traces tagged "wiener"
FrameSaver: q=4.60025e+06 n=1960911 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 44670 XUs and 40942 XVs -> 599 XUVs
C:0 T:1 105824 XUs and 86490 XVs -> 7261 XUVs
C:0 T:2 138836 XUs and 154573 XVs -> 9506 XUVs
C:0 T:3 55616 XUs and 57154 XVs -> 709 XUVs
C:0 T:4 14091 XUs and 14819 XVs -> 267 XUVs
C:0 T:5 73491 XUs and 57087 XVs -> 8259 XUVs
C:0 T:6 150480 XUs and 146750 XVs -> 7474 XUVs
C:0 T:7 49728 XUs and 51246 XVs -> 475 XUVs
C:0 T:8 9362 XUs and 7752 XVs -> 68 XUVs
C:0 T:9 47084 XUs and 94055 XVs -> 5531 XUVs
C:0 T:10 71312 XUs and 54524 XVs -> 7116 XUVs
C:0 T:11 63 XUs and 49 XVs -> 8 XUVs
47273 XUVs total
15168 collection wire objects
42234 potential space points
Neighbour search...
2935342 tests to find 1529066 neighbours
Iterating with no regularization...
Begin: 1.02939e+08
0 8.67984e+07
1 8.55672e+07
2 8.53458e+07
3 8.52765e+07
Now with regularization...
Begin: 7.27914e+07
0 7.27345e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411058666
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411058666
fLifetime: 30000 [us]
12-Dec-2025 14:48:21 UTC Closed output file "reco_stage1.root"
12-Dec-2025 14:48:21 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 228.425 389.872 826.034 370.031 165.082 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00148487 0.00496033 0.00923259 0.00500966 0.00233358 10
reco:ophit:OpHitFinder 0.210692 0.253853 0.302095 0.247297 0.0301578 10
reco:opflash:OpFlashFinder 0.140521 0.183178 0.24325 0.166562 0.0345616 10
reco:opslicer:OpSlicer 0.394044 0.525833 0.693688 0.515346 0.0873138 10
reco:caldata:DataPrepModule 4.08679 4.32414 4.48741 4.3419 0.135968 10
reco:wclsdatasp:WireCellToolkit 33.0841 38.0795 47.4926 37.1294 3.90505 10
reco:gaushit:GausHitFinder 0.747971 1.1469 2.38292 1.03433 0.444158 10
reco:nhitsfilter:NumberOfHitsFilter 0.0012366 0.00242353 0.00599389 0.00207948 0.00128109 10
reco:reco3d:SpacePointSolver 7.02525 22.4225 77.5563 15.3839 20.0854 10
reco:hitpdune:DisambigFromSpacePoints 0.771235 2.19478 5.92537 1.59411 1.67874 10
reco:pandora:StandardPandora 16.0567 42.9062 124.281 34.8896 30.661 10
reco:pandoraWriter:StandardPandora 0.344049 0.718057 1.41531 0.616737 0.31928 10
reco:pandoraTrack:LArPandoraTrackCreation 1.84211 8.61062 29.7977 6.54884 7.62373 10
reco:pandoraShower:LArPandoraShowerCreation 1.74077 12.4207 51.0603 6.60461 14.2508 10
reco:pandoracalo:Calorimetry 1.08712 7.08051 32.9649 2.52268 10.0723 10
reco:pandoracalonosce:Calorimetry 0.994514 5.17627 31.8691 2.28514 8.95018 10
reco:pandorapid:Chi2ParticleID 0.00344053 0.00736796 0.0277539 0.00498903 0.0069739 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0320357 0.0752264 0.371905 0.0439909 0.099053 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00311449 0.00615631 0.0212119 0.00452176 0.00511697 10
reco:pandoraShowercalo:ShowerCalorimetry 1.77424 11.335 69.6872 4.63268 19.5804 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.72848 6.01792 19.9458 4.47734 4.9731 10
reco:emtrkmichelid:EmTrackMichelId 115.208 161.388 215.751 166.661 28.7393 10
reco:crttag:SingleCRTMatchingProducer 0.0116603 0.0252276 0.0430838 0.0238091 0.00894606 10
reco:crtreco:TwoCRTMatchingProducer 0.00437651 0.0148845 0.0440927 0.0112405 0.0110714 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.525379 0.733574 0.973128 0.701532 0.12137 10
reco:pandora2Track:LArPandoraTrackCreation 8.01085 23.5273 51.289 23.7698 12.4793 10
reco:pandora2calo:Calorimetry 3.6789 11.9746 45.5432 7.64146 12.0813 10
reco:pandora2calonosce:Calorimetry 3.52643 10.5911 36.3364 6.71632 9.94351 10
reco:pandora2pid:Chi2ParticleID 0.00819996 0.0118757 0.0176526 0.0119669 0.00272644 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0463046 0.0604406 0.0847353 0.0601557 0.0117439 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00733515 0.0115751 0.0167235 0.0114156 0.00267041 10
reco:pandora2Shower:LArPandoraShowerCreation 2.61633 5.20691 10.2664 4.72009 2.31758 10
reco:pandora2Showercalo:ShowerCalorimetry 2.63334 5.37459 10.4915 5.16553 2.11276 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.41279 4.60268 8.14817 4.4401 1.56212 10
[art]:TriggerResults:TriggerResultInserter 5.1077e-05 8.33281e-05 0.000215219 7.26075e-05 4.54549e-05 10
end_path:out1:RootOutput 1.1873e-05 1.5262e-05 2.2924e-05 1.4347e-05 2.94035e-06 10
end_path:out1:RootOutput(write) 1.77424 2.58483 4.03755 2.48572 0.60604 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5337.89 MB
Peak resident set size usage (VmHWM): 4527.78 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.38 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11548400
-rw-r--r-- 1 dunegli fnalgrid 2666674622 Dec 12 13:41 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2530321547 Dec 12 13:39 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2398549114 Dec 12 14:48 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2118594790 Dec 12 11:50 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2024986661 Dec 12 11:40 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 85817510 Dec 12 14:43 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242939 Dec 12 14:48 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 14:48 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 14:48 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 14:48 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 13:41 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 11:50 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 14:48 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:36 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 14:48 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 13:47 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 13:41 debugprod.log
