Jobsub ID 249150.0@dunegpschedd02.fnal.gov
| Jobsub ID | 249150.0@dunegpschedd02.fnal.gov |
| Workflow ID | 10453 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-21 10:40:17 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-21 12:44:41 |
| From worker node | Hostname | dunegli-7833573-0-fnpc22004.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-21 10:41:07 |
| Input files | monte-carlo-010453-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7395s) |
| CPU time | 2h (7329s = 99%) |
| Max RSS bytes | 4073541632 (3884 MiB) |
| Outputting started | 2025-11-21 12:44:23 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10453/1/001/reco_stage1.root
|
| Finished | 2025-11-21 12:44:41 |
| Saved logs | justin-logs:249150.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 124031 traces, 0 summary
Retagger: tagging trace set: gauss with 93218 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 93218 traces tagged "gauss"
FrameSaver: q=3.1472e+06 n=1672054 tag=gauss
wclsFrameSaver: saving 124031 traces tagged "wiener"
FrameSaver: q=3.3452e+06 n=1480016 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 30391 XUs and 27112 XVs -> 297 XUVs
C:0 T:1 143980 XUs and 98690 XVs -> 16389 XUVs
C:0 T:2 57076 XUs and 77335 XVs -> 3163 XUVs
C:0 T:3 32093 XUs and 32240 XVs -> 315 XUVs
C:0 T:4 16255 XUs and 20808 XVs -> 196 XUVs
C:0 T:5 84005 XUs and 89062 XVs -> 6626 XUVs
C:0 T:6 84803 XUs and 89298 XVs -> 4546 XUVs
C:0 T:7 36198 XUs and 38078 XVs -> 310 XUVs
C:0 T:8 10615 XUs and 9580 XVs -> 109 XUVs
C:0 T:9 63719 XUs and 82180 XVs -> 5286 XUVs
C:0 T:10 20807 XUs and 23217 XVs -> 5727 XUVs
C:0 T:11 259 XUs and 190 XVs -> 20 XUVs
42984 XUVs total
11795 collection wire objects
39102 potential space points
Neighbour search...
4760276 tests to find 2261210 neighbours
Iterating with no regularization...
Begin: 7.1232e+07
0 5.08547e+07
1 4.99156e+07
2 4.98192e+07
3 4.97924e+07
Now with regularization...
Begin: 4.18376e+07
0 4.17487e+07
1 4.17216e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410648319
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410648319
fLifetime: 30000 [us]
21-Nov-2025 12:44:21 UTC Closed output file "reco_stage1.root"
21-Nov-2025 12:44:21 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 162.596 209.96 305.812 206.077 39.8954 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000780642 0.00254162 0.00372362 0.00274964 0.000938024 10
reco:ophit:OpHitFinder 0.184149 0.203618 0.226032 0.200721 0.0143461 10
reco:opflash:OpFlashFinder 0.104466 0.129592 0.160028 0.124579 0.0191733 10
reco:opslicer:OpSlicer 0.378769 0.445317 0.550117 0.439713 0.0508038 10
reco:caldata:DataPrepModule 3.34938 3.46867 3.62152 3.44312 0.0810217 10
reco:wclsdatasp:WireCellToolkit 21.8361 22.8458 23.5123 23.0103 0.565318 10
reco:gaushit:GausHitFinder 0.584082 0.762958 1.00773 0.747826 0.126818 10
reco:nhitsfilter:NumberOfHitsFilter 0.000281334 0.000354531 0.000580031 0.000329286 8.24325e-05 10
reco:reco3d:SpacePointSolver 5.71262 8.54418 12.8907 8.39762 2.22723 10
reco:hitpdune:DisambigFromSpacePoints 0.709198 1.02433 1.58934 0.993489 0.25795 10
reco:pandora:StandardPandora 11.8432 23.025 57.816 21.2917 12.8535 10
reco:pandoraWriter:StandardPandora 0.196636 0.263953 0.365659 0.256648 0.0454502 10
reco:pandoraTrack:LArPandoraTrackCreation 1.38715 2.18082 4.10013 1.95444 0.702713 10
reco:pandoraShower:LArPandoraShowerCreation 1.58502 2.60082 4.89282 2.44827 0.963115 10
reco:pandoracalo:Calorimetry 0.814768 1.30603 2.30336 1.2261 0.381861 10
reco:pandoracalonosce:Calorimetry 0.77582 1.21688 2.16457 1.14442 0.367974 10
reco:pandorapid:Chi2ParticleID 0.00284532 0.00348666 0.00428554 0.00338577 0.000446146 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0268941 0.0317822 0.0378471 0.0317838 0.00306203 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00249267 0.00316793 0.00445674 0.0030834 0.000505001 10
reco:pandoraShowercalo:ShowerCalorimetry 1.50475 2.90381 5.22271 2.83815 1.11269 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.48855 2.8279 5.16494 2.78718 1.07894 10
reco:emtrkmichelid:EmTrackMichelId 88.7905 109.682 139.668 109.709 14.1525 10
reco:crttag:SingleCRTMatchingProducer 0.00921228 0.0117898 0.0173929 0.0113089 0.00245166 10
reco:crtreco:TwoCRTMatchingProducer 0.00439479 0.00530548 0.00718483 0.00515063 0.000715195 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.412926 0.567822 0.660561 0.584245 0.0714238 10
reco:pandora2Track:LArPandoraTrackCreation 4.40089 7.18472 11.5607 6.91345 2.14315 10
reco:pandora2calo:Calorimetry 2.19573 3.8855 6.19488 3.86791 1.19237 10
reco:pandora2calonosce:Calorimetry 2.37777 3.72092 5.86724 3.69027 1.10651 10
reco:pandora2pid:Chi2ParticleID 0.00648872 0.00809338 0.0110647 0.00793067 0.00125583 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0341026 0.0395843 0.0484931 0.0387902 0.0043395 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0062148 0.00794087 0.0108053 0.00776796 0.00132188 10
reco:pandora2Shower:LArPandoraShowerCreation 1.85048 2.64306 4.02675 2.57782 0.670354 10
reco:pandora2Showercalo:ShowerCalorimetry 1.94791 3.36008 5.22933 3.4352 0.963843 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.78621 3.12206 4.76106 3.24931 0.87371 10
[art]:TriggerResults:TriggerResultInserter 2.6881e-05 5.11432e-05 0.000184911 3.61185e-05 4.49534e-05 10
end_path:out1:RootOutput 1.047e-05 1.29917e-05 2.2122e-05 1.19025e-05 3.11701e-06 10
end_path:out1:RootOutput(write) 1.46506 1.85207 2.34635 1.8319 0.241216 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4885.34 MB
Peak resident set size usage (VmHWM): 4073.54 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10139424
-rw-r--r-- 1 dunegli fnalgrid 2377475500 Nov 21 12:08 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2256992804 Nov 21 12:07 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2064808771 Nov 21 12:44 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1844121681 Nov 21 10:52 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1763294470 Nov 21 10:44 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 75461560 Nov 21 12:42 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242843 Nov 21 12:44 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 21 12:44 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 21 12:44 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 21 12:44 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 12:08 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 10:52 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 12:44 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 21 10:41 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 21 12:44 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 12:11 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 12:08 debugprod.log
