Jobsub ID 256114.0@dunegpschedd01.fnal.gov
| Jobsub ID | 256114.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10581 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-24 10:42:00 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-24 16:07:17 |
| From worker node | Hostname | dunegli-7709215-0-fnpc18010.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-24 10:43:01 |
| Input files | monte-carlo-010581-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (19424s) |
| CPU time | 5h (19173s = 98%) |
| Max RSS bytes | 4268584960 (4070 MiB) |
| Outputting started | 2025-11-24 16:06:45 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10581/1/001/reco_stage1.root
|
| Finished | 2025-11-24 16:07:17 |
| Saved logs | justin-logs:256114.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
gitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 145808 traces, 0 summary
Retagger: tagging trace set: gauss with 112689 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 112689 traces tagged "gauss"
FrameSaver: q=3.97306e+06 n=2006740 tag=gauss
wclsFrameSaver: saving 145808 traces tagged "wiener"
FrameSaver: q=4.21379e+06 n=1785607 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 48033 XUs and 43414 XVs -> 1028 XUVs
C:0 T:1 101247 XUs and 86375 XVs -> 6753 XUVs
C:0 T:2 71644 XUs and 94743 XVs -> 2713 XUVs
C:0 T:3 40365 XUs and 42795 XVs -> 199 XUVs
C:0 T:4 10470 XUs and 7801 XVs -> 57 XUVs
C:0 T:5 32782 XUs and 19769 XVs -> 2153 XUVs
C:0 T:6 79712 XUs and 107911 XVs -> 4211 XUVs
C:0 T:7 31441 XUs and 39493 XVs -> 196 XUVs
C:0 T:8 11910 XUs and 9001 XVs -> 359 XUVs
C:0 T:9 68990 XUs and 62200 XVs -> 3635 XUVs
C:0 T:10 164242 XUs and 162907 XVs -> 39026 XUVs
C:0 T:11 91 XUs and 58 XVs -> 9 XUVs
60339 XUVs total
12976 collection wire objects
57205 potential space points
Neighbour search...
12210041 tests to find 5182020 neighbours
Iterating with no regularization...
Begin: 7.10207e+07
0 5.82901e+07
1 5.75686e+07
2 5.74663e+07
3 5.7434e+07
Now with regularization...
Begin: 4.68246e+07
0 4.67361e+07
1 4.66627e+07
2 4.66027e+07
3 4.6555e+07
4 4.65152e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410708717
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410708717
fLifetime: 30000 [us]
24-Nov-2025 16:06:37 UTC Closed output file "reco_stage1.root"
24-Nov-2025 16:06:37 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 472.928 725.842 900.057 735.086 111.129 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00213941 0.00497627 0.00969888 0.00478258 0.00213095 10
reco:ophit:OpHitFinder 0.429806 0.468785 0.501416 0.466925 0.0190948 10
reco:opflash:OpFlashFinder 0.239446 0.278775 0.313315 0.285665 0.0219547 10
reco:opslicer:OpSlicer 1.07302 1.36836 1.57165 1.41587 0.156523 10
reco:caldata:DataPrepModule 8.76912 9.19072 10.2953 9.02434 0.442316 10
reco:wclsdatasp:WireCellToolkit 51.0065 55.5266 62.7932 55.7324 3.48685 10
reco:gaushit:GausHitFinder 2.1564 2.39837 2.67466 2.37062 0.154867 10
reco:nhitsfilter:NumberOfHitsFilter 0.000661669 0.000875068 0.00118334 0.000863288 0.000133281 10
reco:reco3d:SpacePointSolver 16.5091 28.9517 41.1359 28.8061 7.75082 10
reco:hitpdune:DisambigFromSpacePoints 2.07585 3.35317 4.28318 3.30131 0.621551 10
reco:pandora:StandardPandora 38.6133 75.0069 110.14 75.7117 19.1388 10
reco:pandoraWriter:StandardPandora 0.597679 0.776274 0.919622 0.796128 0.101381 10
reco:pandoraTrack:LArPandoraTrackCreation 5.94184 8.89766 11.0885 8.7397 1.83475 10
reco:pandoraShower:LArPandoraShowerCreation 6.25907 11.8283 15.3358 12.4222 2.69738 10
reco:pandoracalo:Calorimetry 2.88435 5.31207 7.10584 5.56877 1.28083 10
reco:pandoracalonosce:Calorimetry 3.37566 5.22976 6.58706 5.2812 1.14438 10
reco:pandorapid:Chi2ParticleID 0.00800268 0.0111335 0.0137314 0.0110573 0.00199126 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0745022 0.105684 0.12869 0.110837 0.0166362 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00778719 0.0104348 0.0131795 0.0107736 0.00160027 10
reco:pandoraShowercalo:ShowerCalorimetry 4.81545 13.4983 17.8237 14.0424 3.53967 10
reco:pandoraShowercalonosce:ShowerCalorimetry 5.86981 12.8838 17.7152 13.2484 3.18267 10
reco:emtrkmichelid:EmTrackMichelId 250.343 373.271 459.322 376.944 52.1868 10
reco:crttag:SingleCRTMatchingProducer 0.0256229 0.0308439 0.0353845 0.0318535 0.00325001 10
reco:crtreco:TwoCRTMatchingProducer 0.0186897 0.0226507 0.0267995 0.0221758 0.00296793 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.34278 1.56954 1.96558 1.54672 0.166291 10
reco:pandora2Track:LArPandoraTrackCreation 18.0909 32.9903 41.6385 34.4702 6.53414 10
reco:pandora2calo:Calorimetry 8.57482 18.1187 24.3817 18.8114 4.40865 10
reco:pandora2calonosce:Calorimetry 6.9012 17.6857 28.3771 17.6744 5.42018 10
reco:pandora2pid:Chi2ParticleID 0.0242926 0.0307475 0.0377127 0.0309781 0.00398909 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.107575 0.145164 0.177638 0.145973 0.0202951 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.019868 0.0295196 0.0352748 0.0308896 0.00467918 10
reco:pandora2Shower:LArPandoraShowerCreation 6.32816 12.1851 15.8877 13.0064 2.57111 10
reco:pandora2Showercalo:ShowerCalorimetry 5.9788 15.2792 21.094 15.9281 4.02045 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.57179 14.0289 20.3547 14.382 3.97936 10
[art]:TriggerResults:TriggerResultInserter 6.2959e-05 0.000105657 0.000284376 8.81015e-05 6.06486e-05 10
end_path:out1:RootOutput 1.0861e-05 1.36328e-05 2.6149e-05 1.2629e-05 4.26423e-06 10
end_path:out1:RootOutput(write) 3.95412 5.15938 6.34633 5.3631 0.634099 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5074.52 MB
Peak resident set size usage (VmHWM): 4268.58 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.37 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.94 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10525232
-rw-r--r-- 1 dunegli fnalgrid 2457961219 Nov 24 14:02 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2331821629 Nov 24 13:58 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2163885240 Nov 24 16:06 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1909818800 Nov 24 11:10 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1834417052 Nov 24 10:50 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 79318490 Nov 24 15:55 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242684 Nov 24 16:06 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 24 16:06 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 24 16:06 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 24 16:06 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 14:02 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 11:10 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 16:06 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 24 10:43 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 24 16:06 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 24 14:13 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 24 14:02 debugprod.log
