Jobsub ID 236768.1@dunegpschedd02.fnal.gov
| Jobsub ID | 236768.1@dunegpschedd02.fnal.gov |
| Workflow ID | 9564 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-03 17:01:07 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-03 19:12:37 |
| From worker node | Hostname | dunegli-7472723-0-fnpc23120.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-03 17:06:54 |
| Input files | monte-carlo-009564-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7529s) |
| CPU time | 2h (7455s = 99%) |
| Max RSS bytes | 4346654720 (4145 MiB) |
| Outputting started | 2025-11-03 19:12:24 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09564/1/001/reco_stage1.root
|
| Finished | 2025-11-03 19:12:37 |
| Saved logs | justin-logs:236768.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
repare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 151540 traces, 0 summary
Retagger: tagging trace set: gauss with 117655 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 117655 traces tagged "gauss"
FrameSaver: q=4.15563e+06 n=2112976 tag=gauss
wclsFrameSaver: saving 151540 traces tagged "wiener"
FrameSaver: q=4.38851e+06 n=1881867 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 28180 XUs and 27643 XVs -> 257 XUVs
C:0 T:1 52686 XUs and 53204 XVs -> 4502 XUVs
C:0 T:2 226465 XUs and 226687 XVs -> 21649 XUVs
C:0 T:3 81209 XUs and 78098 XVs -> 1316 XUVs
C:0 T:4 16492 XUs and 18516 XVs -> 177 XUVs
C:0 T:5 81870 XUs and 74801 XVs -> 5149 XUVs
C:0 T:6 127421 XUs and 130632 XVs -> 5795 XUVs
C:0 T:7 50339 XUs and 53661 XVs -> 479 XUVs
C:0 T:8 9430 XUs and 7816 XVs -> 76 XUVs
C:0 T:9 51693 XUs and 60565 XVs -> 4096 XUVs
C:0 T:10 31787 XUs and 16179 XVs -> 3440 XUVs
C:0 T:11 133 XUs and 65 XVs -> 18 XUVs
46954 XUVs total
13184 collection wire objects
42403 potential space points
Neighbour search...
4648239 tests to find 2115256 neighbours
Iterating with no regularization...
Begin: 9.55115e+07
0 7.95626e+07
1 7.84813e+07
2 7.83327e+07
3 7.82904e+07
Now with regularization...
Begin: 6.63264e+07
0 6.62991e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410291509
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410291509
fLifetime: 30000 [us]
03-Nov-2025 19:12:23 UTC Closed output file "reco_stage1.root"
03-Nov-2025 19:12:23 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 157.258 211.823 256.491 213.221 32.778 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000558236 0.00278228 0.00521672 0.00296742 0.00135881 10
reco:ophit:OpHitFinder 0.191405 0.215299 0.235155 0.216512 0.0147031 10
reco:opflash:OpFlashFinder 0.133506 0.156474 0.187915 0.157875 0.0183315 10
reco:opslicer:OpSlicer 0.373187 0.423245 0.486594 0.425 0.0363648 10
reco:caldata:DataPrepModule 3.0482 3.14404 3.40634 3.11537 0.0971348 10
reco:wclsdatasp:WireCellToolkit 20.5657 21.3788 21.9904 21.4199 0.464221 10
reco:gaushit:GausHitFinder 0.49798 0.686538 0.812338 0.690018 0.0939208 10
reco:nhitsfilter:NumberOfHitsFilter 0.000185772 0.000244127 0.000338473 0.000238351 4.1224e-05 10
reco:reco3d:SpacePointSolver 6.01806 10.8559 15.4491 10.4487 2.90501 10
reco:hitpdune:DisambigFromSpacePoints 0.548686 0.916867 1.25766 0.891773 0.240515 10
reco:pandora:StandardPandora 11.9079 19.5654 29.8998 18.9909 5.22 10
reco:pandoraWriter:StandardPandora 0.195414 0.28612 0.442157 0.288268 0.0659906 10
reco:pandoraTrack:LArPandoraTrackCreation 1.69832 2.37916 3.92113 2.24816 0.634616 10
reco:pandoraShower:LArPandoraShowerCreation 1.49663 2.57974 3.51453 2.6839 0.675031 10
reco:pandoracalo:Calorimetry 0.945867 1.39269 2.23678 1.37327 0.366299 10
reco:pandoracalonosce:Calorimetry 0.882339 1.29625 2.10916 1.26855 0.34599 10
reco:pandorapid:Chi2ParticleID 0.00275362 0.00333554 0.00413455 0.00324999 0.000434524 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0218134 0.028974 0.0348498 0.0295932 0.00388462 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00273285 0.00309166 0.00394514 0.00295021 0.000364404 10
reco:pandoraShowercalo:ShowerCalorimetry 1.39453 2.80491 3.86876 2.96718 0.827319 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.37317 2.76618 3.8096 2.92084 0.816344 10
reco:emtrkmichelid:EmTrackMichelId 87.6847 114.089 135.656 114.411 15.4908 10
reco:crttag:SingleCRTMatchingProducer 0.00414867 0.00814468 0.0114198 0.00827328 0.00195005 10
reco:crtreco:TwoCRTMatchingProducer 0.00334805 0.0048423 0.00542872 0.00517538 0.00072217 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.378869 0.507742 0.613382 0.518747 0.0700657 10
reco:pandora2Track:LArPandoraTrackCreation 4.47513 7.42823 10.6246 7.51396 1.90236 10
reco:pandora2calo:Calorimetry 2.22443 3.99168 5.67559 4.03043 1.06213 10
reco:pandora2calonosce:Calorimetry 2.09636 3.78806 5.46189 3.86423 1.03506 10
reco:pandora2pid:Chi2ParticleID 0.00631202 0.00747696 0.00976024 0.00734047 0.000994319 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0254924 0.0356046 0.042793 0.0358006 0.00531695 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0060805 0.00733116 0.00927113 0.00724874 0.000912269 10
reco:pandora2Shower:LArPandoraShowerCreation 1.6346 2.7314 3.81064 2.69635 0.687109 10
reco:pandora2Showercalo:ShowerCalorimetry 1.84749 3.37868 4.67397 3.4372 0.897678 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.65311 3.08398 4.29135 3.14234 0.834242 10
[art]:TriggerResults:TriggerResultInserter 2.5388e-05 3.6351e-05 8.3807e-05 3.0822e-05 1.60665e-05 10
end_path:out1:RootOutput 4.417e-06 7.4463e-06 1.0866e-05 7.361e-06 1.45769e-06 10
end_path:out1:RootOutput(write) 1.37052 1.80296 2.1526 1.81324 0.248146 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5155.98 MB
Peak resident set size usage (VmHWM): 4346.65 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 1.92 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10848548
-rw-r--r-- 1 dunegli fnalgrid 2524799105 Nov 3 18:35 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2390470049 Nov 3 18:34 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2232628467 Nov 3 19:12 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1983391975 Nov 3 17:17 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1897104600 Nov 3 17:10 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 79904570 Nov 3 19:09 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242734 Nov 3 19:12 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 3 19:12 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 3 19:12 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 3 19:12 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 18:35 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 17:17 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 19:12 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 3 17:06 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 3 19:12 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 18:39 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 18:35 debugprod.log
