This Fermilab instance is still being tested. Please do not submit user workflows for now. Thanks!
Jobsub ID 14284.0@dunegpschedd02.fnal.gov
| Jobsub ID | 14284.0@dunegpschedd02.fnal.gov | |
| Workflow ID | 302 | |
| Stage ID | 1 | |
| User name | pmelas@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 8388608000 (8000 MiB) | |
| Wall seconds limit | 86400 (24 hours) | |
| Submitted time | 2025-08-04 07:05:33 | |
| Site | US_FNAL-FermiGrid | |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly | |
| Last heartbeat | 2025-08-04 09:20:25 | |
| From worker node | Hostname | dunegli-6302047-0-fnpc22036.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 10485760000 (10000 MiB) | |
| Wall seconds limit | 172800 (48 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-08-04 07:07:39 | |
| Input files | monte-carlo-000302-000001 | |
| Jobscript | Exit code | 0 |
| Real time | 2h (7954s) | |
| CPU time | 2h (7868s = 98%) | |
| Max RSS bytes | 4337700864 (4136 MiB) | |
| Outputting started | 2025-08-04 09:20:13 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/00302/1/001/reco_stage1.root | |
| Finished | 2025-08-04 09:20:25 | |
| Saved logs | justin-logs:14284.0-dunegpschedd02.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
ing tool adcScaleKeToAdc ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools. CookedFrameSource: got 15360 recob::Wire objects input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 158956 traces, 0 summary Retagger: tagging trace set: gauss with 116915 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 116915 traces tagged "gauss" FrameSaver: q=4.3553e+06 n=2091264 tag=gauss wclsFrameSaver: saving 158956 traces tagged "wiener" FrameSaver: q=4.62713e+06 n=1840342 tag=wiener 72 X, 28 U, 34 V bad channels Finding XUV coincidences... C:0 T:0 25609 XUs and 37639 XVs -> 862 XUVs C:0 T:1 67142 XUs and 95175 XVs -> 12772 XUVs C:0 T:2 95694 XUs and 119948 XVs -> 3926 XUVs C:0 T:3 49052 XUs and 52019 XVs -> 405 XUVs C:0 T:4 17571 XUs and 22397 XVs -> 172 XUVs C:0 T:5 86532 XUs and 154212 XVs -> 15645 XUVs C:0 T:6 111519 XUs and 148684 XVs -> 6768 XUVs C:0 T:7 44312 XUs and 49048 XVs -> 556 XUVs C:0 T:8 9488 XUs and 16247 XVs -> 215 XUVs C:0 T:9 75269 XUs and 156613 XVs -> 8864 XUVs C:0 T:10 37801 XUs and 34024 XVs -> 6046 XUVs C:0 T:11 232 XUs and 137 XVs -> 20 XUVs 56251 XUVs total 15410 collection wire objects 51922 potential space points Neighbour search... 7385262 tests to find 3340234 neighbours Iterating with no regularization... Begin: 1.0841e+08 0 8.7035e+07 1 8.55504e+07 2 8.53239e+07 3 8.52496e+07 Now with regularization... Begin: 7.04312e+07 0 7.03087e+07 1 7.02401e+07 run: 1 ; subrun: 0 ; event: 10 evttime: 408452589 fLifetime: 30000 [us] run: 1 ; subrun: 0 ; event: 10 evttime: 408452589 fLifetime: 30000 [us] 04-Aug-2025 09:20:12 UTC Closed output file "reco_stage1.root" 04-Aug-2025 09:20:12 UTC Closed input file "detsim_stage2.root" DataPrepModule::endJob: # events processed: 10 DataPrepModule::endJob: # events skipped: 0 ==================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ==================================================================================================================================== Full event 173.226 238.515 347.107 232.728 56.5356 10 ------------------------------------------------------------------------------------------------------------------------------------ source:RootInput(read) 0.000807287 0.00300338 0.00453488 0.00352696 0.00117919 10 reco:ophit:OpHitFinder 0.174991 0.210221 0.242112 0.218997 0.0230624 10 reco:opflash:OpFlashFinder 0.108144 0.140468 0.18106 0.145309 0.0261852 10 reco:opslicer:OpSlicer 0.323462 0.45853 0.580434 0.47571 0.0886685 10 reco:caldata:DataPrepModule 3.41988 3.52898 3.833 3.50414 0.110771 10 reco:wclsdatasp:WireCellToolkit 23.4733 24.9983 26.1382 25.2854 0.862931 10 reco:gaushit:GausHitFinder 0.623309 0.825015 1.0505 0.831669 0.16682 10 reco:nhitsfilter:NumberOfHitsFilter 0.000334202 0.000546244 0.000794011 0.000548126 0.000141663 10 reco:reco3d:SpacePointSolver 6.04734 13.023 20.9424 13.4651 4.97611 10 reco:hitpdune:DisambigFromSpacePoints 0.721147 1.25466 2.14786 1.20035 0.464784 10 reco:pandora:StandardPandora 15.3395 25.0046 51.9529 21.8468 11.1396 10 reco:pandoraWriter:StandardPandora 0.221252 0.310498 0.474341 0.301339 0.0833664 10 reco:pandoraTrack:LArPandoraTrackCreation 1.35961 2.39774 4.58522 2.24566 1.00892 10 reco:pandoraShower:LArPandoraShowerCreation 1.78153 3.38605 7.40453 2.60553 1.82098 10 reco:pandoracalo:Calorimetry 0.846058 1.48832 2.6429 1.35387 0.60991 10 reco:pandoracalonosce:Calorimetry 0.767836 1.35944 2.54286 1.25145 0.581619 10 reco:pandorapid:Chi2ParticleID 0.00250841 0.00344483 0.00477139 0.00330995 0.000765926 10 reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0264812 0.0354084 0.0472798 0.0341294 0.00703769 10 reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00233727 0.00323865 0.00445716 0.00316842 0.000688527 10 reco:pandoraShowercalo:ShowerCalorimetry 1.79961 3.45834 6.17926 3.02928 1.47769 10 reco:pandoraShowercalonosce:ShowerCalorimetry 1.74804 3.26606 6.00063 2.95012 1.34017 10 reco:emtrkmichelid:EmTrackMichelId 92.2721 121.657 164.918 116.943 23.7596 10 reco:crttag:SingleCRTMatchingProducer 0.00572253 0.0102662 0.0143037 0.0110873 0.00319696 10 reco:crtreco:TwoCRTMatchingProducer 0.00370061 0.00599194 0.00831966 0.00621616 0.001591 10 reco:anodepiercerst0:T0RecoAnodePiercers 0.487861 0.714769 0.98002 0.688798 0.163479 10 reco:pandora2Track:LArPandoraTrackCreation 4.89646 9.4066 17.1327 8.71363 4.14385 10 reco:pandora2calo:Calorimetry 2.52038 4.54284 6.58642 4.69069 1.50063 10 reco:pandora2calonosce:Calorimetry 2.399 4.30828 6.35018 4.48311 1.42375 10 reco:pandora2pid:Chi2ParticleID 0.00664308 0.0086789 0.0112201 0.00884755 0.00144921 10 reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0355168 0.0452823 0.0579696 0.0439977 0.00805943 10 reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00655623 0.00867308 0.0109013 0.00887026 0.00146589 10 reco:pandora2Shower:LArPandoraShowerCreation 1.90774 3.05679 4.83349 2.97533 0.972152 10 reco:pandora2Showercalo:ShowerCalorimetry 2.20773 3.88478 5.83925 4.0752 1.21185 10 reco:pandora2Showercalonosce:ShowerCalorimetry 1.98551 3.51014 5.40059 3.55111 1.08141 10 [art]:TriggerResults:TriggerResultInserter 2.8504e-05 4.45441e-05 0.000115268 3.41995e-05 2.47385e-05 10 end_path:out1:RootOutput 7.965e-06 9.4257e-06 1.4217e-05 8.9165e-06 1.72969e-06 10 end_path:out1:RootOutput(write) 1.5505 2.10963 2.78445 2.03407 0.449595 10 ==================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 5142.61 MB Peak resident set size usage (VmHWM): 4337.7 MB Details saved in: 'mem.db' ==================================================================================================== ToolBasedRawDigitPrepService:dtor: Event count: 10 ToolBasedRawDigitPrepService:dtor: Call count: 60 ToolBasedRawDigitPrepService:dtor: Time report for 7 tools. ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.16 sec/event ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.20 sec/event ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event Art has completed and will exit with status 0. lar exit code 0 .: total 10527316 -rw-r--r-- 1 dunegli fnalgrid 2465107997 Aug 4 08:39 detsim_stage2.root -rw-r--r-- 1 dunegli fnalgrid 2339325134 Aug 4 08:37 detsim_stage1.root -rw-r--r-- 1 dunegli fnalgrid 2183474056 Aug 4 09:20 reco_stage1.root -rw-r--r-- 1 dunegli fnalgrid 1900157288 Aug 4 07:19 g4_stage2.root -rw-r--r-- 1 dunegli fnalgrid 1808473839 Aug 4 07:10 g4_stage1.root -rw-r--r-- 1 dunegli fnalgrid 82810220 Aug 4 09:17 Pandora_Events.pndr -rw-r--r-- 1 dunegli fnalgrid 242967 Aug 4 09:20 jobscript.log -rw-r--r-- 1 dunegli fnalgrid 217088 Aug 4 09:20 mem.db -rw-r--r-- 1 dunegli fnalgrid 62376 Aug 4 09:20 Pandora_Geometry.xml -rw-r--r-- 1 dunegli fnalgrid 36864 Aug 4 09:20 time.db -rw-r--r-- 1 dunegli fnalgrid 519 Aug 4 08:39 detsim_single_protoDUNE_hist.root -rw-r--r-- 1 dunegli fnalgrid 519 Aug 4 07:19 g4_protoDUNE_hist.root -rw-r--r-- 1 dunegli fnalgrid 519 Aug 4 09:20 protoDUNE_reco1_hist.root -rw-r--r-- 1 dunegli fnalgrid 52 Aug 4 07:07 all-input-dids.txt -rw-r--r-- 1 dunegli fnalgrid 7 Aug 4 09:20 justin-processed-pfns.txt -rw-r--r-- 1 dunegli fnalgrid 0 Aug 4 08:43 ProtoDUNE.log -rw-r--r-- 1 dunegli fnalgrid 0 Aug 4 08:39 debugprod.log