This Fermilab instance is still being tested. Please do not submit user workflows for now. Thanks!
Jobsub ID 14283.0@dunegpschedd02.fnal.gov
| Jobsub ID | 14283.0@dunegpschedd02.fnal.gov | |
| Workflow ID | 301 | |
| Stage ID | 1 | |
| User name | pmelas@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 8388608000 (8000 MiB) | |
| Wall seconds limit | 86400 (24 hours) | |
| Submitted time | 2025-08-04 07:05:33 | |
| Site | US_FNAL-FermiGrid | |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly | |
| Last heartbeat | 2025-08-04 08:57:27 | |
| From worker node | Hostname | dunegli-6302047-0-fnpc22036.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 10485760000 (10000 MiB) | |
| Wall seconds limit | 172800 (48 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-08-04 07:06:46 | |
| Input files | monte-carlo-000301-000001 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (6628s) | |
| CPU time | 1h (6550s = 98%) | |
| Max RSS bytes | 4047212544 (3859 MiB) | |
| Outputting started | 2025-08-04 08:57:14 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/00301/1/001/reco_stage1.root | |
| Finished | 2025-08-04 08:57:27 | |
| Saved logs | justin-logs:14283.0-dunegpschedd02.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
s input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 113177 traces, 0 summary Retagger: tagging trace set: gauss with 88995 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 88995 traces tagged "gauss" FrameSaver: q=3.20305e+06 n=1625187 tag=gauss wclsFrameSaver: saving 113177 traces tagged "wiener" FrameSaver: q=3.40658e+06 n=1447337 tag=wiener 72 X, 28 U, 34 V bad channels Finding XUV coincidences... C:0 T:0 31095 XUs and 29775 XVs -> 562 XUVs C:0 T:1 80269 XUs and 70739 XVs -> 6725 XUVs C:0 T:2 206304 XUs and 331452 XVs -> 22127 XUVs C:0 T:3 59246 XUs and 70786 XVs -> 522 XUVs C:0 T:4 9008 XUs and 13190 XVs -> 128 XUVs C:0 T:5 35211 XUs and 36185 XVs -> 2788 XUVs C:0 T:6 60161 XUs and 47799 XVs -> 1990 XUVs C:0 T:7 26934 XUs and 19090 XVs -> 106 XUVs C:0 T:9 26956 XUs and 46428 XVs -> 1869 XUVs C:0 T:10 44650 XUs and 32090 XVs -> 3501 XUVs C:0 T:11 441 XUs and 429 XVs -> 40 XUVs 40358 XUVs total 12968 collection wire objects 34785 potential space points Neighbour search... 4881869 tests to find 1358454 neighbours Iterating with no regularization... Begin: 1.10965e+08 0 7.6938e+07 1 7.36902e+07 2 7.31153e+07 3 7.29236e+07 4 7.28406e+07 5 7.27963e+07 Now with regularization... Begin: 6.09913e+07 0 6.08542e+07 1 6.07889e+07 2 6.07432e+07 BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list run: 1 ; subrun: 0 ; event: 10 evttime: 408452643 fLifetime: 30000 [us] run: 1 ; subrun: 0 ; event: 10 evttime: 408452643 fLifetime: 30000 [us] 04-Aug-2025 08:57:14 UTC Closed output file "reco_stage1.root" 04-Aug-2025 08:57:14 UTC Closed input file "detsim_stage2.root" DataPrepModule::endJob: # events processed: 10 DataPrepModule::endJob: # events skipped: 0 ==================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ==================================================================================================================================== Full event 134.331 189.783 235.541 194.135 30.6722 10 ------------------------------------------------------------------------------------------------------------------------------------ source:RootInput(read) 0.000724439 0.00267974 0.00421108 0.00275962 0.00115178 10 reco:ophit:OpHitFinder 0.142651 0.183851 0.218666 0.188464 0.0214862 10 reco:opflash:OpFlashFinder 0.0695588 0.10284 0.135059 0.101761 0.0204003 10 reco:opslicer:OpSlicer 0.231337 0.388182 0.496807 0.378199 0.0690174 10 reco:caldata:DataPrepModule 3.3689 3.4932 3.60205 3.4996 0.0609833 10 reco:wclsdatasp:WireCellToolkit 23.5509 24.5669 25.7369 24.4181 0.732256 10 reco:gaushit:GausHitFinder 0.479363 0.658592 0.736722 0.689901 0.0840249 10 reco:nhitsfilter:NumberOfHitsFilter 0.000235375 0.000408278 0.00061908 0.000387187 0.000107902 10 reco:reco3d:SpacePointSolver 3.62236 8.11289 11.0005 8.51978 2.65018 10 reco:hitpdune:DisambigFromSpacePoints 0.470513 0.806351 1.09275 0.851763 0.179685 10 reco:pandora:StandardPandora 8.36939 17.4159 42.5857 15.751 9.14495 10 reco:pandoraWriter:StandardPandora 0.183007 0.253801 0.298543 0.26344 0.0394582 10 reco:pandoraTrack:LArPandoraTrackCreation 0.980098 2.05439 2.62463 2.26587 0.529722 10 reco:pandoraShower:LArPandoraShowerCreation 0.93499 2.05955 2.92372 2.18671 0.606648 10 reco:pandoracalo:Calorimetry 0.749276 1.22326 1.56788 1.29826 0.283098 10 reco:pandoracalonosce:Calorimetry 0.645315 1.14796 1.53255 1.22626 0.292285 10 reco:pandorapid:Chi2ParticleID 0.00269643 0.0033701 0.00413221 0.00328503 0.000401908 10 reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0232279 0.0291024 0.034375 0.0292215 0.00339258 10 reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00252178 0.00318606 0.00377504 0.00317673 0.000449666 10 reco:pandoraShowercalo:ShowerCalorimetry 0.968352 2.42058 4.0076 2.34722 0.894274 10 reco:pandoraShowercalonosce:ShowerCalorimetry 0.933615 2.31405 3.74502 2.33933 0.83293 10 reco:emtrkmichelid:EmTrackMichelId 75.9197 99.6136 116.858 104.156 12.3828 10 reco:crttag:SingleCRTMatchingProducer 0.00435254 0.00709329 0.00874962 0.00733284 0.00120486 10 reco:crtreco:TwoCRTMatchingProducer 0.0034926 0.00461726 0.00567141 0.00453138 0.000719473 10 reco:anodepiercerst0:T0RecoAnodePiercers 0.424615 0.545612 0.641253 0.53186 0.0761058 10 reco:pandora2Track:LArPandoraTrackCreation 2.80146 6.31969 9.44959 6.80207 2.05843 10 reco:pandora2calo:Calorimetry 1.40025 3.39934 4.6009 3.91051 1.10808 10 reco:pandora2calonosce:Calorimetry 1.31955 3.22952 4.44259 3.65582 1.08206 10 reco:pandora2pid:Chi2ParticleID 0.00482326 0.00742577 0.00944149 0.00757604 0.00136679 10 reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0247631 0.0366824 0.0444529 0.0379634 0.00582229 10 reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0047677 0.0073903 0.00936131 0.00770961 0.00137878 10 reco:pandora2Shower:LArPandoraShowerCreation 1.05926 2.19926 3.13851 2.37702 0.632368 10 reco:pandora2Showercalo:ShowerCalorimetry 1.2261 2.84496 4.04671 3.09525 0.929743 10 reco:pandora2Showercalonosce:ShowerCalorimetry 1.16848 2.54512 3.66639 2.83838 0.784236 10 [art]:TriggerResults:TriggerResultInserter 2.8384e-05 4.43739e-05 9.5351e-05 3.7401e-05 1.96083e-05 10 end_path:out1:RootOutput 7.113e-06 9.3217e-06 1.2664e-05 9.388e-06 1.58047e-06 10 end_path:out1:RootOutput(write) 1.23306 1.70599 2.03371 1.76061 0.239304 10 ==================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4858.18 MB Peak resident set size usage (VmHWM): 4047.21 MB Details saved in: 'mem.db' ==================================================================================================== ToolBasedRawDigitPrepService:dtor: Event count: 10 ToolBasedRawDigitPrepService:dtor: Call count: 60 ToolBasedRawDigitPrepService:dtor: Time report for 7 tools. ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.16 sec/event ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.15 sec/event ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event Art has completed and will exit with status 0. lar exit code 0 .: total 9341260 -rw-r--r-- 1 dunegli fnalgrid 2227448530 Aug 4 08:24 detsim_stage2.root -rw-r--r-- 1 dunegli fnalgrid 2121173989 Aug 4 08:23 detsim_stage1.root -rw-r--r-- 1 dunegli fnalgrid 1880907421 Aug 4 08:57 reco_stage1.root -rw-r--r-- 1 dunegli fnalgrid 1661863577 Aug 4 07:15 g4_stage2.root -rw-r--r-- 1 dunegli fnalgrid 1606109650 Aug 4 07:09 g4_stage1.root -rw-r--r-- 1 dunegli fnalgrid 67329590 Aug 4 08:54 Pandora_Events.pndr -rw-r--r-- 1 dunegli fnalgrid 242861 Aug 4 08:57 jobscript.log -rw-r--r-- 1 dunegli fnalgrid 217088 Aug 4 08:57 mem.db -rw-r--r-- 1 dunegli fnalgrid 62376 Aug 4 08:57 Pandora_Geometry.xml -rw-r--r-- 1 dunegli fnalgrid 36864 Aug 4 08:57 time.db -rw-r--r-- 1 dunegli fnalgrid 519 Aug 4 08:24 detsim_single_protoDUNE_hist.root -rw-r--r-- 1 dunegli fnalgrid 519 Aug 4 07:15 g4_protoDUNE_hist.root -rw-r--r-- 1 dunegli fnalgrid 519 Aug 4 08:57 protoDUNE_reco1_hist.root -rw-r--r-- 1 dunegli fnalgrid 52 Aug 4 07:06 all-input-dids.txt -rw-r--r-- 1 dunegli fnalgrid 7 Aug 4 08:57 justin-processed-pfns.txt -rw-r--r-- 1 dunegli fnalgrid 0 Aug 4 08:26 ProtoDUNE.log -rw-r--r-- 1 dunegli fnalgrid 0 Aug 4 08:24 debugprod.log