Jobsub ID 271179.0@dunegpschedd01.fnal.gov
| Jobsub ID | 271179.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11459 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-01 07:48:57 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-01 12:16:32 |
| From worker node | Hostname | dunegli-8053767-0-fnpc17129.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-01 08:12:36 |
| Input files | monte-carlo-011459-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (14616s) |
| CPU time | 3h (13346s = 91%) |
| Max RSS bytes | 4084457472 (3895 MiB) |
| Outputting started | 2026-01-01 12:16:13 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11459/1/001/reco_stage1.root
|
| Finished | 2026-01-01 12:16:32 |
| Saved logs | justin-logs:271179.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 144527 traces, 0 summary
Retagger: tagging trace set: gauss with 112137 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 112137 traces tagged "gauss"
FrameSaver: q=4.16492e+06 n=2045296 tag=gauss
wclsFrameSaver: saving 144527 traces tagged "wiener"
FrameSaver: q=4.39974e+06 n=1839553 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 17031 XUs and 20016 XVs -> 113 XUVs
C:0 T:1 24538 XUs and 25620 XVs -> 1700 XUVs
C:0 T:2 37092 XUs and 55396 XVs -> 1880 XUVs
C:0 T:3 21427 XUs and 25705 XVs -> 140 XUVs
C:0 T:4 20680 XUs and 22550 XVs -> 272 XUVs
C:0 T:5 79822 XUs and 71852 XVs -> 7007 XUVs
C:0 T:6 113762 XUs and 110787 XVs -> 3734 XUVs
C:0 T:7 52972 XUs and 48314 XVs -> 566 XUVs
C:0 T:8 10361 XUs and 13236 XVs -> 107 XUVs
C:0 T:9 65305 XUs and 98773 XVs -> 7389 XUVs
C:0 T:10 70940 XUs and 53546 XVs -> 8642 XUVs
C:0 T:11 1194 XUs and 996 XVs -> 129 XUVs
31679 XUVs total
11337 collection wire objects
30057 potential space points
Neighbour search...
1694841 tests to find 950472 neighbours
Iterating with no regularization...
Begin: 8.73505e+07
0 7.63671e+07
1 7.55279e+07
2 7.54245e+07
3 7.53973e+07
Now with regularization...
Begin: 6.32666e+07
0 6.32473e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411470681
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411470681
fLifetime: 30000 [us]
01-Jan-2026 12:16:09 UTC Closed output file "reco_stage1.root"
01-Jan-2026 12:16:09 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 381.4 459.961 561.534 452.777 49.5556 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00107198 0.00391402 0.00632569 0.00396824 0.00152326 10
reco:ophit:OpHitFinder 0.229645 0.279803 0.330201 0.282397 0.0319929 10
reco:opflash:OpFlashFinder 0.158634 0.206017 0.275221 0.200348 0.0371343 10
reco:opslicer:OpSlicer 0.465427 0.686469 0.943197 0.665957 0.135595 10
reco:caldata:DataPrepModule 6.05973 6.47696 7.94384 6.30601 0.537554 10
reco:wclsdatasp:WireCellToolkit 50.0179 52.4546 57.4628 52.3565 2.13337 10
reco:gaushit:GausHitFinder 1.18628 1.49113 1.94467 1.46388 0.187871 10
reco:nhitsfilter:NumberOfHitsFilter 0.000626701 0.000755204 0.000902136 0.000722529 9.18457e-05 10
reco:reco3d:SpacePointSolver 9.16244 14.1432 23.9081 13.4823 3.85192 10
reco:hitpdune:DisambigFromSpacePoints 1.58315 2.17865 3.45315 2.04935 0.488219 10
reco:pandora:StandardPandora 25.0391 38.1742 58.1389 37.6183 8.01822 10
reco:pandoraWriter:StandardPandora 0.422532 0.70894 2.39762 0.51743 0.5668 10
reco:pandoraTrack:LArPandoraTrackCreation 5.81193 8.99498 12.9119 8.28997 2.173 10
reco:pandoraShower:LArPandoraShowerCreation 4.62636 11.3052 16.8689 11.9853 3.39876 10
reco:pandoracalo:Calorimetry 2.58777 4.21828 5.82026 3.9788 1.00484 10
reco:pandoracalonosce:Calorimetry 2.5059 3.94047 5.33193 3.82046 0.867364 10
reco:pandorapid:Chi2ParticleID 0.00505364 0.0060323 0.00856738 0.00551138 0.00100339 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0571374 0.0672495 0.0778406 0.068294 0.00643805 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00491854 0.00578702 0.00704295 0.00566659 0.000642076 10
reco:pandoraShowercalo:ShowerCalorimetry 5.42047 10.4242 14.7012 11.31 2.52492 10
reco:pandoraShowercalonosce:ShowerCalorimetry 5.10574 10.0983 14.2756 10.4092 2.34863 10
reco:emtrkmichelid:EmTrackMichelId 183.572 204.859 238.674 203.443 18.7443 10
reco:crttag:SingleCRTMatchingProducer 0.0210676 0.0300238 0.0450932 0.0296104 0.0062934 10
reco:crtreco:TwoCRTMatchingProducer 0.0178626 0.0241517 0.0319356 0.0245162 0.00491222 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.915452 1.26139 1.84529 1.19215 0.25175 10
reco:pandora2Track:LArPandoraTrackCreation 21.9638 31.2579 40.8588 30.1514 5.35485 10
reco:pandora2calo:Calorimetry 8.44411 13.2004 17.0346 12.9233 2.38748 10
reco:pandora2calonosce:Calorimetry 6.70135 12.1109 15.2086 12.5604 2.19015 10
reco:pandora2pid:Chi2ParticleID 0.0130437 0.0151731 0.017386 0.0157244 0.0014937 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0778159 0.0884162 0.0970229 0.089312 0.00653261 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0124653 0.014659 0.0160985 0.0148612 0.00100007 10
reco:pandora2Shower:LArPandoraShowerCreation 6.61755 8.85444 11.5184 8.4469 1.41012 10
reco:pandora2Showercalo:ShowerCalorimetry 6.72956 10.4337 12.8034 10.4176 1.75877 10
reco:pandora2Showercalonosce:ShowerCalorimetry 6.57571 8.68309 11.6939 8.55918 1.44939 10
[art]:TriggerResults:TriggerResultInserter 6.7899e-05 9.21551e-05 0.000212475 7.3256e-05 4.17313e-05 10
end_path:out1:RootOutput 8.823e-06 1.14632e-05 2.1259e-05 9.8655e-06 3.50374e-06 10
end_path:out1:RootOutput(write) 2.53168 3.08888 4.04655 3.0723 0.494004 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4905.58 MB
Peak resident set size usage (VmHWM): 4084.46 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.25 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.84 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9700372
-rw-r--r-- 1 dunegli fnalgrid 2299841091 Jan 1 10:52 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2187521089 Jan 1 10:44 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1974537265 Jan 1 12:16 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1732127922 Jan 1 08:35 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1666473388 Jan 1 08:20 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 72053430 Jan 1 12:09 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242817 Jan 1 12:16 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 1 12:16 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 1 12:16 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 1 12:16 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 10:53 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 08:35 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 12:16 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 1 08:12 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 1 12:16 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 11:03 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 10:53 debugprod.log
