Jobsub ID 301885.1@dunegpschedd01.fnal.gov
| Jobsub ID | 301885.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12461 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-28 08:06:25 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-28 12:05:26 |
| From worker node | Hostname | dunegli-8450302-0-fnpc18006.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-28 08:07:51 |
| Input files | monte-carlo-012461-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (14238s) |
| CPU time | 3h (14110s = 99%) |
| Max RSS bytes | 4007821312 (3822 MiB) |
| Outputting started | 2026-01-28 12:05:09 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12461/1/001/reco_stage1.root
|
| Finished | 2026-01-28 12:05:26 |
| Saved logs | justin-logs:301885.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
llSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 108012 traces, 0 summary
Retagger: tagging trace set: gauss with 87573 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 87573 traces tagged "gauss"
FrameSaver: q=2.93747e+06 n=1603173 tag=gauss
wclsFrameSaver: saving 108012 traces tagged "wiener"
FrameSaver: q=3.09717e+06 n=1447231 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:1 21267 XUs and 14431 XVs -> 1320 XUVs
C:0 T:2 58042 XUs and 106065 XVs -> 3585 XUVs
C:0 T:3 31069 XUs and 43366 XVs -> 276 XUVs
C:0 T:4 13391 XUs and 10961 XVs -> 144 XUVs
C:0 T:5 65424 XUs and 38486 XVs -> 5320 XUVs
C:0 T:6 138179 XUs and 133150 XVs -> 5853 XUVs
C:0 T:7 52870 XUs and 51687 XVs -> 438 XUVs
C:0 T:8 6991 XUs and 7795 XVs -> 62 XUVs
C:0 T:9 51380 XUs and 105888 XVs -> 8136 XUVs
C:0 T:10 26046 XUs and 15874 XVs -> 2240 XUVs
C:0 T:11 2874 XUs and 9912 XVs -> 1351 XUVs
28725 XUVs total
10003 collection wire objects
26847 potential space points
Neighbour search...
2565037 tests to find 1243046 neighbours
Iterating with no regularization...
Begin: 6.43109e+07
0 5.39899e+07
1 5.34337e+07
2 5.33492e+07
3 5.33237e+07
Now with regularization...
Begin: 4.50865e+07
0 4.5042e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 412014132
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412014132
fLifetime: 30000 [us]
28-Jan-2026 12:05:08 UTC Closed output file "reco_stage1.root"
28-Jan-2026 12:05:08 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 270.627 467.857 685.073 445.168 133.138 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00155727 0.0236615 0.209831 0.00302242 0.0620631 10
reco:ophit:OpHitFinder 0.23862 0.324789 0.391216 0.321332 0.0431992 10
reco:opflash:OpFlashFinder 0.124839 0.167734 0.23508 0.15807 0.0333479 10
reco:opslicer:OpSlicer 0.590068 0.874575 1.2475 0.816581 0.187604 10
reco:caldata:DataPrepModule 5.39968 7.27754 9.10757 7.77269 1.22361 10
reco:wclsdatasp:WireCellToolkit 35.0369 42.265 48.2081 42.7923 4.51102 10
reco:gaushit:GausHitFinder 0.905038 1.56371 2.07186 1.61659 0.435431 10
reco:nhitsfilter:NumberOfHitsFilter 0.000448946 0.00061033 0.000864228 0.000621875 0.000134153 10
reco:reco3d:SpacePointSolver 10.5965 20.6073 43.3557 15.2107 11.2262 10
reco:hitpdune:DisambigFromSpacePoints 1.00793 1.96926 3.25099 1.77186 0.704365 10
reco:pandora:StandardPandora 17.9471 48.3085 104.616 37.3988 26.4435 10
reco:pandoraWriter:StandardPandora 0.367833 0.543035 0.7218 0.549919 0.123075 10
reco:pandoraTrack:LArPandoraTrackCreation 3.03214 5.74274 8.09023 5.70578 1.90859 10
reco:pandoraShower:LArPandoraShowerCreation 3.36618 6.19767 9.47205 5.87032 2.26279 10
reco:pandoracalo:Calorimetry 1.2983 3.09157 4.72749 3.05465 1.2301 10
reco:pandoracalonosce:Calorimetry 1.29409 2.88519 4.35652 2.79567 1.11705 10
reco:pandorapid:Chi2ParticleID 0.00575311 0.00912452 0.0127998 0.00870409 0.00211983 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0422458 0.0732824 0.10884 0.0801736 0.0218746 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00466972 0.00829202 0.0115813 0.00870594 0.00203178 10
reco:pandoraShowercalo:ShowerCalorimetry 2.67563 6.13747 10.2434 5.61314 2.81369 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.04251 5.98703 10.0093 5.42091 2.68581 10
reco:emtrkmichelid:EmTrackMichelId 147.476 255.621 358.527 263.816 67.1802 10
reco:crttag:SingleCRTMatchingProducer 0.0121794 0.0173857 0.025867 0.0158302 0.00474209 10
reco:crtreco:TwoCRTMatchingProducer 0.00806594 0.0117752 0.0173906 0.0113893 0.00337721 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.656032 1.04543 1.59523 1.01473 0.313391 10
reco:pandora2Track:LArPandoraTrackCreation 10.031 17.5548 27.7175 14.126 6.50313 10
reco:pandora2calo:Calorimetry 3.77569 8.27905 14.1534 6.25686 3.71693 10
reco:pandora2calonosce:Calorimetry 3.59399 7.76259 13.5461 5.55394 3.56384 10
reco:pandora2pid:Chi2ParticleID 0.0166045 0.0227941 0.0307193 0.0210286 0.00466895 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0583012 0.0922951 0.136588 0.0882902 0.0278275 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0139419 0.0210263 0.0274075 0.0198609 0.00453884 10
reco:pandora2Shower:LArPandoraShowerCreation 3.90995 6.54196 10.6783 5.34075 2.3837 10
reco:pandora2Showercalo:ShowerCalorimetry 3.31723 6.86167 12.2813 5.45099 2.89864 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.64669 6.08216 11.3085 4.50021 2.69932 10
[art]:TriggerResults:TriggerResultInserter 4.442e-05 6.22993e-05 0.000140732 5.2556e-05 2.75496e-05 10
end_path:out1:RootOutput 9.987e-06 1.18801e-05 1.739e-05 1.05115e-05 2.55086e-06 10
end_path:out1:RootOutput(write) 2.59224 3.77148 5.86145 3.59046 1.0372 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4828.92 MB
Peak resident set size usage (VmHWM): 4007.82 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.29 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.66 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9230432
-rw-r--r-- 1 dunegli fnalgrid 2214939468 Jan 28 10:44 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2104642593 Jan 28 10:41 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1880060382 Jan 28 12:05 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1629221099 Jan 28 08:23 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1552483643 Jan 28 08:12 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 69986090 Jan 28 12:01 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242838 Jan 28 12:05 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 28 12:05 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 28 12:05 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 28 12:05 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 28 10:44 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 28 08:23 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 28 12:05 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 28 08:07 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 28 12:05 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 28 10:53 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 28 10:44 debugprod.log
