Jobsub ID 256483.0@dunegpschedd01.fnal.gov
| Jobsub ID | 256483.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10622 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-24 20:39:32 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-24 23:14:56 |
| From worker node | Hostname | dunegli-7724504-0-fnpc23113.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-24 21:17:02 |
| Input files | monte-carlo-010622-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (7061s) |
| CPU time | 1h (6991s = 99%) |
| Max RSS bytes | 4089434112 (3899 MiB) |
| Outputting started | 2025-11-24 23:14:43 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10622/1/001/reco_stage1.root
|
| Finished | 2025-11-24 23:14:56 |
| Saved logs | justin-logs:256483.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
ervice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 117510 traces, 0 summary
Retagger: tagging trace set: gauss with 87237 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 87237 traces tagged "gauss"
FrameSaver: q=3.09922e+06 n=1497603 tag=gauss
wclsFrameSaver: saving 117510 traces tagged "wiener"
FrameSaver: q=3.30387e+06 n=1312148 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 25019 XUs and 26294 XVs -> 198 XUVs
C:0 T:1 51920 XUs and 49200 XVs -> 3271 XUVs
C:0 T:2 69945 XUs and 113371 XVs -> 3796 XUVs
C:0 T:3 38954 XUs and 54160 XVs -> 489 XUVs
C:0 T:4 7271 XUs and 14844 XVs -> 74 XUVs
C:0 T:5 35116 XUs and 115680 XVs -> 5272 XUVs
C:0 T:6 104254 XUs and 74441 XVs -> 3662 XUVs
C:0 T:7 43026 XUs and 28459 XVs -> 365 XUVs
C:0 T:8 2551 XUs and 4910 XVs -> 25 XUVs
C:0 T:9 22654 XUs and 50941 XVs -> 5237 XUVs
C:0 T:10 53894 XUs and 39173 XVs -> 5628 XUVs
C:0 T:11 294 XUs and 212 XVs -> 24 XUVs
28041 XUVs total
10193 collection wire objects
25958 potential space points
Neighbour search...
1806134 tests to find 810488 neighbours
Iterating with no regularization...
Begin: 8.69317e+07
0 6.96202e+07
1 6.84964e+07
2 6.83299e+07
3 6.82837e+07
Now with regularization...
Begin: 5.69454e+07
0 5.69036e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410717074
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410717074
fLifetime: 30000 [us]
24-Nov-2025 23:14:42 UTC Closed output file "reco_stage1.root"
24-Nov-2025 23:14:42 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 139.372 179.278 242.615 177.246 26.2859 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00069174 0.00280896 0.00466994 0.00303292 0.00122101 10
reco:ophit:OpHitFinder 0.164098 0.189473 0.228231 0.187268 0.0155235 10
reco:opflash:OpFlashFinder 0.0816101 0.112497 0.139052 0.110649 0.0157994 10
reco:opslicer:OpSlicer 0.291817 0.354397 0.422728 0.356438 0.0404309 10
reco:caldata:DataPrepModule 3.12131 3.20945 3.39062 3.20317 0.072467 10
reco:wclsdatasp:WireCellToolkit 20.6494 21.4855 22.1217 21.532 0.520163 10
reco:gaushit:GausHitFinder 0.453369 0.579617 0.788125 0.566839 0.083924 10
reco:nhitsfilter:NumberOfHitsFilter 0.000191 0.000239148 0.000365114 0.000228327 4.78703e-05 10
reco:reco3d:SpacePointSolver 5.54467 8.74012 21.1521 7.18393 4.31473 10
reco:hitpdune:DisambigFromSpacePoints 0.500156 0.741382 1.23286 0.677833 0.192746 10
reco:pandora:StandardPandora 8.72984 14.8949 23.9213 13.6592 4.61559 10
reco:pandoraWriter:StandardPandora 0.175322 0.23828 0.33371 0.236701 0.0391928 10
reco:pandoraTrack:LArPandoraTrackCreation 1.11761 1.59114 2.5181 1.51367 0.347372 10
reco:pandoraShower:LArPandoraShowerCreation 0.945216 1.84083 3.11331 1.81243 0.501028 10
reco:pandoracalo:Calorimetry 0.637321 0.968546 1.4761 0.969581 0.207728 10
reco:pandoracalonosce:Calorimetry 0.579306 0.890343 1.34978 0.879313 0.192577 10
reco:pandorapid:Chi2ParticleID 0.00224505 0.00268825 0.00369144 0.00250104 0.000421072 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0223156 0.0266002 0.0328068 0.0263954 0.00294014 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00209838 0.00246168 0.00328201 0.00240208 0.000305754 10
reco:pandoraShowercalo:ShowerCalorimetry 0.950339 2.01412 3.41622 2.05289 0.585747 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.920474 1.94904 3.30986 1.97047 0.569209 10
reco:emtrkmichelid:EmTrackMichelId 80.3154 99.583 123.675 99.3391 11.7431 10
reco:crttag:SingleCRTMatchingProducer 0.00665305 0.00995236 0.0127102 0.0097918 0.00166496 10
reco:crtreco:TwoCRTMatchingProducer 0.00331707 0.00427385 0.00520524 0.00412767 0.000675084 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.406807 0.469622 0.563897 0.465989 0.0404007 10
reco:pandora2Track:LArPandoraTrackCreation 3.00646 5.32237 8.55825 5.25009 1.32326 10
reco:pandora2calo:Calorimetry 1.53266 2.85232 4.50241 2.86959 0.721999 10
reco:pandora2calonosce:Calorimetry 1.47939 2.70822 4.27444 2.72529 0.678996 10
reco:pandora2pid:Chi2ParticleID 0.00479404 0.0061897 0.00793953 0.0061521 0.000824982 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0287715 0.0336762 0.0408957 0.0334154 0.00317198 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00464657 0.00606752 0.00790344 0.00608966 0.000821722 10
reco:pandora2Shower:LArPandoraShowerCreation 1.20636 1.99388 2.99716 2.00245 0.416477 10
reco:pandora2Showercalo:ShowerCalorimetry 1.37071 2.48532 3.77546 2.55314 0.579635 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.29572 2.291 3.42267 2.37227 0.514986 10
[art]:TriggerResults:TriggerResultInserter 3.4362e-05 4.6151e-05 0.000114293 3.90795e-05 2.28849e-05 10
end_path:out1:RootOutput 9.915e-06 1.19421e-05 1.7106e-05 1.1087e-05 2.15175e-06 10
end_path:out1:RootOutput(write) 1.37629 1.6006 2.09666 1.59821 0.188027 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4898.79 MB
Peak resident set size usage (VmHWM): 4089.43 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 1.93 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9747372
-rw-r--r-- 1 dunegli fnalgrid 2300616862 Nov 24 22:43 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2186699478 Nov 24 22:42 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1963560006 Nov 24 23:14 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1766993573 Nov 24 21:28 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1693387569 Nov 24 21:20 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 69439390 Nov 24 23:12 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242958 Nov 24 23:14 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 24 23:14 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 24 23:14 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 24 23:14 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 22:43 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 21:28 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 23:14 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 24 21:17 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 24 23:14 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 24 22:46 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 24 22:43 debugprod.log
