Jobsub ID 247574.1@dunegpschedd02.fnal.gov
| Jobsub ID | 247574.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10289 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-17 09:57:11 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-17 12:20:32 |
| From worker node | Hostname | dunegli-7789642-0-fnpc23108.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-17 10:09:33 |
| Input files | monte-carlo-010289-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7847s) |
| CPU time | 2h (7757s = 98%) |
| Max RSS bytes | 3981688832 (3797 MiB) |
| Outputting started | 2025-11-17 12:20:21 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10289/1/001/reco_stage1.root
|
| Finished | 2025-11-17 12:20:32 |
| Saved logs | justin-logs:247574.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
vice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 134270 traces, 0 summary
Retagger: tagging trace set: gauss with 96478 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 96478 traces tagged "gauss"
FrameSaver: q=3.4101e+06 n=1625082 tag=gauss
wclsFrameSaver: saving 134270 traces tagged "wiener"
FrameSaver: q=3.65167e+06 n=1417889 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 31309 XUs and 29438 XVs -> 266 XUVs
C:0 T:1 62398 XUs and 61835 XVs -> 5994 XUVs
C:0 T:2 63888 XUs and 88341 XVs -> 4009 XUVs
C:0 T:3 34237 XUs and 39351 XVs -> 182 XUVs
C:0 T:4 11530 XUs and 13829 XVs -> 201 XUVs
C:0 T:5 56962 XUs and 55241 XVs -> 8170 XUVs
C:0 T:6 104384 XUs and 114248 XVs -> 6015 XUVs
C:0 T:7 45314 XUs and 44016 XVs -> 436 XUVs
C:0 T:8 3695 XUs and 3756 XVs -> 37 XUVs
C:0 T:9 28609 XUs and 45137 XVs -> 6482 XUVs
C:0 T:10 59040 XUs and 61883 XVs -> 17941 XUVs
C:0 T:11 542 XUs and 314 XVs -> 61 XUVs
49794 XUVs total
11183 collection wire objects
47341 potential space points
Neighbour search...
7350101 tests to find 3563912 neighbours
Iterating with no regularization...
Begin: 6.98367e+07
0 6.07848e+07
1 6.00658e+07
2 5.99596e+07
3 5.99292e+07
Now with regularization...
Begin: 5.02591e+07
0 5.02151e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410567227
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410567227
fLifetime: 30000 [us]
17-Nov-2025 12:20:20 UTC Closed output file "reco_stage1.root"
17-Nov-2025 12:20:20 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 174.429 219.899 289.107 206.543 39.2175 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000899098 0.00315465 0.0050194 0.00313624 0.00114551 10
reco:ophit:OpHitFinder 0.170518 0.217562 0.262883 0.228303 0.0333855 10
reco:opflash:OpFlashFinder 0.0885217 0.114885 0.148766 0.118334 0.0171906 10
reco:opslicer:OpSlicer 0.288404 0.473819 0.638087 0.519167 0.117329 10
reco:caldata:DataPrepModule 3.15026 4.28891 5.15593 4.71683 0.873929 10
reco:wclsdatasp:WireCellToolkit 22.1716 25.3928 30.8214 25.4254 2.82422 10
reco:gaushit:GausHitFinder 0.562399 0.751452 1.15814 0.69963 0.185401 10
reco:nhitsfilter:NumberOfHitsFilter 0.000198452 0.000299503 0.000457516 0.000283106 9.1418e-05 10
reco:reco3d:SpacePointSolver 5.01784 9.25696 15.7395 8.35587 2.93885 10
reco:hitpdune:DisambigFromSpacePoints 0.580939 0.887445 1.65383 0.781508 0.314158 10
reco:pandora:StandardPandora 11.3935 16.5466 25.1983 14.5531 4.78378 10
reco:pandoraWriter:StandardPandora 0.212135 0.296344 0.445426 0.285869 0.0589338 10
reco:pandoraTrack:LArPandoraTrackCreation 1.40631 2.31427 3.70296 2.07539 0.709477 10
reco:pandoraShower:LArPandoraShowerCreation 1.45463 2.24465 4.10071 2.12627 0.786739 10
reco:pandoracalo:Calorimetry 0.824599 1.17263 1.70991 1.11628 0.261649 10
reco:pandoracalonosce:Calorimetry 0.734024 1.09764 1.58118 1.02524 0.284522 10
reco:pandorapid:Chi2ParticleID 0.00267874 0.00335491 0.00564664 0.00311269 0.000816049 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0239394 0.0310478 0.0402513 0.0312681 0.00557834 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00260056 0.00308092 0.00378201 0.00296614 0.000360689 10
reco:pandoraShowercalo:ShowerCalorimetry 1.39954 2.26504 3.84764 2.12393 0.776122 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.32359 2.32954 3.97367 2.17617 0.929554 10
reco:emtrkmichelid:EmTrackMichelId 96.8701 123.927 165.316 122.373 22.6791 10
reco:crttag:SingleCRTMatchingProducer 0.00607509 0.00999551 0.0150903 0.00952356 0.00268101 10
reco:crtreco:TwoCRTMatchingProducer 0.00351866 0.00589134 0.0087537 0.00622068 0.00181865 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.402237 0.617588 0.85411 0.613145 0.157177 10
reco:pandora2Track:LArPandoraTrackCreation 3.9027 7.64081 12.5955 6.64405 2.94624 10
reco:pandora2calo:Calorimetry 1.87849 3.76615 5.99755 3.24978 1.45846 10
reco:pandora2calonosce:Calorimetry 1.83416 3.42312 5.80499 3.19742 1.25347 10
reco:pandora2pid:Chi2ParticleID 0.00564353 0.00897059 0.0136481 0.00801308 0.00285276 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0293828 0.0479879 0.0735405 0.0451438 0.0159153 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00560373 0.00848741 0.0126252 0.00784983 0.00263895 10
reco:pandora2Shower:LArPandoraShowerCreation 1.56577 2.66841 4.4089 2.35656 0.830417 10
reco:pandora2Showercalo:ShowerCalorimetry 1.73896 3.1627 5.40316 2.93711 1.1774 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.59499 2.88909 4.80362 2.51636 1.07544 10
[art]:TriggerResults:TriggerResultInserter 3.6936e-05 5.68246e-05 0.000115937 5.0056e-05 2.16028e-05 10
end_path:out1:RootOutput 6.43e-06 8.531e-06 1.3901e-05 7.1665e-06 2.48832e-06 10
end_path:out1:RootOutput(write) 1.37089 1.91526 2.79368 1.82997 0.461508 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4798.14 MB
Peak resident set size usage (VmHWM): 3981.69 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.60 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9140304
-rw-r--r-- 1 dunegli fnalgrid 2186053287 Nov 17 11:42 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2077558899 Nov 17 11:40 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1842134725 Nov 17 12:20 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1622141030 Nov 17 10:19 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1563534107 Nov 17 10:12 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 67636380 Nov 17 12:17 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242685 Nov 17 12:20 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 17 12:20 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 17 12:20 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 17 12:20 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 17 11:42 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 17 10:19 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 17 12:20 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 17 10:09 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 17 12:20 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 17 11:45 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 17 11:42 debugprod.log
