Jobsub ID 249147.1@dunegpschedd02.fnal.gov
| Jobsub ID | 249147.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10448 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-21 10:38:16 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-21 15:47:15 |
| From worker node | Hostname | dunegli-7829465-0-fnpc18009.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-21 10:39:39 |
| Input files | monte-carlo-010448-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (18386s) |
| CPU time | 4h (17556s = 95%) |
| Max RSS bytes | 4089155584 (3899 MiB) |
| Outputting started | 2025-11-21 15:46:05 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10448/1/001/reco_stage1.root
|
| Finished | 2025-11-21 15:47:15 |
| Saved logs | justin-logs:249147.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Service:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 133854 traces, 0 summary
Retagger: tagging trace set: gauss with 102941 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 102941 traces tagged "gauss"
FrameSaver: q=3.67422e+06 n=1857704 tag=gauss
wclsFrameSaver: saving 133854 traces tagged "wiener"
FrameSaver: q=3.8656e+06 n=1651300 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 41380 XUs and 33050 XVs -> 473 XUVs
C:0 T:1 72478 XUs and 65846 XVs -> 3598 XUVs
C:0 T:2 42475 XUs and 79481 XVs -> 3160 XUVs
C:0 T:3 21526 XUs and 33676 XVs -> 229 XUVs
C:0 T:4 18975 XUs and 18443 XVs -> 176 XUVs
C:0 T:5 74213 XUs and 58047 XVs -> 5157 XUVs
C:0 T:6 116047 XUs and 103952 XVs -> 4787 XUVs
C:0 T:7 50535 XUs and 38483 XVs -> 352 XUVs
C:0 T:8 9118 XUs and 8634 XVs -> 89 XUVs
C:0 T:9 54996 XUs and 73165 XVs -> 3855 XUVs
C:0 T:10 29342 XUs and 14006 XVs -> 3253 XUVs
C:0 T:11 46 XUs and 19 XVs -> 9 XUVs
25138 XUVs total
11549 collection wire objects
23424 potential space points
Neighbour search...
726028 tests to find 401794 neighbours
Iterating with no regularization...
Begin: 7.64091e+07
0 6.62114e+07
1 6.55009e+07
2 6.54074e+07
3 6.53817e+07
Now with regularization...
Begin: 5.56301e+07
0 5.56027e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410648372
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410648372
fLifetime: 30000 [us]
21-Nov-2025 15:42:27 UTC Closed output file "reco_stage1.root"
21-Nov-2025 15:42:27 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 405.344 537.694 645.533 550.286 70.1365 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00206461 0.00562622 0.0113804 0.00575778 0.00280769 10
reco:ophit:OpHitFinder 0.31057 0.400195 0.509165 0.388108 0.0649143 10
reco:opflash:OpFlashFinder 0.162581 0.236107 0.301562 0.236027 0.0385476 10
reco:opslicer:OpSlicer 0.708654 1.1275 1.56057 1.08599 0.258924 10
reco:caldata:DataPrepModule 6.64263 8.17121 11.1678 7.45919 1.48044 10
reco:wclsdatasp:WireCellToolkit 39.713 49.3359 58.7704 47.8115 6.10577 10
reco:gaushit:GausHitFinder 1.33112 1.82377 2.57078 1.77603 0.309313 10
reco:nhitsfilter:NumberOfHitsFilter 0.000684712 0.000968248 0.00132613 0.000922657 0.000178808 10
reco:reco3d:SpacePointSolver 9.40998 20.2942 33.0831 19.5644 5.63618 10
reco:hitpdune:DisambigFromSpacePoints 1.31835 2.31907 3.49049 2.36753 0.541762 10
reco:pandora:StandardPandora 27.2779 53.4908 78.8228 54.3211 14.8253 10
reco:pandoraWriter:StandardPandora 0.447085 0.640181 0.871827 0.609407 0.110403 10
reco:pandoraTrack:LArPandoraTrackCreation 3.74035 7.93176 11.3315 8.05333 2.18559 10
reco:pandoraShower:LArPandoraShowerCreation 4.75548 10.1452 13.6827 10.2779 2.47375 10
reco:pandoracalo:Calorimetry 1.87378 4.55785 6.32685 4.61944 1.27588 10
reco:pandoracalonosce:Calorimetry 1.78785 4.4268 6.21913 4.57394 1.29776 10
reco:pandorapid:Chi2ParticleID 0.00549304 0.00924761 0.0128446 0.00940889 0.00183581 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0504478 0.0883754 0.127344 0.0880282 0.0218867 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00528645 0.00852326 0.0119873 0.00891785 0.00189548 10
reco:pandoraShowercalo:ShowerCalorimetry 4.19817 10.8933 14.3737 11.3785 2.75297 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.11658 10.4974 14.5176 10.5458 2.60288 10
reco:emtrkmichelid:EmTrackMichelId 220.46 258.576 322.611 250.577 29.6467 10
reco:crttag:SingleCRTMatchingProducer 0.0239175 0.032747 0.0419118 0.0320479 0.00528 10
reco:crtreco:TwoCRTMatchingProducer 0.014752 0.0202253 0.0278865 0.0202355 0.00372662 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.03764 1.27152 1.52115 1.28984 0.144723 10
reco:pandora2Track:LArPandoraTrackCreation 16.3436 27.0315 37.5894 27.4934 6.03737 10
reco:pandora2calo:Calorimetry 6.21501 13.5651 19.1646 13.8298 3.51348 10
reco:pandora2calonosce:Calorimetry 5.61615 13.0271 17.5287 13.3476 3.43506 10
reco:pandora2pid:Chi2ParticleID 0.0171371 0.0225928 0.0270219 0.0224583 0.0029828 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0865352 0.108829 0.138259 0.106751 0.0144356 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0172638 0.0219345 0.026716 0.0215229 0.00285603 10
reco:pandora2Shower:LArPandoraShowerCreation 5.16241 10.4471 16.0799 9.95683 2.99014 10
reco:pandora2Showercalo:ShowerCalorimetry 6.02281 12.0209 17.0847 12.4049 3.22323 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.84285 10.7095 14.2817 10.8671 2.81969 10
[art]:TriggerResults:TriggerResultInserter 0.000102994 0.000140887 0.000186982 0.000142854 2.61902e-05 10
end_path:out1:RootOutput 1.4868e-05 1.98806e-05 2.8775e-05 1.77985e-05 4.71503e-06 10
end_path:out1:RootOutput(write) 3.55816 4.2171 4.73297 4.24945 0.3685 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4903.25 MB
Peak resident set size usage (VmHWM): 4089.16 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10206896
-rw-r--r-- 1 dunegli fnalgrid 2398422786 Nov 21 14:09 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2276462756 Nov 21 14:00 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2089837378 Nov 21 15:42 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1843062721 Nov 21 11:15 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1767250645 Nov 21 10:51 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 76203290 Nov 21 15:35 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242799 Nov 21 15:42 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 21 15:42 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 21 15:42 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 21 15:42 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 14:09 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 11:15 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 15:42 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 21 10:39 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 21 15:42 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 14:16 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 14:09 debugprod.log
