Jobsub ID 249149.0@dunegpschedd02.fnal.gov
| Jobsub ID | 249149.0@dunegpschedd02.fnal.gov |
| Workflow ID | 10452 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-21 10:40:17 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-21 14:31:03 |
| From worker node | Hostname | dunegli-7677248-0-fnpc22013.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-21 10:41:01 |
| Input files | monte-carlo-010452-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13768s) |
| CPU time | 3h (13538s = 98%) |
| Max RSS bytes | 4112183296 (3921 MiB) |
| Outputting started | 2025-11-21 14:30:29 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10452/1/001/reco_stage1.root
|
| Finished | 2025-11-21 14:30:59 |
| Saved logs | justin-logs:249149.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ervice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 120454 traces, 0 summary
Retagger: tagging trace set: gauss with 91961 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 91961 traces tagged "gauss"
FrameSaver: q=3.22495e+06 n=1656877 tag=gauss
wclsFrameSaver: saving 120454 traces tagged "wiener"
FrameSaver: q=3.39314e+06 n=1465926 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 41519 XUs and 36059 XVs -> 491 XUVs
C:0 T:1 93298 XUs and 76290 XVs -> 6443 XUVs
C:0 T:2 92873 XUs and 157981 XVs -> 6400 XUVs
C:0 T:3 44921 XUs and 62335 XVs -> 462 XUVs
C:0 T:4 11919 XUs and 10748 XVs -> 178 XUVs
C:0 T:5 67061 XUs and 36525 XVs -> 7406 XUVs
C:0 T:6 32384 XUs and 44656 XVs -> 3171 XUVs
C:0 T:7 12189 XUs and 16469 XVs -> 73 XUVs
C:0 T:8 7885 XUs and 9403 XVs -> 163 XUVs
C:0 T:9 66987 XUs and 146355 XVs -> 18913 XUVs
C:0 T:10 25775 XUs and 13479 XVs -> 3807 XUVs
C:0 T:11 46 XUs and 26 XVs -> 4 XUVs
47511 XUVs total
10767 collection wire objects
44477 potential space points
Neighbour search...
7113695 tests to find 3260504 neighbours
Iterating with no regularization...
Begin: 7.60934e+07
0 6.48849e+07
1 6.43894e+07
2 6.43148e+07
3 6.42888e+07
Now with regularization...
Begin: 5.55596e+07
0 5.55042e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410648329
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410648329
fLifetime: 30000 [us]
21-Nov-2025 14:30:27 UTC Closed output file "reco_stage1.root"
21-Nov-2025 14:30:27 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 289.208 428.145 684.756 381.333 125.784 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00119143 0.00434067 0.00704226 0.00426965 0.00188182 10
reco:ophit:OpHitFinder 0.285917 0.350115 0.436132 0.339487 0.0415826 10
reco:opflash:OpFlashFinder 0.128969 0.183743 0.25173 0.183563 0.0360621 10
reco:opslicer:OpSlicer 0.591484 0.792436 1.01255 0.782548 0.131937 10
reco:caldata:DataPrepModule 6.54723 6.84784 7.34462 6.84514 0.250148 10
reco:wclsdatasp:WireCellToolkit 39.052 41.2644 43.8825 40.5167 1.68362 10
reco:gaushit:GausHitFinder 1.00357 1.52803 2.43622 1.36002 0.433244 10
reco:nhitsfilter:NumberOfHitsFilter 0.000453869 0.000903102 0.00178276 0.000810439 0.000356041 10
reco:reco3d:SpacePointSolver 9.90077 20.8406 31.1916 20.8642 7.04377 10
reco:hitpdune:DisambigFromSpacePoints 1.25295 2.1697 3.83279 1.98908 0.800764 10
reco:pandora:StandardPandora 19.0212 36.7188 84.6795 29.7088 18.8647 10
reco:pandoraWriter:StandardPandora 0.419601 0.603618 0.882375 0.562439 0.162634 10
reco:pandoraTrack:LArPandoraTrackCreation 2.41792 5.00706 9.11346 4.24125 2.33392 10
reco:pandoraShower:LArPandoraShowerCreation 2.21526 6.19492 14.7938 4.78589 4.31015 10
reco:pandoracalo:Calorimetry 1.39503 2.84733 5.27444 2.31558 1.34204 10
reco:pandoracalonosce:Calorimetry 1.20701 2.59218 5.30657 2.10888 1.27244 10
reco:pandorapid:Chi2ParticleID 0.00588113 0.00694478 0.0092736 0.00680395 0.000966034 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0559229 0.0729528 0.101222 0.0720011 0.0137843 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00521455 0.00651154 0.00889643 0.00612066 0.00105198 10
reco:pandoraShowercalo:ShowerCalorimetry 2.18699 5.7845 14.4984 5.14363 3.65038 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.13106 5.85302 13.7309 4.60233 3.88662 10
reco:emtrkmichelid:EmTrackMichelId 159.129 230.527 336.695 213.002 54.2555 10
reco:crttag:SingleCRTMatchingProducer 0.0163897 0.023191 0.0351455 0.0230123 0.00498536 10
reco:crtreco:TwoCRTMatchingProducer 0.00762503 0.0118232 0.0194771 0.0107274 0.00375086 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.750261 1.1003 1.63136 0.980684 0.296608 10
reco:pandora2Track:LArPandoraTrackCreation 7.25848 17.8141 38.6729 12.8781 10.4746 10
reco:pandora2calo:Calorimetry 3.61736 8.38962 17.7795 6.4917 4.60125 10
reco:pandora2calonosce:Calorimetry 3.24856 7.92779 15.4574 6.18587 4.15299 10
reco:pandora2pid:Chi2ParticleID 0.0119391 0.0163044 0.0242817 0.0156852 0.00369014 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0681439 0.0907596 0.119457 0.0899035 0.0164136 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0120086 0.0161194 0.0241411 0.0152435 0.00345582 10
reco:pandora2Shower:LArPandoraShowerCreation 2.71916 6.09016 11.6692 4.53323 3.0861 10
reco:pandora2Showercalo:ShowerCalorimetry 2.96944 6.83934 12.3985 5.43439 3.31443 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.61421 6.11296 11.6522 5.11202 2.91393 10
[art]:TriggerResults:TriggerResultInserter 6.9612e-05 8.73605e-05 0.00015834 7.9145e-05 2.51473e-05 10
end_path:out1:RootOutput 1.2143e-05 1.71966e-05 2.2032e-05 1.74685e-05 2.52886e-06 10
end_path:out1:RootOutput(write) 2.47782 3.34736 4.6413 3.19088 0.693154 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4915.27 MB
Peak resident set size usage (VmHWM): 4112.18 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.33 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.30 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9991296
-rw-r--r-- 1 dunegli fnalgrid 2341331138 Nov 21 13:17 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2222115825 Nov 21 13:14 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2031868623 Nov 21 14:30 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1818262757 Nov 21 11:02 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1741649470 Nov 21 10:47 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 75244970 Nov 21 14:26 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242870 Nov 21 14:30 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 21 14:30 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 21 14:30 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 21 14:30 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 13:17 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 11:02 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 14:30 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 21 10:41 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 21 14:30 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 13:22 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 13:17 debugprod.log
