Jobsub ID 236766.0@dunegpschedd02.fnal.gov
| Jobsub ID | 236766.0@dunegpschedd02.fnal.gov |
| Workflow ID | 9561 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-03 17:01:06 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-03 21:31:54 |
| From worker node | Hostname | dunegli-7472846-0-fnpc17119.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-03 17:05:35 |
| Input files | monte-carlo-009561-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15961s) |
| CPU time | 4h (14738s = 92%) |
| Max RSS bytes | 4525985792 (4316 MiB) |
| Outputting started | 2025-11-03 21:31:36 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09561/1/001/reco_stage1.root
|
| Finished | 2025-11-03 21:31:54 |
| Saved logs | justin-logs:236766.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
aleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 136420 traces, 0 summary
Retagger: tagging trace set: gauss with 100535 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 100535 traces tagged "gauss"
FrameSaver: q=3.46987e+06 n=1743028 tag=gauss
wclsFrameSaver: saving 136420 traces tagged "wiener"
FrameSaver: q=3.70074e+06 n=1532142 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 36622 XUs and 38290 XVs -> 407 XUVs
C:0 T:1 86211 XUs and 80318 XVs -> 6533 XUVs
C:0 T:2 49612 XUs and 76604 XVs -> 5272 XUVs
C:0 T:3 25066 XUs and 26380 XVs -> 106 XUVs
C:0 T:4 11335 XUs and 9571 XVs -> 102 XUVs
C:0 T:5 82993 XUs and 42788 XVs -> 11584 XUVs
C:0 T:6 132088 XUs and 164323 XVs -> 11429 XUVs
C:0 T:7 46513 XUs and 45025 XVs -> 614 XUVs
C:0 T:8 8656 XUs and 9708 XVs -> 270 XUVs
C:0 T:9 76072 XUs and 97478 XVs -> 14601 XUVs
C:0 T:10 36919 XUs and 33474 XVs -> 5209 XUVs
C:0 T:11 502 XUs and 328 XVs -> 78 XUVs
56205 XUVs total
12810 collection wire objects
51829 potential space points
Neighbour search...
8820929 tests to find 4029640 neighbours
Iterating with no regularization...
Begin: 6.24136e+07
0 5.33341e+07
1 5.25791e+07
2 5.24516e+07
3 5.24107e+07
Now with regularization...
Begin: 4.28345e+07
0 4.27677e+07
1 4.27102e+07
2 4.26677e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410291542
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410291542
fLifetime: 30000 [us]
03-Nov-2025 21:31:34 UTC Closed output file "reco_stage1.root"
03-Nov-2025 21:31:34 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 356.478 516.051 821.554 504.214 116.878 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000878022 0.00392533 0.00792975 0.00385697 0.0019081 10
reco:ophit:OpHitFinder 0.300293 0.331458 0.394404 0.32257 0.0300286 10
reco:opflash:OpFlashFinder 0.231013 0.302207 0.376925 0.282488 0.0465689 10
reco:opslicer:OpSlicer 0.644874 0.782971 1.09628 0.769964 0.12175 10
reco:caldata:DataPrepModule 5.4712 5.80234 6.5913 5.74926 0.291864 10
reco:wclsdatasp:WireCellToolkit 47.1583 49.6026 53.2912 49.4309 1.75888 10
reco:gaushit:GausHitFinder 1.32606 1.68161 2.24901 1.65893 0.238144 10
reco:nhitsfilter:NumberOfHitsFilter 0.000708118 0.000858274 0.00108064 0.000847973 0.000120872 10
reco:reco3d:SpacePointSolver 11.4823 19.7006 28.8776 19.4538 5.09417 10
reco:hitpdune:DisambigFromSpacePoints 1.82636 2.84573 4.37994 2.80543 0.654488 10
reco:pandora:StandardPandora 29.932 56.4472 84.17 55.3222 17.1226 10
reco:pandoraWriter:StandardPandora 0.456952 0.608126 0.817745 0.595901 0.0872996 10
reco:pandoraTrack:LArPandoraTrackCreation 5.95979 11.8382 21.1109 11.1917 3.60559 10
reco:pandoraShower:LArPandoraShowerCreation 4.20497 11.9675 30.059 11.2055 6.68392 10
reco:pandoracalo:Calorimetry 2.60049 4.88982 9.51492 4.6218 1.72034 10
reco:pandoracalonosce:Calorimetry 2.4453 4.44991 8.09168 4.33121 1.37037 10
reco:pandorapid:Chi2ParticleID 0.00530593 0.00716878 0.0110901 0.00681466 0.00156029 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.063277 0.0795192 0.128755 0.0750602 0.0174516 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00547231 0.00698155 0.00997977 0.00677471 0.00116971 10
reco:pandoraShowercalo:ShowerCalorimetry 4.45572 10.5651 21.0948 10.3676 4.18918 10
reco:pandoraShowercalonosce:ShowerCalorimetry 5.72349 10.4426 21.9375 9.89177 4.25029 10
reco:emtrkmichelid:EmTrackMichelId 175.459 224.694 341.741 215.093 42.8623 10
reco:crttag:SingleCRTMatchingProducer 0.0263491 0.0345448 0.0642956 0.0316936 0.0103902 10
reco:crtreco:TwoCRTMatchingProducer 0.0155104 0.0246404 0.0539343 0.0211499 0.0106866 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.19233 1.51376 2.52081 1.4318 0.374745 10
reco:pandora2Track:LArPandoraTrackCreation 17.7114 37.7147 85.3212 35.4659 17.4408 10
reco:pandora2calo:Calorimetry 7.65168 13.8035 24.6032 13.4944 4.39221 10
reco:pandora2calonosce:Calorimetry 7.14131 12.9732 23.2648 12.6081 4.16513 10
reco:pandora2pid:Chi2ParticleID 0.0112394 0.0170212 0.0258618 0.0168356 0.0036759 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0727979 0.0984439 0.13966 0.0996139 0.0175902 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0110847 0.0168129 0.0241824 0.0166378 0.00333575 10
reco:pandora2Shower:LArPandoraShowerCreation 4.72525 9.21456 16.3807 8.93855 2.92962 10
reco:pandora2Showercalo:ShowerCalorimetry 6.39037 10.4274 16.8927 10.662 2.70299 10
reco:pandora2Showercalonosce:ShowerCalorimetry 6.22716 9.49071 15.7169 9.15515 2.51161 10
[art]:TriggerResults:TriggerResultInserter 5.3316e-05 6.98584e-05 0.000143677 6.11835e-05 2.54812e-05 10
end_path:out1:RootOutput 7.067e-06 1.00729e-05 1.5628e-05 9.266e-06 2.90955e-06 10
end_path:out1:RootOutput(write) 2.89868 3.48341 4.81878 3.30196 0.525815 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5335.22 MB
Peak resident set size usage (VmHWM): 4525.99 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.59 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11583000
-rw-r--r-- 1 dunegli fnalgrid 2675756864 Nov 3 20:03 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2531599584 Nov 3 20:01 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2427456839 Nov 3 21:31 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2115615494 Nov 3 17:42 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2019459043 Nov 3 17:24 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 90476560 Nov 3 21:26 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242909 Nov 3 21:31 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 3 21:31 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 3 21:31 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 3 21:31 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 20:03 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 17:42 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 21:31 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 3 17:05 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 3 21:31 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 20:10 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 20:03 debugprod.log
