Jobsub ID 273250.0@dunegpschedd02.fnal.gov
| Jobsub ID | 273250.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11956 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-15 10:55:47 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-15 13:23:40 |
| From worker node | Hostname | dunegli-8324241-0-fnpc23037.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-15 10:56:53 |
| Input files | monte-carlo-011956-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8792s) |
| CPU time | 2h (8629s = 98%) |
| Max RSS bytes | 4531965952 (4322 MiB) |
| Outputting started | 2026-01-15 13:23:25 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11956/1/001/reco_stage1.root
|
| Finished | 2026-01-15 13:23:40 |
| Saved logs | justin-logs:273250.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
g tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 142420 traces, 0 summary
Retagger: tagging trace set: gauss with 106768 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 106768 traces tagged "gauss"
FrameSaver: q=3.75509e+06 n=1898540 tag=gauss
wclsFrameSaver: saving 142420 traces tagged "wiener"
FrameSaver: q=3.98178e+06 n=1676636 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 33411 XUs and 33425 XVs -> 912 XUVs
C:0 T:1 118615 XUs and 83777 XVs -> 14993 XUVs
C:0 T:2 80800 XUs and 70016 XVs -> 6497 XUVs
C:0 T:3 33225 XUs and 26196 XVs -> 246 XUVs
C:0 T:4 20439 XUs and 21846 XVs -> 287 XUVs
C:0 T:5 147459 XUs and 104319 XVs -> 19613 XUVs
C:0 T:6 116692 XUs and 114062 XVs -> 5318 XUVs
C:0 T:7 46111 XUs and 45283 XVs -> 424 XUVs
C:0 T:8 8525 XUs and 7600 XVs -> 123 XUVs
C:0 T:9 95361 XUs and 79109 XVs -> 12919 XUVs
C:0 T:10 20590 XUs and 13568 XVs -> 1906 XUVs
C:0 T:11 82 XUs and 55 XVs -> 10 XUVs
63248 XUVs total
12680 collection wire objects
57832 potential space points
Neighbour search...
10958818 tests to find 4875300 neighbours
Iterating with no regularization...
Begin: 7.56051e+07
0 6.26904e+07
1 6.18103e+07
2 6.16716e+07
3 6.16261e+07
Now with regularization...
Begin: 5.11528e+07
0 5.10726e+07
1 5.10229e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411755013
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411755013
fLifetime: 30000 [us]
15-Jan-2026 13:23:24 UTC Closed output file "reco_stage1.root"
15-Jan-2026 13:23:24 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 201.162 262.621 333.576 251.776 34.4023 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000678352 0.00321395 0.00641838 0.00321934 0.0016465 10
reco:ophit:OpHitFinder 0.214884 0.253813 0.276932 0.25771 0.0213212 10
reco:opflash:OpFlashFinder 0.162821 0.193365 0.246645 0.183279 0.0271708 10
reco:opslicer:OpSlicer 0.449904 0.562795 0.633083 0.582619 0.0580191 10
reco:caldata:DataPrepModule 3.6711 3.81247 4.26469 3.74847 0.169568 10
reco:wclsdatasp:WireCellToolkit 23.2952 24.4579 25.2777 24.5801 0.649981 10
reco:gaushit:GausHitFinder 0.662617 0.921681 1.10954 0.924685 0.118542 10
reco:nhitsfilter:NumberOfHitsFilter 0.000335123 0.000418538 0.000572659 0.00040335 7.09077e-05 10
reco:reco3d:SpacePointSolver 8.95671 12.0095 16.4265 11.6497 2.34576 10
reco:hitpdune:DisambigFromSpacePoints 1.00071 1.42959 1.94115 1.30563 0.310144 10
reco:pandora:StandardPandora 13.9988 28.5827 46.3959 26.6718 8.44579 10
reco:pandoraWriter:StandardPandora 0.255826 0.339892 0.538831 0.321956 0.077203 10
reco:pandoraTrack:LArPandoraTrackCreation 2.09725 2.81322 3.50923 2.69371 0.428883 10
reco:pandoraShower:LArPandoraShowerCreation 1.86635 3.12467 4.5003 2.98582 0.77153 10
reco:pandoracalo:Calorimetry 1.31103 1.68792 2.13404 1.57888 0.251726 10
reco:pandoracalonosce:Calorimetry 1.21108 1.61094 2.20104 1.46524 0.301579 10
reco:pandorapid:Chi2ParticleID 0.00344086 0.00419786 0.00542792 0.0040975 0.000537763 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0327586 0.0371131 0.0442287 0.0360696 0.00331157 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00325115 0.0038623 0.00428838 0.003842 0.00030519 10
reco:pandoraShowercalo:ShowerCalorimetry 2.18576 3.63833 5.18621 3.40533 0.941528 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.14083 3.50394 5.00099 3.32988 0.84347 10
reco:emtrkmichelid:EmTrackMichelId 111.305 140.092 171.282 134.689 15.4848 10
reco:crttag:SingleCRTMatchingProducer 0.00738956 0.0107773 0.0150113 0.0101797 0.00228673 10
reco:crtreco:TwoCRTMatchingProducer 0.00491569 0.00587692 0.00671763 0.00589576 0.000470076 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.549696 0.692668 0.910626 0.682825 0.103321 10
reco:pandora2Track:LArPandoraTrackCreation 5.78231 9.14828 12.5348 8.67052 2.01444 10
reco:pandora2calo:Calorimetry 3.25455 5.00915 6.70495 4.87853 1.00792 10
reco:pandora2calonosce:Calorimetry 3.09429 4.75452 6.31841 4.61496 0.941089 10
reco:pandora2pid:Chi2ParticleID 0.00734696 0.00988075 0.0118326 0.00967182 0.00131763 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0394569 0.0471303 0.0586939 0.0454438 0.0055389 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00723771 0.00953631 0.0118984 0.00906015 0.00142548 10
reco:pandora2Shower:LArPandoraShowerCreation 2.2195 3.25989 4.26435 3.1853 0.615246 10
reco:pandora2Showercalo:ShowerCalorimetry 2.89573 4.29654 5.42788 4.2698 0.790104 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.80684 3.95844 5.06238 3.90664 0.703974 10
[art]:TriggerResults:TriggerResultInserter 3.7502e-05 4.93558e-05 0.000107807 4.2221e-05 1.9887e-05 10
end_path:out1:RootOutput 9.088e-06 1.06224e-05 1.59e-05 1.001e-05 1.94082e-06 10
end_path:out1:RootOutput(write) 1.86466 2.26415 2.75762 2.18083 0.254648 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5348.1 MB
Peak resident set size usage (VmHWM): 4531.97 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.39 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11589472
-rw-r--r-- 1 dunegli fnalgrid 2671491713 Jan 15 12:38 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2531058476 Jan 15 12:36 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2399846862 Jan 15 13:23 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2141605604 Jan 15 11:11 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2037538503 Jan 15 11:00 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 85399840 Jan 15 13:20 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242987 Jan 15 13:23 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 15 13:23 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 15 13:23 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 15 13:23 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 15 12:38 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 15 11:11 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 15 13:23 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 15 10:56 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 15 13:23 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 15 12:42 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 15 12:38 debugprod.log
