Jobsub ID 265518.1@dunegpschedd02.fnal.gov
| Jobsub ID | 265518.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11468 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-02 09:24:17 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-02 11:57:25 |
| From worker node | Hostname | dunegli-8219947-0-fnpc23031.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-02 09:50:53 |
| Input files | monte-carlo-011468-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7578s) |
| CPU time | 2h (7501s = 98%) |
| Max RSS bytes | 4276637696 (4078 MiB) |
| Outputting started | 2026-01-02 11:57:12 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11468/1/001/reco_stage1.root
|
| Finished | 2026-01-02 11:57:25 |
| Saved logs | justin-logs:265518.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
l adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 131763 traces, 0 summary
Retagger: tagging trace set: gauss with 97599 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 97599 traces tagged "gauss"
FrameSaver: q=3.49506e+06 n=1672951 tag=gauss
wclsFrameSaver: saving 131763 traces tagged "wiener"
FrameSaver: q=3.7409e+06 n=1467865 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 39529 XUs and 38995 XVs -> 377 XUVs
C:0 T:1 103057 XUs and 75150 XVs -> 6144 XUVs
C:0 T:2 38488 XUs and 41929 XVs -> 2994 XUVs
C:0 T:3 20839 XUs and 19990 XVs -> 90 XUVs
C:0 T:4 9222 XUs and 11601 XVs -> 52 XUVs
C:0 T:5 31994 XUs and 29557 XVs -> 2904 XUVs
C:0 T:6 169346 XUs and 177578 XVs -> 11719 XUVs
C:0 T:7 54137 XUs and 54357 XVs -> 674 XUVs
C:0 T:8 6966 XUs and 5975 XVs -> 87 XUVs
C:0 T:9 43825 XUs and 49220 XVs -> 3316 XUVs
C:0 T:10 42708 XUs and 47809 XVs -> 11684 XUVs
C:0 T:11 205 XUs and 128 XVs -> 15 XUVs
40056 XUVs total
11717 collection wire objects
36584 potential space points
Neighbour search...
4549006 tests to find 1941014 neighbours
Iterating with no regularization...
Begin: 8.79306e+07
0 6.6963e+07
1 6.52803e+07
2 6.49839e+07
3 6.48877e+07
4 6.48456e+07
Now with regularization...
Begin: 5.34739e+07
0 5.33879e+07
1 5.33517e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411492012
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411492012
fLifetime: 30000 [us]
02-Jan-2026 11:57:11 UTC Closed output file "reco_stage1.root"
02-Jan-2026 11:57:11 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 156.411 225.911 344.987 207.004 52.9351 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00059559 0.00285863 0.00657344 0.00269235 0.00157161 10
reco:ophit:OpHitFinder 0.166838 0.210241 0.235335 0.21873 0.0229954 10
reco:opflash:OpFlashFinder 0.0821938 0.14157 0.176249 0.153979 0.0312747 10
reco:opslicer:OpSlicer 0.379759 0.463105 0.561283 0.467711 0.0670893 10
reco:caldata:DataPrepModule 3.35708 3.46966 3.65669 3.44494 0.0965376 10
reco:wclsdatasp:WireCellToolkit 22.0416 23.1045 24.3482 23.1484 0.730917 10
reco:gaushit:GausHitFinder 0.584423 0.761545 1.088 0.729901 0.1416 10
reco:nhitsfilter:NumberOfHitsFilter 0.000271791 0.0003437 0.000464819 0.000331745 6.33532e-05 10
reco:reco3d:SpacePointSolver 7.48762 14.5706 29.7232 10.8326 6.99202 10
reco:hitpdune:DisambigFromSpacePoints 0.657946 1.10239 1.7648 0.989809 0.323952 10
reco:pandora:StandardPandora 11.1434 21.8702 53.4115 16.9625 11.6946 10
reco:pandoraWriter:StandardPandora 0.20261 0.286904 0.397754 0.268503 0.0583711 10
reco:pandoraTrack:LArPandoraTrackCreation 1.37987 2.43765 4.45517 2.35125 0.853848 10
reco:pandoraShower:LArPandoraShowerCreation 1.27095 2.73334 5.72913 2.41837 1.17824 10
reco:pandoracalo:Calorimetry 0.806276 1.4332 2.42211 1.40828 0.42975 10
reco:pandoracalonosce:Calorimetry 0.738296 1.3249 2.28175 1.30426 0.413837 10
reco:pandorapid:Chi2ParticleID 0.00255323 0.00356596 0.00476483 0.00355803 0.000672752 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0265888 0.0336098 0.0433091 0.0321573 0.00469204 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00235215 0.00328138 0.00492128 0.00325537 0.000645252 10
reco:pandoraShowercalo:ShowerCalorimetry 1.33353 3.07817 6.08865 2.90791 1.23248 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.2821 2.98082 5.97513 2.64361 1.22085 10
reco:emtrkmichelid:EmTrackMichelId 86.7561 116.684 158.211 111.041 20.3526 10
reco:crttag:SingleCRTMatchingProducer 0.00618533 0.00883827 0.0125719 0.00784817 0.00199202 10
reco:crtreco:TwoCRTMatchingProducer 0.00413573 0.00543343 0.00662927 0.0053429 0.000751511 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.484809 0.636647 0.951233 0.582669 0.134957 10
reco:pandora2Track:LArPandoraTrackCreation 3.85184 7.94029 15.4396 6.97664 3.16927 10
reco:pandora2calo:Calorimetry 2.01922 4.28189 7.81714 4.02806 1.54605 10
reco:pandora2calonosce:Calorimetry 1.92275 4.09496 7.49515 3.90452 1.46183 10
reco:pandora2pid:Chi2ParticleID 0.00595161 0.00840083 0.0128375 0.00799824 0.00186264 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0315291 0.0425027 0.0592266 0.0408899 0.00765514 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00579938 0.00820495 0.0128905 0.00767879 0.00192751 10
reco:pandora2Shower:LArPandoraShowerCreation 1.52124 2.92276 5.28973 2.77172 1.01701 10
reco:pandora2Showercalo:ShowerCalorimetry 1.78478 3.73632 6.73886 3.60366 1.30496 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.66407 3.45468 6.2054 3.31788 1.19143 10
[art]:TriggerResults:TriggerResultInserter 2.8725e-05 4.05677e-05 9.6775e-05 3.4581e-05 1.91451e-05 10
end_path:out1:RootOutput 6.492e-06 8.1274e-06 1.2474e-05 7.549e-06 1.54934e-06 10
end_path:out1:RootOutput(write) 1.4874 2.00464 2.74796 1.90296 0.374909 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5085.78 MB
Peak resident set size usage (VmHWM): 4276.64 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10435452
-rw-r--r-- 1 dunegli fnalgrid 2435793932 Jan 2 11:18 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2310870672 Jan 2 11:17 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2145891687 Jan 2 11:57 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1896197954 Jan 2 10:02 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1816688706 Jan 2 09:54 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 79840330 Jan 2 11:54 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242997 Jan 2 11:57 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 2 11:57 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 2 11:57 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 2 11:57 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 2 11:18 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 2 10:02 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 2 11:57 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 2 09:50 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 2 11:57 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 2 11:21 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 2 11:18 debugprod.log
