Jobsub ID 271305.1@dunegpschedd01.fnal.gov
| Jobsub ID | 271305.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11472 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-02 09:24:17 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-02 11:39:26 |
| From worker node | Hostname | dunegli-8063537-0-fnpc23014.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-02 09:50:32 |
| Input files | monte-carlo-011472-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6521s) |
| CPU time | 1h (6455s = 98%) |
| Max RSS bytes | 4248002560 (4051 MiB) |
| Outputting started | 2026-01-02 11:39:14 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11472/1/001/reco_stage1.root
|
| Finished | 2026-01-02 11:39:26 |
| Saved logs | justin-logs:271305.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 124116 traces, 0 summary
Retagger: tagging trace set: gauss with 94470 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 94470 traces tagged "gauss"
FrameSaver: q=3.26618e+06 n=1651673 tag=gauss
wclsFrameSaver: saving 124116 traces tagged "wiener"
FrameSaver: q=3.46208e+06 n=1455682 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 21120 XUs and 12242 XVs -> 184 XUVs
C:0 T:1 43130 XUs and 28861 XVs -> 4057 XUVs
C:0 T:2 115555 XUs and 147610 XVs -> 6330 XUVs
C:0 T:3 54698 XUs and 60319 XVs -> 405 XUVs
C:0 T:4 9704 XUs and 8778 XVs -> 136 XUVs
C:0 T:5 46995 XUs and 29176 XVs -> 6812 XUVs
C:0 T:6 124074 XUs and 110495 XVs -> 5074 XUVs
C:0 T:7 42647 XUs and 39833 XVs -> 348 XUVs
C:0 T:8 13982 XUs and 12858 XVs -> 472 XUVs
C:0 T:9 82600 XUs and 103341 XVs -> 10151 XUVs
C:0 T:10 35483 XUs and 10097 XVs -> 2221 XUVs
C:0 T:11 269 XUs and 169 XVs -> 34 XUVs
36224 XUVs total
11163 collection wire objects
33598 potential space points
Neighbour search...
3481792 tests to find 1782358 neighbours
Iterating with no regularization...
Begin: 7.09633e+07
0 5.51048e+07
1 5.41925e+07
2 5.40523e+07
3 5.40082e+07
Now with regularization...
Begin: 4.49258e+07
0 4.48832e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411491965
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411491965
fLifetime: 30000 [us]
02-Jan-2026 11:39:14 UTC Closed output file "reco_stage1.root"
02-Jan-2026 11:39:14 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 138.225 183.755 231.82 187.465 29.6103 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000792229 0.0026567 0.00446636 0.00275642 0.00114979 10
reco:ophit:OpHitFinder 0.154898 0.194872 0.234859 0.19255 0.0238529 10
reco:opflash:OpFlashFinder 0.0814958 0.122136 0.159307 0.119963 0.0229389 10
reco:opslicer:OpSlicer 0.302893 0.417043 0.58986 0.412673 0.0731587 10
reco:caldata:DataPrepModule 3.34768 3.47964 3.70805 3.45698 0.0931237 10
reco:wclsdatasp:WireCellToolkit 22.389 23.3582 24.4249 23.1827 0.656084 10
reco:gaushit:GausHitFinder 0.490767 0.682296 0.928876 0.687637 0.128264 10
reco:nhitsfilter:NumberOfHitsFilter 0.000228979 0.000303084 0.00040715 0.000294168 5.03892e-05 10
reco:reco3d:SpacePointSolver 4.90504 7.81944 11.8677 7.81231 2.06068 10
reco:hitpdune:DisambigFromSpacePoints 0.525857 0.891661 1.33776 0.866107 0.250006 10
reco:pandora:StandardPandora 7.32388 14.4609 22.8664 15.0176 4.12028 10
reco:pandoraWriter:StandardPandora 0.173429 0.233897 0.285231 0.236324 0.036541 10
reco:pandoraTrack:LArPandoraTrackCreation 0.940436 1.73207 2.6407 1.7718 0.452964 10
reco:pandoraShower:LArPandoraShowerCreation 1.13668 1.89722 2.99262 1.93457 0.557665 10
reco:pandoracalo:Calorimetry 0.59351 1.06255 1.58932 1.10051 0.284572 10
reco:pandoracalonosce:Calorimetry 0.522292 0.972632 1.47405 1.00936 0.271071 10
reco:pandorapid:Chi2ParticleID 0.00215455 0.00317254 0.00472993 0.00304385 0.000667737 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0220371 0.0303887 0.0361418 0.0313565 0.00437139 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00203946 0.00289354 0.00360674 0.00286854 0.000404924 10
reco:pandoraShowercalo:ShowerCalorimetry 1.177 2.15 3.43087 2.22295 0.699301 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.13994 2.09244 3.32975 2.15372 0.686962 10
reco:emtrkmichelid:EmTrackMichelId 77.3798 100.867 123.621 102.635 14.6792 10
reco:crttag:SingleCRTMatchingProducer 0.00546122 0.00756933 0.00983867 0.00738813 0.00150469 10
reco:crtreco:TwoCRTMatchingProducer 0.00336776 0.0046558 0.00576513 0.00481654 0.000782956 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.37929 0.581245 0.815839 0.576061 0.117936 10
reco:pandora2Track:LArPandoraTrackCreation 3.54438 5.57519 8.40389 5.75687 1.53855 10
reco:pandora2calo:Calorimetry 1.83382 3.05733 4.60999 3.25993 0.918324 10
reco:pandora2calonosce:Calorimetry 1.72252 2.92198 4.3887 3.09215 0.908707 10
reco:pandora2pid:Chi2ParticleID 0.0057033 0.00719552 0.00923027 0.00744941 0.00107082 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0302318 0.0373358 0.0440583 0.0371848 0.00533006 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00561683 0.00707866 0.00919454 0.00736184 0.00109974 10
reco:pandora2Shower:LArPandoraShowerCreation 1.37548 2.10167 2.98555 2.11328 0.551659 10
reco:pandora2Showercalo:ShowerCalorimetry 1.62695 2.71124 4.01179 2.83377 0.809304 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.50849 2.5028 3.66256 2.60315 0.743905 10
[art]:TriggerResults:TriggerResultInserter 2.8976e-05 3.83156e-05 8.9191e-05 3.3033e-05 1.71554e-05 10
end_path:out1:RootOutput 4.188e-06 7.1576e-06 1.036e-05 7.374e-06 1.63102e-06 10
end_path:out1:RootOutput(write) 1.33508 1.71033 2.13996 1.712 0.266853 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5054.22 MB
Peak resident set size usage (VmHWM): 4248 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9793384
-rw-r--r-- 1 dunegli fnalgrid 2316587538 Jan 2 11:07 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2204148211 Jan 2 11:06 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1976249847 Jan 2 11:39 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1768379844 Jan 2 10:00 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1694537877 Jan 2 09:53 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 67902580 Jan 2 11:36 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242778 Jan 2 11:39 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 2 11:39 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 2 11:39 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 2 11:39 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 2 11:07 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 2 10:00 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 2 11:39 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 2 09:50 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 2 11:39 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 2 11:10 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 2 11:07 debugprod.log
