Jobsub ID 299265.1@dunegpschedd01.fnal.gov
| Jobsub ID | 299265.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12246 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-22 14:31:06 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-22 21:20:07 |
| From worker node | Hostname | gpu05.pic.es |
| cpuinfo | Intel(R) Xeon(R) Gold 6230R CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-22 14:32:06 |
| Input files | monte-carlo-012246-000001
|
| Jobscript | Exit code | 0 |
| Real time | 6h (22396s) |
| CPU time | 6h (21658s = 96%) |
| Max RSS bytes | 4335415296 (4134 MiB) |
| Outputting started | 2026-01-22 20:45:23 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12246/1/001/reco_stage1.root
|
| Finished | 2026-01-22 21:20:07 |
| Saved logs | justin-logs:299265.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ol adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 160744 traces, 0 summary
Retagger: tagging trace set: gauss with 119728 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 119728 traces tagged "gauss"
FrameSaver: q=4.16522e+06 n=2108458 tag=gauss
wclsFrameSaver: saving 160744 traces tagged "wiener"
FrameSaver: q=4.41333e+06 n=1854762 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 43898 XUs and 43579 XVs -> 557 XUVs
C:0 T:1 95082 XUs and 91135 XVs -> 6373 XUVs
C:0 T:2 71268 XUs and 138215 XVs -> 5247 XUVs
C:0 T:3 33296 XUs and 52932 XVs -> 332 XUVs
C:0 T:4 8752 XUs and 12468 XVs -> 200 XUVs
C:0 T:5 36421 XUs and 58380 XVs -> 7825 XUVs
C:0 T:6 155274 XUs and 157912 XVs -> 11072 XUVs
C:0 T:7 56544 XUs and 58704 XVs -> 613 XUVs
C:0 T:8 11068 XUs and 11346 XVs -> 150 XUVs
C:0 T:9 74324 XUs and 97073 XVs -> 10455 XUVs
C:0 T:10 136489 XUs and 40435 XVs -> 7142 XUVs
C:0 T:11 13 XUs and 14 XVs -> 0 XUVs
49966 XUVs total
14561 collection wire objects
45988 potential space points
Neighbour search...
5407078 tests to find 2510534 neighbours
Iterating with no regularization...
Begin: 1.02242e+08
0 7.39373e+07
1 7.25542e+07
2 7.23763e+07
3 7.2327e+07
Now with regularization...
Begin: 6.03996e+07
0 6.03277e+07
1 6.02924e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411898846
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411898846
fLifetime: 30000 [us]
22-Jan-2026 21:45:20 CET Closed output file "reco_stage1.root"
22-Jan-2026 21:45:20 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 691.048 975.339 1200.86 970.959 160.637 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00187486 0.00602998 0.00855855 0.00597818 0.00207817 10
reco:ophit:OpHitFinder 0.396492 0.53567 0.675058 0.507703 0.0888686 10
reco:opflash:OpFlashFinder 0.279747 0.379541 0.54095 0.359736 0.0793926 10
reco:opslicer:OpSlicer 1.01931 1.35447 1.87179 1.30386 0.29081 10
reco:caldata:DataPrepModule 7.42959 10.4669 12.0006 11.3175 1.73583 10
reco:wclsdatasp:WireCellToolkit 70.0055 76.9046 89.861 76.6004 6.08232 10
reco:gaushit:GausHitFinder 2.16199 2.74613 3.52615 2.72039 0.470759 10
reco:nhitsfilter:NumberOfHitsFilter 0.00068594 0.0013007 0.00222584 0.00113297 0.000433039 10
reco:reco3d:SpacePointSolver 14.9669 27.6368 42.1303 27.9605 8.22025 10
reco:hitpdune:DisambigFromSpacePoints 2.10015 4.94948 8.21777 4.65582 1.8337 10
reco:pandora:StandardPandora 42.3412 81.4461 110.509 85.0197 18.1367 10
reco:pandoraWriter:StandardPandora 0.533688 0.828357 1.13283 0.826409 0.190695 10
reco:pandoraTrack:LArPandoraTrackCreation 11.3425 20.417 29.2685 20.5916 5.36223 10
reco:pandoraShower:LArPandoraShowerCreation 9.98086 23.8493 36.9034 25.467 7.32231 10
reco:pandoracalo:Calorimetry 5.0123 9.81895 15.0806 9.36886 2.96692 10
reco:pandoracalonosce:Calorimetry 4.56455 9.65734 13.2943 10.1764 2.66644 10
reco:pandorapid:Chi2ParticleID 0.00726507 0.0117162 0.0160385 0.0118269 0.00310889 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0696956 0.119573 0.182457 0.117114 0.0328922 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00769968 0.0114238 0.0150754 0.0115023 0.00271731 10
reco:pandoraShowercalo:ShowerCalorimetry 10.0827 22.7868 29.563 24.5534 6.45057 10
reco:pandoraShowercalonosce:ShowerCalorimetry 9.7948 21.8718 30.7677 23.3378 6.25189 10
reco:emtrkmichelid:EmTrackMichelId 350.128 441.372 562.622 438.459 62.0099 10
reco:crttag:SingleCRTMatchingProducer 0.031621 0.0549029 0.0722451 0.0546681 0.0125775 10
reco:crtreco:TwoCRTMatchingProducer 0.0251152 0.0495129 0.0695105 0.0510452 0.0142816 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.79688 2.5504 3.71189 2.56981 0.541893 10
reco:pandora2Track:LArPandoraTrackCreation 33.7731 75.4108 117.633 71.0357 26.2084 10
reco:pandora2calo:Calorimetry 18.6779 33.4097 51.0421 33.1693 10.9189 10
reco:pandora2calonosce:Calorimetry 19.0703 31.0673 47.0579 27.4436 9.9918 10
reco:pandora2pid:Chi2ParticleID 0.0182166 0.0292296 0.0405202 0.0294871 0.00638336 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.117441 0.157511 0.209235 0.148488 0.030111 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.018423 0.0293299 0.0405429 0.0291197 0.00667758 10
reco:pandora2Shower:LArPandoraShowerCreation 12.5173 22.4394 31.8832 21.2209 6.20431 10
reco:pandora2Showercalo:ShowerCalorimetry 12.5847 25.0233 38.6861 24.6872 8.54399 10
reco:pandora2Showercalonosce:ShowerCalorimetry 11.8064 22.247 31.9957 24.2642 6.45972 10
[art]:TriggerResults:TriggerResultInserter 4.2184e-05 7.02611e-05 0.000149951 6.6597e-05 2.90084e-05 10
end_path:out1:RootOutput 5.429e-06 8.2624e-06 1.3255e-05 7.604e-06 2.12162e-06 10
end_path:out1:RootOutput(write) 4.19619 5.41552 6.31018 5.29519 0.70985 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5160.4 MB
Peak resident set size usage (VmHWM): 4335.42 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.40 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 6.72 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.37 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11127252
-rw-r--r-- 1 dune001 dune 2572460371 Jan 22 18:59 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2440282471 Jan 22 18:54 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2293919777 Jan 22 21:45 reco_stage1.root
-rw-r--r-- 1 dune001 dune 2046148172 Jan 22 16:15 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1957297386 Jan 22 15:47 g4_stage1.root
-rw-r--r-- 1 dune001 dune 83560200 Jan 22 21:30 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242796 Jan 22 21:45 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 22 21:45 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 22 21:45 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 22 21:45 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 22 18:59 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 22 16:15 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 22 21:45 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 22 15:32 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 22 21:45 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 22 19:12 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 22 18:59 debugprod.log
