Jobsub ID 273252.0@dunegpschedd02.fnal.gov
| Jobsub ID | 273252.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11961 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-15 10:55:47 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-15 13:57:01 |
| From worker node | Hostname | tdm003.pic.es |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-15 10:56:29 |
| Input files | monte-carlo-011961-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (10794s) |
| CPU time | 2h (10320s = 95%) |
| Max RSS bytes | 4369186816 (4166 MiB) |
| Outputting started | 2026-01-15 13:56:23 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11961/1/001/reco_stage1.root
|
| Finished | 2026-01-15 13:57:01 |
| Saved logs | justin-logs:273252.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
g tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 123149 traces, 0 summary
Retagger: tagging trace set: gauss with 95609 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95609 traces tagged "gauss"
FrameSaver: q=3.27214e+06 n=1703133 tag=gauss
wclsFrameSaver: saving 123149 traces tagged "wiener"
FrameSaver: q=3.43409e+06 n=1509358 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 21335 XUs and 14890 XVs -> 238 XUVs
C:0 T:1 44770 XUs and 30811 XVs -> 8642 XUVs
C:0 T:2 46677 XUs and 59972 XVs -> 2516 XUVs
C:0 T:3 21442 XUs and 27667 XVs -> 118 XUVs
C:0 T:4 12198 XUs and 10812 XVs -> 121 XUVs
C:0 T:5 44447 XUs and 35899 XVs -> 4935 XUVs
C:0 T:6 170408 XUs and 154010 XVs -> 5867 XUVs
C:0 T:7 68848 XUs and 58210 XVs -> 658 XUVs
C:0 T:8 5768 XUs and 5530 XVs -> 23 XUVs
C:0 T:9 35008 XUs and 52403 XVs -> 2856 XUVs
C:0 T:10 63825 XUs and 32450 XVs -> 4175 XUVs
C:0 T:11 217 XUs and 142 XVs -> 24 XUVs
30173 XUVs total
10591 collection wire objects
27948 potential space points
Neighbour search...
2859706 tests to find 1344474 neighbours
Iterating with no regularization...
Begin: 6.69367e+07
0 5.97799e+07
1 5.92461e+07
2 5.91699e+07
3 5.91463e+07
Now with regularization...
Begin: 5.04828e+07
0 5.04643e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411754958
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411754958
fLifetime: 30000 [us]
15-Jan-2026 14:56:21 CET Closed output file "reco_stage1.root"
15-Jan-2026 14:56:21 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 336.699 397.229 592.196 375.931 73.7705 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000778823 0.00377402 0.00622831 0.00405613 0.00171043 10
reco:ophit:OpHitFinder 0.297059 0.329236 0.3878 0.317261 0.0271012 10
reco:opflash:OpFlashFinder 0.180884 0.226036 0.302949 0.2177 0.0318857 10
reco:opslicer:OpSlicer 0.715444 0.8027 0.930233 0.767238 0.0832784 10
reco:caldata:DataPrepModule 4.89709 5.17958 5.42679 5.23427 0.172714 10
reco:wclsdatasp:WireCellToolkit 33.4539 36.7134 40.2953 36.4147 2.44589 10
reco:gaushit:GausHitFinder 1.12568 1.32651 1.84176 1.23331 0.216755 10
reco:nhitsfilter:NumberOfHitsFilter 0.000520939 0.000635893 0.000770653 0.000607551 8.53212e-05 10
reco:reco3d:SpacePointSolver 8.09979 15.582 23.2256 15.9966 4.09211 10
reco:hitpdune:DisambigFromSpacePoints 1.24806 1.69297 2.8071 1.5803 0.44835 10
reco:pandora:StandardPandora 23.4941 35.8745 63.8962 34.6546 10.6885 10
reco:pandoraWriter:StandardPandora 0.386875 0.468243 0.656489 0.4432 0.0749857 10
reco:pandoraTrack:LArPandoraTrackCreation 3.23075 4.2051 6.55057 3.96723 0.932186 10
reco:pandoraShower:LArPandoraShowerCreation 3.03181 4.71216 10.5885 4.05259 2.12174 10
reco:pandoracalo:Calorimetry 1.74215 2.15762 3.17262 2.02382 0.414728 10
reco:pandoracalonosce:Calorimetry 1.58856 1.95383 2.89447 1.83304 0.386449 10
reco:pandorapid:Chi2ParticleID 0.00521815 0.00605337 0.00732503 0.00603841 0.000625035 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0477546 0.0563654 0.078334 0.0535399 0.00803354 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00517315 0.0057955 0.0066756 0.00582021 0.000457986 10
reco:pandoraShowercalo:ShowerCalorimetry 3.04354 4.46372 9.22176 3.96504 1.75792 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.94977 4.44996 9.57217 3.85104 1.87854 10
reco:emtrkmichelid:EmTrackMichelId 196.486 229.267 322.639 217.328 36.2057 10
reco:crttag:SingleCRTMatchingProducer 0.010064 0.0130755 0.020553 0.0121501 0.0031395 10
reco:crtreco:TwoCRTMatchingProducer 0.00794965 0.00928069 0.0133401 0.00882792 0.00154154 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.822454 0.94412 1.19199 0.918538 0.101625 10
reco:pandora2Track:LArPandoraTrackCreation 10.1027 14.8402 28.9268 12.7756 5.52455 10
reco:pandora2calo:Calorimetry 4.5951 6.38883 11.8636 5.79935 2.03351 10
reco:pandora2calonosce:Calorimetry 4.37959 6.10434 11.4123 5.50403 1.97777 10
reco:pandora2pid:Chi2ParticleID 0.0132112 0.0152562 0.0210302 0.0146417 0.00221194 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0605749 0.0709531 0.100812 0.067189 0.0111567 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0130808 0.0149678 0.0202978 0.0145035 0.00211857 10
reco:pandora2Shower:LArPandoraShowerCreation 3.79507 5.36164 10.6114 4.64565 1.92258 10
reco:pandora2Showercalo:ShowerCalorimetry 4.06915 5.4997 9.81008 4.99651 1.6162 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.79866 5.00834 8.92979 4.55482 1.45988 10
[art]:TriggerResults:TriggerResultInserter 3.808e-05 5.25977e-05 0.000130172 4.3871e-05 2.60843e-05 10
end_path:out1:RootOutput 8.7e-06 1.01341e-05 1.449e-05 9.75e-06 1.61588e-06 10
end_path:out1:RootOutput(write) 2.87704 3.35746 4.83703 3.11142 0.557743 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5202.13 MB
Peak resident set size usage (VmHWM): 4369.19 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10665892
-rw-r--r-- 1 dune001 dune 2486457242 Jan 15 13:48 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2353934679 Jan 15 13:45 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2199973056 Jan 15 14:56 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1935672956 Jan 15 12:15 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1864198550 Jan 15 12:03 g4_stage1.root
-rw-r--r-- 1 dune001 dune 80998410 Jan 15 14:52 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242959 Jan 15 14:56 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 15 14:56 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 15 14:56 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 15 14:56 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 15 13:48 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 15 12:15 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 15 14:56 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 15 11:56 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 15 14:56 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 15 13:53 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 15 13:48 debugprod.log
