Jobsub ID 293865.0@dunegpschedd02.fnal.gov
| Jobsub ID | 293865.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12281 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-22 22:09:30 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-23 04:08:37 |
| From worker node | Hostname | gpu05.pic.es |
| cpuinfo | Intel(R) Xeon(R) Gold 6230R CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-22 22:10:30 |
| Input files | monte-carlo-012281-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (21422s) |
| CPU time | 5h (20846s = 97%) |
| Max RSS bytes | 4321722368 (4121 MiB) |
| Outputting started | 2026-01-23 04:07:33 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12281/1/001/reco_stage1.root
|
| Finished | 2026-01-23 04:08:37 |
| Saved logs | justin-logs:293865.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
epare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 118584 traces, 0 summary
Retagger: tagging trace set: gauss with 90778 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 90778 traces tagged "gauss"
FrameSaver: q=3.30983e+06 n=1642960 tag=gauss
wclsFrameSaver: saving 118584 traces tagged "wiener"
FrameSaver: q=3.4993e+06 n=1466091 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 20348 XUs and 24418 XVs -> 94 XUVs
C:0 T:1 35228 XUs and 40952 XVs -> 3258 XUVs
C:0 T:2 74642 XUs and 88787 XVs -> 11257 XUVs
C:0 T:3 36976 XUs and 29101 XVs -> 441 XUVs
C:0 T:4 7102 XUs and 7755 XVs -> 62 XUVs
C:0 T:5 18709 XUs and 16858 XVs -> 1974 XUVs
C:0 T:6 146828 XUs and 158953 XVs -> 8158 XUVs
C:0 T:7 55237 XUs and 57728 XVs -> 665 XUVs
C:0 T:8 10462 XUs and 7400 XVs -> 123 XUVs
C:0 T:9 97457 XUs and 65691 XVs -> 11211 XUVs
C:0 T:10 53687 XUs and 65122 XVs -> 8910 XUVs
C:0 T:11 57 XUs and 41 XVs -> 8 XUVs
46161 XUVs total
10385 collection wire objects
42840 potential space points
Neighbour search...
6425684 tests to find 3014402 neighbours
Iterating with no regularization...
Begin: 6.6137e+07
0 5.75381e+07
1 5.67997e+07
2 5.66866e+07
3 5.66515e+07
Now with regularization...
Begin: 4.68972e+07
0 4.68568e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411905273
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411905273
fLifetime: 30000 [us]
23-Jan-2026 05:07:31 CET Closed output file "reco_stage1.root"
23-Jan-2026 05:07:31 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 704.22 941.925 1209.65 943.347 157.658 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00184543 0.00586009 0.0093492 0.00583272 0.00220483 10
reco:ophit:OpHitFinder 0.362346 0.509251 0.653568 0.501466 0.0858632 10
reco:opflash:OpFlashFinder 0.279982 0.347704 0.43658 0.360393 0.0513193 10
reco:opslicer:OpSlicer 0.923815 1.31224 1.71595 1.31049 0.248738 10
reco:caldata:DataPrepModule 10.0085 13.8034 15.6764 13.9658 1.44748 10
reco:wclsdatasp:WireCellToolkit 61.3807 79.1917 86.5883 83.1286 8.68984 10
reco:gaushit:GausHitFinder 1.63125 2.61861 3.49418 2.83063 0.581963 10
reco:nhitsfilter:NumberOfHitsFilter 0.000822502 0.00111711 0.00170934 0.00106404 0.000256296 10
reco:reco3d:SpacePointSolver 15.1768 31.4674 46.6168 33.8935 9.66747 10
reco:hitpdune:DisambigFromSpacePoints 2.05246 4.62217 7.23629 4.50482 1.51661 10
reco:pandora:StandardPandora 33.3875 83.8383 136.328 82.0369 28.5269 10
reco:pandoraWriter:StandardPandora 0.545782 0.973314 1.52919 0.991329 0.254678 10
reco:pandoraTrack:LArPandoraTrackCreation 9.66398 18.9209 25.7379 18.3254 4.82359 10
reco:pandoraShower:LArPandoraShowerCreation 10.9308 20.7598 28.1032 21.8702 5.1599 10
reco:pandoracalo:Calorimetry 4.38364 8.83088 12.0683 8.92769 2.33941 10
reco:pandoracalonosce:Calorimetry 4.08898 8.43186 11.7372 8.37247 2.24522 10
reco:pandorapid:Chi2ParticleID 0.0065989 0.012082 0.0179915 0.0127382 0.00316648 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0745092 0.113143 0.147369 0.115775 0.0214814 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00645973 0.0111513 0.0149899 0.0116848 0.00257834 10
reco:pandoraShowercalo:ShowerCalorimetry 10.6745 21.2315 29.8476 21.9907 5.46394 10
reco:pandoraShowercalonosce:ShowerCalorimetry 10.3539 20.3236 28.5273 21.3514 5.46036 10
reco:emtrkmichelid:EmTrackMichelId 318.088 405.86 496.887 401.281 54.2952 10
reco:crttag:SingleCRTMatchingProducer 0.0339723 0.0541855 0.0752948 0.0551591 0.012406 10
reco:crtreco:TwoCRTMatchingProducer 0.0281722 0.0507723 0.0644822 0.0525955 0.010551 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.7698 2.20728 2.8634 2.14769 0.28967 10
reco:pandora2Track:LArPandoraTrackCreation 43.7876 73.9069 110.389 68.6973 21.2001 10
reco:pandora2calo:Calorimetry 19.9622 31.761 47.1131 28.4489 10.0165 10
reco:pandora2calonosce:Calorimetry 18.1719 30.6164 50.5577 27.8664 10.6408 10
reco:pandora2pid:Chi2ParticleID 0.0165071 0.0274915 0.0392893 0.0272294 0.00755522 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0956147 0.144265 0.191434 0.14006 0.0302346 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0169564 0.0274771 0.0392866 0.0273184 0.00729758 10
reco:pandora2Shower:LArPandoraShowerCreation 14.1859 22.3119 32.0259 20.7714 6.77333 10
reco:pandora2Showercalo:ShowerCalorimetry 16.0072 27.6768 40.5535 27.0506 8.85397 10
reco:pandora2Showercalonosce:ShowerCalorimetry 14.6594 24.5513 36.1905 22.6376 7.73723 10
[art]:TriggerResults:TriggerResultInserter 4.1361e-05 8.78402e-05 0.000231213 7.832e-05 5.01654e-05 10
end_path:out1:RootOutput 7.483e-06 1.0068e-05 1.8631e-05 9.183e-06 3.11348e-06 10
end_path:out1:RootOutput(write) 3.33046 5.13363 6.9025 5.01194 1.07112 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5135.92 MB
Peak resident set size usage (VmHWM): 4321.72 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.43 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 9.87 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.40 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10728608
-rw-r--r-- 1 dune001 dune 2490232323 Jan 23 02:27 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2363845697 Jan 23 02:22 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2187013890 Jan 23 05:07 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1971760240 Jan 22 23:52 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1895150610 Jan 22 23:24 g4_stage1.root
-rw-r--r-- 1 dune001 dune 77453110 Jan 23 04:57 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 243033 Jan 23 05:07 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 23 05:07 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 23 05:07 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 23 05:07 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 23 02:27 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 22 23:52 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 23 05:07 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 22 23:10 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 23 05:07 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 23 02:41 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 23 02:27 debugprod.log
