Jobsub ID 293587.0@dunegpschedd02.fnal.gov
| Jobsub ID | 293587.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12250 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-22 15:01:07 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-22 20:46:55 |
| From worker node | Hostname | gpu05.pic.es |
| cpuinfo | Intel(R) Xeon(R) Gold 6230R CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-22 15:02:10 |
| Input files | monte-carlo-012250-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (19031s) |
| CPU time | 5h (18508s = 97%) |
| Max RSS bytes | 4221665280 (4026 MiB) |
| Outputting started | 2026-01-22 20:19:22 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12250/1/001/reco_stage1.root
|
| Finished | 2026-01-22 20:46:55 |
| Saved logs | justin-logs:293587.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
wDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 117740 traces, 0 summary
Retagger: tagging trace set: gauss with 85619 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 85619 traces tagged "gauss"
FrameSaver: q=3.01746e+06 n=1478195 tag=gauss
wclsFrameSaver: saving 117740 traces tagged "wiener"
FrameSaver: q=3.21922e+06 n=1291311 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 20490 XUs and 21180 XVs -> 140 XUVs
C:0 T:1 34752 XUs and 30313 XVs -> 2229 XUVs
C:0 T:2 124619 XUs and 261372 XVs -> 14073 XUVs
C:0 T:3 52250 XUs and 60898 XVs -> 520 XUVs
C:0 T:4 6690 XUs and 8516 XVs -> 52 XUVs
C:0 T:5 20942 XUs and 19566 XVs -> 2444 XUVs
C:0 T:6 85563 XUs and 130529 XVs -> 13383 XUVs
C:0 T:7 28383 XUs and 33753 XVs -> 953 XUVs
C:0 T:8 6417 XUs and 6818 XVs -> 73 XUVs
C:0 T:9 30595 XUs and 39202 XVs -> 2754 XUVs
C:0 T:10 73544 XUs and 113026 XVs -> 22348 XUVs
C:0 T:11 43 XUs and 51 XVs -> 28 XUVs
58997 XUVs total
10333 collection wire objects
54575 potential space points
Neighbour search...
11567065 tests to find 4987854 neighbours
Iterating with no regularization...
Begin: 6.01118e+07
0 4.56799e+07
1 4.49339e+07
2 4.48048e+07
3 4.47658e+07
Now with regularization...
Begin: 3.6366e+07
0 3.6316e+07
1 3.62741e+07
2 3.6241e+07
PcaShowerParticleBuildingAlgorithm::OpeningAngle - principal eigenvalue less than or equal to 0.
run: 1 ; subrun: 0 ; event: 10
evttime: 411898823
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411898823
fLifetime: 30000 [us]
22-Jan-2026 21:19:19 CET Closed output file "reco_stage1.root"
22-Jan-2026 21:19:19 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 478.276 805.622 1058.11 823.842 178.883 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0011921 0.00562963 0.0108058 0.00544428 0.00237712 10
reco:ophit:OpHitFinder 0.372367 0.50848 0.609541 0.531618 0.073244 10
reco:opflash:OpFlashFinder 0.232172 0.342222 0.429205 0.348932 0.0533073 10
reco:opslicer:OpSlicer 0.752927 1.26166 1.59389 1.29211 0.249898 10
reco:caldata:DataPrepModule 7.69537 10.9991 11.8966 11.3635 1.13392 10
reco:wclsdatasp:WireCellToolkit 57.6306 78.2648 87.1431 81.4891 8.86421 10
reco:gaushit:GausHitFinder 1.58075 2.48131 3.75057 2.34672 0.637358 10
reco:nhitsfilter:NumberOfHitsFilter 0.000779595 0.00112949 0.00153589 0.00108457 0.000268767 10
reco:reco3d:SpacePointSolver 9.24905 29.2338 40.5653 30.7755 9.61283 10
reco:hitpdune:DisambigFromSpacePoints 1.58981 3.57089 6.06244 3.5556 1.15751 10
reco:pandora:StandardPandora 33.442 63.6912 122.745 60.5314 25.33 10
reco:pandoraWriter:StandardPandora 0.519155 0.858917 1.21236 0.85157 0.223605 10
reco:pandoraTrack:LArPandoraTrackCreation 8.49158 17.8713 29.295 16.9631 5.91047 10
reco:pandoraShower:LArPandoraShowerCreation 5.56647 18.0734 29.5839 15.9677 7.59317 10
reco:pandoracalo:Calorimetry 3.5513 8.07003 12.3173 7.99993 2.48373 10
reco:pandoracalonosce:Calorimetry 3.08525 8.02617 12.1706 7.79516 2.55595 10
reco:pandorapid:Chi2ParticleID 0.00796702 0.0117493 0.0162884 0.0118626 0.00231768 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0639108 0.105738 0.138548 0.113959 0.0210523 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00830197 0.0112974 0.0145417 0.0117255 0.00176878 10
reco:pandoraShowercalo:ShowerCalorimetry 4.86502 18.2058 30.7612 15.8274 7.77097 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.24256 16.3955 29.9828 15.3728 7.15329 10
reco:emtrkmichelid:EmTrackMichelId 235.717 360.24 442.645 376.001 73.7839 10
reco:crttag:SingleCRTMatchingProducer 0.0293152 0.049601 0.0632186 0.0509731 0.00917008 10
reco:crtreco:TwoCRTMatchingProducer 0.023978 0.0445661 0.0608207 0.0456765 0.00951049 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.14879 2.05003 2.38527 2.06391 0.34164 10
reco:pandora2Track:LArPandoraTrackCreation 26.0986 59.8266 84.173 59.3831 16.9378 10
reco:pandora2calo:Calorimetry 9.65194 23.639 39.5784 23.4196 9.53921 10
reco:pandora2calonosce:Calorimetry 10.3237 22.347 37.7455 22.6855 9.20899 10
reco:pandora2pid:Chi2ParticleID 0.0145883 0.0236095 0.0326045 0.0220267 0.00640156 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0832282 0.124167 0.171953 0.119099 0.0319929 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0146527 0.0238039 0.0328603 0.0223983 0.00643676 10
reco:pandora2Shower:LArPandoraShowerCreation 7.28722 16.5159 24.2402 18.3203 5.79809 10
reco:pandora2Showercalo:ShowerCalorimetry 7.00209 19.8611 32.8858 19.8524 8.2627 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.63901 18.0407 29.2761 18.3235 7.40443 10
[art]:TriggerResults:TriggerResultInserter 3.6313e-05 8.62155e-05 0.000208624 7.6374e-05 4.31283e-05 10
end_path:out1:RootOutput 5.405e-06 8.8257e-06 1.6252e-05 8.3655e-06 2.86603e-06 10
end_path:out1:RootOutput(write) 2.76627 4.57133 5.86454 4.90938 1.07076 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4986.14 MB
Peak resident set size usage (VmHWM): 4158.54 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.43 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 7.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.40 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10123180
-rw-r--r-- 1 dune001 dune 2370037751 Jan 22 19:01 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2247760877 Jan 22 18:58 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2041548033 Jan 22 21:19 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1853568634 Jan 22 16:35 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1781482513 Jan 22 16:14 g4_stage1.root
-rw-r--r-- 1 dune001 dune 71100170 Jan 22 21:09 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242914 Jan 22 21:19 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 22 21:19 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 22 21:19 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 22 21:19 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 22 19:01 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 22 16:35 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 22 21:19 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 22 16:02 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 22 21:19 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 22 19:11 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 22 19:01 debugprod.log
