Jobsub ID 276339.1@dunegpschedd02.fnal.gov
| Jobsub ID | 276339.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12097 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-19 14:19:11 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce15-multicore |
| Last heartbeat | 2026-01-19 19:30:43 |
| From worker node | Hostname | tds414.pic.es |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-19 14:20:00 |
| Input files | monte-carlo-012097-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (18578s) |
| CPU time | 4h (17642s = 94%) |
| Max RSS bytes | 4289499136 (4090 MiB) |
| Outputting started | 2026-01-19 19:29:39 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12097/1/001/reco_stage1.root
|
| Finished | 2026-01-19 19:30:43 |
| Saved logs | justin-logs:276339.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
r
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 151591 traces, 0 summary
Retagger: tagging trace set: gauss with 115984 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 115984 traces tagged "gauss"
FrameSaver: q=3.97949e+06 n=2031974 tag=gauss
wclsFrameSaver: saving 151591 traces tagged "wiener"
FrameSaver: q=4.22533e+06 n=1796941 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 43839 XUs and 32689 XVs -> 541 XUVs
C:0 T:1 80882 XUs and 66593 XVs -> 6155 XUVs
C:0 T:2 77117 XUs and 115034 XVs -> 5191 XUVs
C:0 T:3 40805 XUs and 43341 XVs -> 279 XUVs
C:0 T:4 21135 XUs and 14060 XVs -> 282 XUVs
C:0 T:5 94551 XUs and 58334 XVs -> 14583 XUVs
C:0 T:6 79863 XUs and 110624 XVs -> 6486 XUVs
C:0 T:7 27924 XUs and 36844 XVs -> 257 XUVs
C:0 T:8 10108 XUs and 8521 XVs -> 120 XUVs
C:0 T:9 76805 XUs and 80261 XVs -> 7083 XUVs
C:0 T:10 60241 XUs and 24251 XVs -> 4375 XUVs
C:0 T:11 84 XUs and 37 XVs -> 7 XUVs
45359 XUVs total
13324 collection wire objects
42547 potential space points
Neighbour search...
5939143 tests to find 2707088 neighbours
Iterating with no regularization...
Begin: 6.63073e+07
0 5.08726e+07
1 4.96779e+07
2 4.94792e+07
3 4.94186e+07
4 4.9392e+07
Now with regularization...
Begin: 3.8183e+07
0 3.81114e+07
1 3.80616e+07
2 3.80257e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411838324
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411838324
fLifetime: 30000 [us]
19-Jan-2026 20:29:36 CET Closed output file "reco_stage1.root"
19-Jan-2026 20:29:36 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 578.205 705.251 925.421 707.82 92.4139 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.001632 0.00541887 0.0087842 0.0053211 0.00240678 10
reco:ophit:OpHitFinder 0.357305 0.42622 0.516954 0.419325 0.0403261 10
reco:opflash:OpFlashFinder 0.199182 0.256192 0.372095 0.252791 0.0446204 10
reco:opslicer:OpSlicer 0.953126 1.16994 1.48894 1.18076 0.145674 10
reco:caldata:DataPrepModule 7.90904 8.16189 8.52105 8.12307 0.178822 10
reco:wclsdatasp:WireCellToolkit 43.6259 53.4745 59.3501 54.8648 4.34415 10
reco:gaushit:GausHitFinder 1.73673 2.11655 2.73206 2.10221 0.248821 10
reco:nhitsfilter:NumberOfHitsFilter 0.000745313 0.000996362 0.00157873 0.000928092 0.000238788 10
reco:reco3d:SpacePointSolver 17.5467 27.2668 41.8255 25.6902 7.81345 10
reco:hitpdune:DisambigFromSpacePoints 2.21105 3.09252 4.92825 2.98471 0.710064 10
reco:pandora:StandardPandora 50.9051 69.9562 112.424 65.7908 18.0026 10
reco:pandoraWriter:StandardPandora 0.641859 0.796128 0.939261 0.816952 0.0829254 10
reco:pandoraTrack:LArPandoraTrackCreation 7.60759 9.05024 11.4616 8.5557 1.32522 10
reco:pandoraShower:LArPandoraShowerCreation 7.59459 10.1982 15.8359 9.99213 2.20509 10
reco:pandoracalo:Calorimetry 4.09064 5.14505 6.3882 5.21968 0.759411 10
reco:pandoracalonosce:Calorimetry 3.01335 4.46683 5.57273 4.68513 0.774503 10
reco:pandorapid:Chi2ParticleID 0.00799621 0.0102265 0.0117826 0.010723 0.00119413 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.065215 0.102082 0.12431 0.104271 0.0161031 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00661103 0.0100452 0.0109633 0.0103898 0.00120435 10
reco:pandoraShowercalo:ShowerCalorimetry 7.7291 10.9312 17.0804 11.0184 2.51993 10
reco:pandoraShowercalonosce:ShowerCalorimetry 6.39282 9.84042 16.4123 9.29009 2.52582 10
reco:emtrkmichelid:EmTrackMichelId 326.917 390.208 485.392 390.228 42.8799 10
reco:crttag:SingleCRTMatchingProducer 0.0153189 0.0275339 0.0385625 0.0249753 0.00821604 10
reco:crtreco:TwoCRTMatchingProducer 0.0111762 0.0193367 0.0282733 0.018812 0.00518081 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.13863 1.46408 1.69653 1.49252 0.177753 10
reco:pandora2Track:LArPandoraTrackCreation 17.0381 28.2143 37.9725 28.5129 5.80876 10
reco:pandora2calo:Calorimetry 8.63166 15.071 22.2554 14.9302 3.46421 10
reco:pandora2calonosce:Calorimetry 9.51341 14.1437 22.5624 13.8801 3.51009 10
reco:pandora2pid:Chi2ParticleID 0.0225218 0.0271742 0.0356586 0.0264186 0.00375306 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.116405 0.136108 0.169822 0.135552 0.0153183 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0221487 0.0268394 0.0340215 0.0271671 0.00344232 10
reco:pandora2Shower:LArPandoraShowerCreation 7.2059 10.6848 16.0077 10.9382 2.44414 10
reco:pandora2Showercalo:ShowerCalorimetry 7.26912 12.6772 19.6349 12.6326 3.21717 10
reco:pandora2Showercalonosce:ShowerCalorimetry 6.30872 10.9376 14.3515 11.9177 2.37295 10
[art]:TriggerResults:TriggerResultInserter 6.5771e-05 9.53748e-05 0.000221824 8.3587e-05 4.29133e-05 10
end_path:out1:RootOutput 9.44e-06 1.32562e-05 2.264e-05 1.2505e-05 3.56327e-06 10
end_path:out1:RootOutput(write) 3.62594 4.92993 5.68021 4.93814 0.519067 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5117.15 MB
Peak resident set size usage (VmHWM): 4289.5 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10613864
-rw-r--r-- 1 dune001 dune 2487659369 Jan 19 18:28 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2360647972 Jan 19 18:25 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2208196529 Jan 19 20:29 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1909021857 Jan 19 15:52 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1819200660 Jan 19 15:30 g4_stage1.root
-rw-r--r-- 1 dune001 dune 83241200 Jan 19 20:20 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242975 Jan 19 20:29 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 19 20:29 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 19 20:29 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 19 20:29 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 19 18:28 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 19 15:52 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 19 20:29 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 19 15:20 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 19 20:29 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 19 18:39 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 19 18:28 debugprod.log
