Jobsub ID 294419.1@dunegpschedd02.fnal.gov
| Jobsub ID | 294419.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12344 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-24 00:20:56 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce15-multicore |
| Last heartbeat | 2026-01-24 06:50:52 |
| From worker node | Hostname | gpu05.pic.es |
| cpuinfo | Intel(R) Xeon(R) Gold 6230R CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-24 00:23:11 |
| Input files | monte-carlo-012344-000001
|
| Jobscript | Exit code | 0 |
| Real time | 6h (23179s) |
| CPU time | 6h (22495s = 97%) |
| Max RSS bytes | 4267282432 (4069 MiB) |
| Outputting started | 2026-01-24 06:49:32 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12344/1/001/reco_stage1.root
|
| Finished | 2026-01-24 06:50:52 |
| Saved logs | justin-logs:294419.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 161994 traces, 0 summary
Retagger: tagging trace set: gauss with 122013 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 122013 traces tagged "gauss"
FrameSaver: q=4.15431e+06 n=2109410 tag=gauss
wclsFrameSaver: saving 161994 traces tagged "wiener"
FrameSaver: q=4.39676e+06 n=1847683 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 47200 XUs and 28682 XVs -> 883 XUVs
C:0 T:1 102637 XUs and 63886 XVs -> 8191 XUVs
C:0 T:2 83103 XUs and 93777 XVs -> 7864 XUVs
C:0 T:3 37285 XUs and 41201 XVs -> 317 XUVs
C:0 T:4 17339 XUs and 15937 XVs -> 176 XUVs
C:0 T:5 74370 XUs and 63468 XVs -> 7189 XUVs
C:0 T:6 90861 XUs and 97842 XVs -> 4480 XUVs
C:0 T:7 35021 XUs and 36094 XVs -> 338 XUVs
C:0 T:8 12451 XUs and 12951 XVs -> 302 XUVs
C:0 T:9 100489 XUs and 126484 XVs -> 7675 XUVs
C:0 T:10 44167 XUs and 31949 XVs -> 3904 XUVs
C:0 T:11 489 XUs and 384 XVs -> 61 XUVs
41380 XUVs total
15358 collection wire objects
37609 potential space points
Neighbour search...
2954843 tests to find 1517434 neighbours
Iterating with no regularization...
Begin: 8.25095e+07
0 6.7803e+07
1 6.68366e+07
2 6.6688e+07
3 6.66447e+07
Now with regularization...
Begin: 5.40329e+07
0 5.40091e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411927195
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411927195
fLifetime: 30000 [us]
24-Jan-2026 07:49:29 CET Closed output file "reco_stage1.root"
24-Jan-2026 07:49:29 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 680.985 996.731 1307.91 1031.75 178.426 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00204889 0.0062459 0.0103523 0.00637504 0.00262393 10
reco:ophit:OpHitFinder 0.335429 0.562202 0.741716 0.572928 0.12024 10
reco:opflash:OpFlashFinder 0.258667 0.405174 0.598092 0.406413 0.0931533 10
reco:opslicer:OpSlicer 0.805068 1.40124 2.00931 1.40687 0.348774 10
reco:caldata:DataPrepModule 7.33914 10.8873 12.1779 11.6669 1.71042 10
reco:wclsdatasp:WireCellToolkit 68.2256 81.2841 95.2008 80.9639 9.07496 10
reco:gaushit:GausHitFinder 1.54302 2.72163 3.77791 2.77816 0.688988 10
reco:nhitsfilter:NumberOfHitsFilter 0.00106683 0.00161883 0.00307892 0.00140543 0.000599991 10
reco:reco3d:SpacePointSolver 11.386 29.5633 49.9189 30.4521 10.5463 10
reco:hitpdune:DisambigFromSpacePoints 2.15554 4.83641 7.90685 4.99101 2.00738 10
reco:pandora:StandardPandora 36.3095 91.332 232.533 92.0314 52.9693 10
reco:pandoraWriter:StandardPandora 0.568963 0.909939 1.2368 0.867902 0.227355 10
reco:pandoraTrack:LArPandoraTrackCreation 11.6017 21.8328 34.5756 22.7234 6.19403 10
reco:pandoraShower:LArPandoraShowerCreation 14.7246 25.0266 31.9633 25.042 5.41168 10
reco:pandoracalo:Calorimetry 6.32452 9.66965 12.6409 9.91326 2.01793 10
reco:pandoracalonosce:Calorimetry 4.4454 9.09941 12.3177 9.35396 2.31621 10
reco:pandorapid:Chi2ParticleID 0.00674894 0.0100098 0.0167679 0.00919273 0.00294733 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0669862 0.104842 0.166546 0.101786 0.0293782 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00685739 0.00974083 0.0141016 0.00869645 0.00253987 10
reco:pandoraShowercalo:ShowerCalorimetry 9.85066 24.0673 37.3272 23.4039 8.15659 10
reco:pandoraShowercalonosce:ShowerCalorimetry 9.23955 24.2754 40.0796 22.7156 9.38966 10
reco:emtrkmichelid:EmTrackMichelId 341.446 421.418 485.335 441.373 50.2185 10
reco:crttag:SingleCRTMatchingProducer 0.0452671 0.0559464 0.0696971 0.0570779 0.00704987 10
reco:crtreco:TwoCRTMatchingProducer 0.041781 0.0497605 0.0586489 0.0499333 0.00654393 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.67369 2.37416 3.30501 2.32458 0.400472 10
reco:pandora2Track:LArPandoraTrackCreation 50.9127 77.6463 112.6 76.6357 19.6581 10
reco:pandora2calo:Calorimetry 18.8645 34.942 49.1905 35.2429 9.50816 10
reco:pandora2calonosce:Calorimetry 18.7828 33.8288 49.3059 33.0518 9.42952 10
reco:pandora2pid:Chi2ParticleID 0.0195363 0.0318997 0.0406771 0.0321232 0.00647517 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.122108 0.171247 0.218139 0.173285 0.0332682 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0194998 0.031413 0.041017 0.031014 0.00712981 10
reco:pandora2Shower:LArPandoraShowerCreation 17.6077 25.4453 34.7441 24.1539 5.78222 10
reco:pandora2Showercalo:ShowerCalorimetry 14.2659 30.1298 42.0247 29.841 8.90964 10
reco:pandora2Showercalonosce:ShowerCalorimetry 8.19413 26.5779 40.9346 28.0756 9.44464 10
[art]:TriggerResults:TriggerResultInserter 4.2286e-05 8.25081e-05 0.000141835 7.83605e-05 2.5855e-05 10
end_path:out1:RootOutput 7.53e-06 1.06833e-05 1.5444e-05 1.0429e-05 1.89286e-06 10
end_path:out1:RootOutput(write) 2.94967 5.71157 6.94444 6.17174 1.14951 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5089.26 MB
Peak resident set size usage (VmHWM): 4267.28 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.43 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 6.93 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.38 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11055072
-rw-r--r-- 1 dune001 dune 2560151254 Jan 24 04:59 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2426576078 Jan 24 04:54 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2274413059 Jan 24 07:49 reco_stage1.root
-rw-r--r-- 1 dune001 dune 2035731410 Jan 24 02:08 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1941450112 Jan 24 01:38 g4_stage1.root
-rw-r--r-- 1 dune001 dune 81445450 Jan 24 07:35 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 243315 Jan 24 07:49 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 24 07:49 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 24 07:49 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 24 07:49 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 24 04:59 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 24 02:08 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 24 07:49 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 24 01:23 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 24 07:49 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 24 05:14 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 24 04:59 debugprod.log
