Jobsub ID 299747.0@dunegpschedd01.fnal.gov
| Jobsub ID | 299747.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12292 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-23 06:43:56 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-23 10:02:25 |
| From worker node | Hostname | hnode78.pic.es |
| cpuinfo | AMD EPYC 7443P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-23 06:45:12 |
| Input files | monte-carlo-012292-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11758s) |
| CPU time | 2h (10345s = 87%) |
| Max RSS bytes | 4274335744 (4076 MiB) |
| Outputting started | 2026-01-23 10:01:11 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12292/1/001/reco_stage1.root
|
| Finished | 2026-01-23 10:02:25 |
| Saved logs | justin-logs:299747.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e: Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 128163 traces, 0 summary
Retagger: tagging trace set: gauss with 97359 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 97359 traces tagged "gauss"
FrameSaver: q=3.54217e+06 n=1757751 tag=gauss
wclsFrameSaver: saving 128163 traces tagged "wiener"
FrameSaver: q=3.73855e+06 n=1565054 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 26096 XUs and 20352 XVs -> 518 XUVs
C:0 T:1 79205 XUs and 64932 XVs -> 11729 XUVs
C:0 T:2 89768 XUs and 107677 XVs -> 6505 XUVs
C:0 T:3 37958 XUs and 32762 XVs -> 703 XUVs
C:0 T:4 10841 XUs and 12282 XVs -> 73 XUVs
C:0 T:5 34542 XUs and 33223 XVs -> 3507 XUVs
C:0 T:6 130983 XUs and 152517 XVs -> 6810 XUVs
C:0 T:7 50129 XUs and 59491 XVs -> 608 XUVs
C:0 T:8 8990 XUs and 10157 XVs -> 135 XUVs
C:0 T:9 44904 XUs and 61870 XVs -> 3880 XUVs
C:0 T:10 43398 XUs and 22262 XVs -> 3551 XUVs
C:0 T:11 245 XUs and 189 XVs -> 24 XUVs
38043 XUVs total
10262 collection wire objects
33969 potential space points
Neighbour search...
2775265 tests to find 1464436 neighbours
Iterating with no regularization...
Begin: 7.40353e+07
0 6.04571e+07
1 5.95077e+07
2 5.93682e+07
3 5.9324e+07
Now with regularization...
Begin: 4.94488e+07
0 4.94103e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411912437
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411912437
fLifetime: 30000 [us]
23-Jan-2026 11:01:09 CET Closed output file "reco_stage1.root"
23-Jan-2026 11:01:09 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 201.824 424.883 832.911 408.067 166.982 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0008618 0.00323512 0.00578109 0.00319568 0.00161071 10
reco:ophit:OpHitFinder 0.190211 0.278497 0.400248 0.24615 0.0699456 10
reco:opflash:OpFlashFinder 0.129093 0.180907 0.27551 0.17006 0.0393626 10
reco:opslicer:OpSlicer 0.364776 0.625286 0.983624 0.534983 0.193407 10
reco:caldata:DataPrepModule 3.3138 4.81622 6.79933 4.04602 1.39593 10
reco:wclsdatasp:WireCellToolkit 22.9288 54.1344 280.706 30.3352 75.6589 10
reco:gaushit:GausHitFinder 0.662242 1.3103 1.99225 1.21752 0.450836 10
reco:nhitsfilter:NumberOfHitsFilter 0.000284056 0.000520186 0.000790228 0.000488606 0.000175087 10
reco:reco3d:SpacePointSolver 6.15915 17.4094 35.8313 15.3192 8.38526 10
reco:hitpdune:DisambigFromSpacePoints 0.78282 1.82163 2.84946 1.66274 0.667863 10
reco:pandora:StandardPandora 12.7011 38.9076 84.1487 32.5424 18.2631 10
reco:pandoraWriter:StandardPandora 0.214183 0.449075 0.72948 0.454989 0.155546 10
reco:pandoraTrack:LArPandoraTrackCreation 1.65469 16.1024 125.211 4.43364 36.394 10
reco:pandoraShower:LArPandoraShowerCreation 1.56322 17.3059 129.854 4.96753 37.58 10
reco:pandoracalo:Calorimetry 1.05761 2.24015 4.08826 2.18892 0.829712 10
reco:pandoracalonosce:Calorimetry 0.957196 2.21118 4.06986 2.07114 0.885171 10
reco:pandorapid:Chi2ParticleID 0.00297645 0.00538725 0.00981163 0.00440662 0.00230461 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0288924 0.0508422 0.0904152 0.0389545 0.0223756 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00280943 0.0052474 0.00884377 0.0040418 0.00222155 10
reco:pandoraShowercalo:ShowerCalorimetry 1.96718 5.62142 11.2982 5.19892 2.55301 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.89498 5.81804 11.0915 4.77136 2.99927 10
reco:emtrkmichelid:EmTrackMichelId 119.232 203.903 273.324 219.826 51.1409 10
reco:crttag:SingleCRTMatchingProducer 0.00612963 0.0134798 0.0186692 0.0133987 0.00351588 10
reco:crtreco:TwoCRTMatchingProducer 0.00474581 0.011053 0.0159563 0.011111 0.00310319 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.660813 0.993819 1.23324 1.03018 0.16728 10
reco:pandora2Track:LArPandoraTrackCreation 7.39152 15.3083 26.8862 14.0562 5.80451 10
reco:pandora2calo:Calorimetry 3.97743 7.98355 17.1263 6.70742 3.89249 10
reco:pandora2calonosce:Calorimetry 3.0588 7.34032 16.4879 6.532 3.75567 10
reco:pandora2pid:Chi2ParticleID 0.00678582 0.0132884 0.0224148 0.0118071 0.00496664 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0372243 0.0725733 0.12783 0.0668443 0.0303056 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00678723 0.0144595 0.0263441 0.0128865 0.00621166 10
reco:pandora2Shower:LArPandoraShowerCreation 2.40399 5.29647 11.0651 4.57955 2.49858 10
reco:pandora2Showercalo:ShowerCalorimetry 2.60245 6.20231 12.2429 6.05634 2.57326 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.41677 5.49291 9.94484 5.48163 2.11182 10
[art]:TriggerResults:TriggerResultInserter 2.059e-05 4.06569e-05 8.2541e-05 3.31705e-05 1.98289e-05 10
end_path:out1:RootOutput 4.19e-06 5.627e-06 8.26e-06 5.645e-06 1.18317e-06 10
end_path:out1:RootOutput(write) 1.68717 2.83268 4.27995 2.91832 0.808406 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5088.71 MB
Peak resident set size usage (VmHWM): 4274.34 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10749156
-rw-r--r-- 1 dune001 dune 2508599141 Jan 23 09:48 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2378281613 Jan 23 09:46 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2232096843 Jan 23 11:01 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1949171420 Jan 23 08:05 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1854149712 Jan 23 07:52 g4_stage1.root
-rw-r--r-- 1 dune001 dune 84209530 Jan 23 10:56 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 243074 Jan 23 11:01 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 23 11:01 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 23 11:01 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 23 11:01 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 23 09:48 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 23 08:05 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 23 11:01 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 23 07:45 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 23 11:01 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 23 09:53 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 23 09:48 debugprod.log
