justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269341.0@dunegpschedd01.fnal.gov

Jobsub ID269341.0@dunegpschedd01.fnal.gov
Workflow ID11289
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-20 03:57:41
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep206
Last heartbeat2025-12-20 07:57:08
From worker nodeHostnameheplnc167.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-20 03:58:32
Input filesmonte-carlo-011289-000001
JobscriptExit code0
Real time3h (14231s)
CPU time3h (13651s = 95%)
Max RSS bytes4302180352 (4102 MiB)
Outputting started2025-12-20 07:55:44
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11289/1/001/reco_stage1.root
Finished2025-12-20 07:57:08
Saved logsjustin-logs:269341.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

dEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 127810 traces, 0 summary
Retagger: tagging trace set: gauss with 95629 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95629 traces tagged "gauss"
FrameSaver: q=3.14754e+06 n=1667203 tag=gauss
wclsFrameSaver: saving 127810 traces tagged "wiener"
FrameSaver: q=3.35991e+06 n=1460061 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 34719 XUs and 29974 XVs -> 338 XUVs
C:0 T:1 50578 XUs and 46550 XVs -> 2939 XUVs
C:0 T:2 130016 XUs and 136109 XVs -> 13670 XUVs
C:0 T:3 44575 XUs and 44560 XVs -> 675 XUVs
C:0 T:4 7976 XUs and 7430 XVs -> 32 XUVs
C:0 T:5 30060 XUs and 21162 XVs -> 2740 XUVs
C:0 T:6 300979 XUs and 238470 XVs -> 48959 XUVs
C:0 T:7 49444 XUs and 57351 XVs -> 1326 XUVs
C:0 T:8 6062 XUs and 3069 XVs -> 73 XUVs
C:0 T:9 63153 XUs and 38334 XVs -> 8176 XUVs
C:0 T:10 138632 XUs and 133431 XVs -> 53444 XUVs
C:0 T:11 208 XUs and 181 XVs -> 37 XUVs
132409 XUVs total
12605 collection wire objects
125263 potential space points
Neighbour search...
45188961 tests to find 17846366 neighbours
Iterating with no regularization...
Begin: 6.01938e+07
0 4.63523e+07
1 4.56687e+07
2 4.55448e+07
3 4.54999e+07
Now with regularization...
Begin: 3.74467e+07
0 3.72749e+07
1 3.71367e+07
2 3.70176e+07
3 3.69152e+07
4 3.68321e+07
5 3.67638e+07
6 3.67058e+07
7 3.66573e+07
8 3.6617e+07
9 3.65835e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411226036
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411226036
fLifetime: 30000 [us]
20-Dec-2025 07:55:42 GMT  Closed output file "reco_stage1.root"
20-Dec-2025 07:55:42 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          341.811       427.095       554.579       414.672       66.2404        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00132489    0.00488354    0.00738873    0.00526163    0.00155847       10     
reco:ophit:OpHitFinder                             0.284803      0.416816      0.772423       0.39084      0.134647        10     
reco:opflash:OpFlashFinder                         0.187842      0.244562      0.358996      0.230545      0.0516663       10     
reco:opslicer:OpSlicer                             0.568576       0.83366       1.06395      0.840162      0.174089        10     
reco:caldata:DataPrepModule                         5.00185       7.10766       8.35898       7.31986      0.901867        10     
reco:wclsdatasp:WireCellToolkit                     35.5509       40.6751       45.6516       40.712        2.56385        10     
reco:gaushit:GausHitFinder                          1.44258       1.69183       2.01946       1.67667      0.167104        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000616664   0.000741154   0.000927456   0.000726214   0.000104484      10     
reco:reco3d:SpacePointSolver                        13.7502       23.7382       69.3159       16.1794       16.1215        10     
reco:hitpdune:DisambigFromSpacePoints               1.08522       2.12417       3.34591       1.89425      0.666505        10     
reco:pandora:StandardPandora                        27.4395        41.27        69.5166       36.4195       13.5058        10     
reco:pandoraWriter:StandardPandora                 0.337045      0.539417      0.816679      0.522792      0.141438        10     
reco:pandoraTrack:LArPandoraTrackCreation           3.69555       5.04308       7.39654       4.81629       1.08669        10     
reco:pandoraShower:LArPandoraShowerCreation         3.04798       4.8635        9.60931       4.43979       1.78833        10     
reco:pandoracalo:Calorimetry                        2.12245       3.03624       4.06867       3.00372      0.554757        10     
reco:pandoracalonosce:Calorimetry                   1.90757       2.81569       3.8569        2.82597      0.643146        10     
reco:pandorapid:Chi2ParticleID                    0.00518439    0.00869117     0.0102259    0.00914351    0.00138929       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0376941     0.0794821     0.0976439     0.0828729     0.0168375       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00523732    0.00845169     0.0100488    0.00896065    0.00132699       10     
reco:pandoraShowercalo:ShowerCalorimetry            3.20925       5.73529       8.46403       5.24484       1.66963        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.67709       5.24413       7.63118       4.94767       1.53228        10     
reco:emtrkmichelid:EmTrackMichelId                  195.428       227.272       278.33        213.298       30.2943        10     
reco:crttag:SingleCRTMatchingProducer              0.0142529     0.0234188     0.0418686     0.0218996    0.00732343       10     
reco:crtreco:TwoCRTMatchingProducer               0.00889193     0.0126537     0.0170222     0.012856     0.00225083       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.785115       1.13057       1.48108       1.09945      0.199132        10     
reco:pandora2Track:LArPandoraTrackCreation          9.77437       15.3588       22.123        14.329        4.35036        10     
reco:pandora2calo:Calorimetry                       4.55324       8.11914       12.0263       7.33228       2.31631        10     
reco:pandora2calonosce:Calorimetry                  4.0979        7.38604       10.5704       7.20162       1.98194        10     
reco:pandora2pid:Chi2ParticleID                    0.0174413     0.0208499     0.0256001     0.0203567    0.00253508       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0778358     0.100493      0.122802      0.101971      0.0129905       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0125779     0.0196028     0.0252452     0.0192881    0.00327474       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.62603       5.2834        8.56371       4.92414       1.41984        10     
reco:pandora2Showercalo:ShowerCalorimetry           4.77819       6.91015       10.361        7.0439        1.78704        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      4.20347       6.29136       8.72314       5.87481       1.44261        10     
[art]:TriggerResults:TriggerResultInserter        6.0333e-05    9.87509e-05   0.000281186   7.98295e-05   6.13994e-05      10     
end_path:out1:RootOutput                           1.094e-05    1.51743e-05   2.4756e-05    1.49575e-05   3.58688e-06      10     
end_path:out1:RootOutput(write)                     2.72924       3.54742       4.46171       3.50446      0.537852        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5189.75 MB
  Peak resident set size usage (VmHWM): 4302.18 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.10 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.32 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.45 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.19 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10588392
-rw-r--r-- 1 pltdune04 pltdune 2471207108 Dec 20 06:42 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2345518820 Dec 20 06:39 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2156027110 Dec 20 07:55 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 1937275077 Dec 20 04:21 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1857005158 Dec 20 04:06 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   74865030 Dec 20 07:51 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     243122 Dec 20 07:55 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Dec 20 07:55 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Dec 20 07:55 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Dec 20 07:55 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 20 06:42 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 20 04:21 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 20 07:55 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Dec 20 03:58 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Dec 20 07:55 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Dec 20 06:47 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Dec 20 06:42 debugprod.log
justIN time: 2026-02-07 06:22:11 UTC       justIN version: 01.06.00