justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 17854.0@dunegpschedd02.fnal.gov

Jobsub ID17854.0@dunegpschedd02.fnal.gov
Workflow ID985
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-08-15 11:19:38
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2025-08-15 13:22:43
From worker nodeHostnamenode2b07.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-08-15 11:20:20
Input filesmonte-carlo-000985-000001
JobscriptExit code0
Real time2h (7281s)
CPU time1h (6866s = 94%)
Max RSS bytes4107350016 (3917 MiB)
Outputting started2025-08-15 13:21:42
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/00985/1/001/reco_stage1.root
Finished2025-08-15 13:22:43
Saved logsjustin-logs:17854.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ervice:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 116644 traces, 0 summary
Retagger: tagging trace set: gauss with 85976 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 85976 traces tagged "gauss"
FrameSaver: q=2.86726e+06 n=1473532 tag=gauss
wclsFrameSaver: saving 116644 traces tagged "wiener"
FrameSaver: q=3.0416e+06 n=1281604 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 20341 XUs and 17898 XVs -> 163 XUVs
C:0 T:1 62633 XUs and 42027 XVs -> 7248 XUVs
C:0 T:2 54974 XUs and 110920 XVs -> 4597 XUVs
C:0 T:3 23099 XUs and 40473 XVs -> 97 XUVs
C:0 T:4 7526 XUs and 6065 XVs -> 32 XUVs
C:0 T:5 35440 XUs and 21820 XVs -> 3828 XUVs
C:0 T:6 88727 XUs and 112143 XVs -> 5641 XUVs
C:0 T:7 33556 XUs and 39632 XVs -> 305 XUVs
C:0 T:8 12318 XUs and 11387 XVs -> 227 XUVs
C:0 T:9 78071 XUs and 91443 XVs -> 5054 XUVs
C:0 T:10 24880 XUs and 19597 XVs -> 4046 XUVs
C:0 T:11 70 XUs and 36 XVs -> 6 XUVs
31244 XUVs total
11458 collection wire objects
28456 potential space points
Neighbour search...
2431450 tests to find 1272302 neighbours
Iterating with no regularization...
Begin: 5.50664e+07
0 4.69596e+07
1 4.64081e+07
2 4.63202e+07
3 4.62946e+07
Now with regularization...
Begin: 3.78389e+07
0 3.78083e+07
PcaShowerParticleBuildingAlgorithm::OpeningAngle - principal eigenvalue less than or equal to 0.
run: 1 ; subrun: 0 ; event: 10
evttime: 408677437
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 408677437
fLifetime: 30000 [us]
15-Aug-2025 14:21:39 BST  Closed output file "reco_stage1.root"
15-Aug-2025 14:21:39 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          168.466        237.5        313.274       230.673       40.039         10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000879515   0.00277845     0.0043238    0.00297314    0.00108383       10     
reco:ophit:OpHitFinder                             0.208052      0.237877      0.277492      0.231375      0.0220887       10     
reco:opflash:OpFlashFinder                         0.122923      0.162594      0.210519      0.160167      0.0286091       10     
reco:opslicer:OpSlicer                              0.3687       0.479886      0.613027      0.480415      0.0685725       10     
reco:caldata:DataPrepModule                         4.53903       4.77863       5.36085       4.75162      0.219967        10     
reco:wclsdatasp:WireCellToolkit                     36.4871       39.7292       42.4781       40.5814       2.10236        10     
reco:gaushit:GausHitFinder                         0.728826      0.985926       1.34053      0.939386      0.185526        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000315468   0.000502312   0.000632472   0.000492438   9.39715e-05      10     
reco:reco3d:SpacePointSolver                        4.96869       9.05022       14.7043       7.92314       3.11302        10     
reco:hitpdune:DisambigFromSpacePoints              0.589041      0.987636       1.38929      0.918166       0.23222        10     
reco:pandora:StandardPandora                        10.1991       21.243        36.5306       19.2772       8.50417        10     
reco:pandoraWriter:StandardPandora                 0.225229      0.315212      0.398736      0.306498      0.0497235       10     
reco:pandoraTrack:LArPandoraTrackCreation           1.42579       2.7127        4.15303       2.77046      0.749457        10     
reco:pandoraShower:LArPandoraShowerCreation         1.3535        2.75043       4.77293       2.44099       1.00532        10     
reco:pandoracalo:Calorimetry                       0.797288       1.47301       2.27895       1.47024      0.424623        10     
reco:pandoracalonosce:Calorimetry                  0.693922       1.32045       2.06048       1.32181      0.393316        10     
reco:pandorapid:Chi2ParticleID                    0.00297121    0.00409434    0.00475469    0.00423817    0.000510891      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0277102     0.0371728     0.0486716     0.0369337    0.00616516       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00293788    0.00401549    0.00493131     0.0039278    0.000598327      10     
reco:pandoraShowercalo:ShowerCalorimetry            1.24489       2.64168       4.75185       2.30958       1.08577        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       1.19773       2.56944       4.63495       2.23295       1.05579        10     
reco:emtrkmichelid:EmTrackMichelId                  87.7702       117.477       147.521       115.521       16.7442        10     
reco:crttag:SingleCRTMatchingProducer             0.00960437     0.0129186     0.015689      0.0129524    0.00191814       10     
reco:crtreco:TwoCRTMatchingProducer               0.00551333    0.00740105    0.00917537     0.0071267    0.00116407       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.520926      0.809068        1.085       0.805325       0.15876        10     
reco:pandora2Track:LArPandoraTrackCreation          4.09554       8.27263       13.4337       7.74141       2.74445        10     
reco:pandora2calo:Calorimetry                       1.97208       3.9976        6.58105       3.66386       1.42905        10     
reco:pandora2calonosce:Calorimetry                  1.85793       3.78636       6.49538       3.47961       1.41045        10     
reco:pandora2pid:Chi2ParticleID                   0.00695535    0.00949203     0.0123454    0.00939934    0.00151979       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0346359     0.0447437     0.0584851     0.0429115    0.00715605       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00712355    0.00963847     0.0127357    0.00949301    0.00156176       10     
reco:pandora2Shower:LArPandoraShowerCreation        1.58596       3.0688        4.88385       2.95715      0.972223        10     
reco:pandora2Showercalo:ShowerCalorimetry           1.63325       3.38256       5.68234       3.14049       1.26716        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      1.52115       3.12793       5.18926       2.90201       1.16121        10     
[art]:TriggerResults:TriggerResultInserter        3.2297e-05    4.28913e-05   0.000100769   3.6409e-05    1.94759e-05      10     
end_path:out1:RootOutput                           6.687e-06    7.8365e-06    1.4544e-05     7.081e-06    2.25079e-06      10     
end_path:out1:RootOutput(write)                     1.38356       1.92396       2.47615       1.87666      0.314664        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4915.36 MB
  Peak resident set size usage (VmHWM): 4107.35 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.19 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.03 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.12 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9688816
-rw-r--r-- 1 gl05pi6 eddie_users 2285365639 Aug 15 13:39 detsim_stage2.root
-rw-r--r-- 1 gl05pi6 eddie_users 2171311041 Aug 15 13:37 detsim_stage1.root
-rw-r--r-- 1 gl05pi6 eddie_users 1930504565 Aug 15 14:21 reco_stage1.root
-rw-r--r-- 1 gl05pi6 eddie_users 1774770666 Aug 15 12:37 g4_stage2.root
-rw-r--r-- 1 gl05pi6 eddie_users 1693887776 Aug 15 12:25 g4_stage1.root
-rw-r--r-- 1 gl05pi6 eddie_users   64630080 Aug 15 14:18 Pandora_Events.pndr
-rw-r--r-- 1 gl05pi6 eddie_users     491622 Aug 15 14:21 jobscript.log
-rw-r--r-- 1 gl05pi6 eddie_users     217088 Aug 15 14:21 mem.db
-rw-r--r-- 1 gl05pi6 eddie_users      62376 Aug 15 14:21 Pandora_Geometry.xml
-rw-r--r-- 1 gl05pi6 eddie_users      36864 Aug 15 14:21 time.db
-rw-r--r-- 1 gl05pi6 eddie_users        519 Aug 15 13:39 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 gl05pi6 eddie_users        519 Aug 15 12:37 g4_protoDUNE_hist.root
-rw-r--r-- 1 gl05pi6 eddie_users        519 Aug 15 14:21 protoDUNE_reco1_hist.root
-rw-r--r-- 1 gl05pi6 eddie_users         52 Aug 15 12:20 all-input-dids.txt
-rw-r--r-- 1 gl05pi6 eddie_users          7 Aug 15 14:21 justin-processed-pfns.txt
-rw-r--r-- 1 gl05pi6 eddie_users          0 Aug 15 13:44 ProtoDUNE.log
-rw-r--r-- 1 gl05pi6 eddie_users          0 Aug 15 13:39 debugprod.log
justIN time: 2025-09-18 21:55:43 UTC       justIN version: 01.05.00