justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 268096.1@dunegpschedd01.fnal.gov

Jobsub ID268096.1@dunegpschedd01.fnal.gov
Workflow ID11207
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-13 17:10:51
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep206
Last heartbeat2025-12-13 21:37:40
From worker nodeHostnameheplnc158.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 17:12:07
Input filesmonte-carlo-011207-000001
JobscriptExit code0
Real time4h (15840s)
CPU time4h (14986s = 94%)
Max RSS bytes4233728000 (4037 MiB)
Outputting started2025-12-13 21:36:07
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11207/1/001/reco_stage1.root
Finished2025-12-13 21:37:40
Saved logsjustin-logs:268096.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 148907 traces, 0 summary
Retagger: tagging trace set: gauss with 112378 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 112378 traces tagged "gauss"
FrameSaver: q=4.0146e+06 n=1929692 tag=gauss
wclsFrameSaver: saving 148907 traces tagged "wiener"
FrameSaver: q=4.24717e+06 n=1694101 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38789 XUs and 39907 XVs -> 753 XUVs
C:0 T:1 73642 XUs and 66826 XVs -> 6465 XUVs
C:0 T:2 63824 XUs and 61731 XVs -> 3119 XUVs
C:0 T:3 30928 XUs and 26212 XVs -> 167 XUVs
C:0 T:4 14104 XUs and 16172 XVs -> 142 XUVs
C:0 T:5 76195 XUs and 62039 XVs -> 10821 XUVs
C:0 T:6 126565 XUs and 125372 XVs -> 5420 XUVs
C:0 T:7 57745 XUs and 52816 XVs -> 589 XUVs
C:0 T:8 10689 XUs and 10402 XVs -> 151 XUVs
C:0 T:9 87591 XUs and 120231 XVs -> 10832 XUVs
C:0 T:10 26111 XUs and 16076 XVs -> 2995 XUVs
C:0 T:11 241 XUs and 195 XVs -> 34 XUVs
41488 XUVs total
12515 collection wire objects
38374 potential space points
Neighbour search...
4300384 tests to find 2046618 neighbours
Iterating with no regularization...
Begin: 9.53982e+07
0 8.19179e+07
1 8.0948e+07
2 8.08113e+07
3 8.07745e+07
Now with regularization...
Begin: 6.77189e+07
0 6.76844e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411096439
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411096439
fLifetime: 30000 [us]
13-Dec-2025 21:36:05 GMT  Closed output file "reco_stage1.root"
13-Dec-2025 21:36:05 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          392.603       479.547       582.158       494.921       54.2633        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00131714    0.00496696    0.00948128    0.00470382    0.00227303       10     
reco:ophit:OpHitFinder                             0.331986      0.424871      0.476161      0.433755      0.0458974       10     
reco:opflash:OpFlashFinder                          0.20095      0.246081      0.290532      0.247699      0.0303238       10     
reco:opslicer:OpSlicer                             0.755891      0.998623       1.23434       1.02816      0.153796        10     
reco:caldata:DataPrepModule                         6.51744       7.59612       8.19499       7.73646      0.537715        10     
reco:wclsdatasp:WireCellToolkit                     41.1248       43.6482       46.0832       43.4339       1.54287        10     
reco:gaushit:GausHitFinder                          1.41717       1.77383       2.00475       1.79747      0.186909        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000581715   0.00113895    0.00203293    0.00082642    0.000551012      10     
reco:reco3d:SpacePointSolver                        13.0905       24.6035       35.2853       24.9375       5.65888        10     
reco:hitpdune:DisambigFromSpacePoints               1.67871       2.50478       3.40207       2.57721      0.540016        10     
reco:pandora:StandardPandora                        33.3589       49.0143       60.7247       51.4149       8.38875        10     
reco:pandoraWriter:StandardPandora                 0.549449      0.733118       1.03337      0.695567      0.139862        10     
reco:pandoraTrack:LArPandoraTrackCreation           4.78229       6.00551       9.34125       5.5279        1.36516        10     
reco:pandoraShower:LArPandoraShowerCreation         3.60962       6.05343       10.0706       5.82818        1.772         10     
reco:pandoracalo:Calorimetry                        1.84695       3.66204       5.05752       3.71642      0.903661        10     
reco:pandoracalonosce:Calorimetry                   2.04159       3.42611       4.92036       3.49522      0.698919        10     
reco:pandorapid:Chi2ParticleID                    0.00501456    0.00923243     0.0130616    0.00931739    0.00219756       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0431326     0.0866011     0.113244      0.0944789     0.0204259       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00515622    0.00879143     0.0113238    0.00913109    0.00175317       10     
reco:pandoraShowercalo:ShowerCalorimetry            3.64038       7.28538       10.788        7.35488       2.41674        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       3.46833       6.81878       9.12663       7.39891       1.83469        10     
reco:emtrkmichelid:EmTrackMichelId                  209.956       248.818       297.538       255.478       25.3481        10     
reco:crttag:SingleCRTMatchingProducer              0.0155236     0.0316517     0.0563768     0.0324671     0.0127205       10     
reco:crtreco:TwoCRTMatchingProducer                0.0099939     0.0167361     0.0246991     0.0173424     0.0051209       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.911428       1.13436       1.36816       1.08008      0.160608        10     
reco:pandora2Track:LArPandoraTrackCreation          12.4917       19.498        25.9526       20.4918       4.0438         10     
reco:pandora2calo:Calorimetry                       6.21596       9.79136       12.2975       10.7803       2.13379        10     
reco:pandora2calonosce:Calorimetry                  5.88477       9.07373       11.599        9.7776        2.04206        10     
reco:pandora2pid:Chi2ParticleID                    0.0119975     0.0210353     0.0260181     0.0217801    0.00405299       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0682511     0.106806      0.132497       0.10922      0.0190783       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0117031     0.0207797     0.0250141     0.021544     0.00406796       10     
reco:pandora2Shower:LArPandoraShowerCreation        4.29643       6.81373       9.98431       6.81029       1.65265        10     
reco:pandora2Showercalo:ShowerCalorimetry           5.22591       8.01162       12.2023       8.18311       2.00096        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      5.13147       7.19566       8.73969       7.64832       1.34634        10     
[art]:TriggerResults:TriggerResultInserter        7.6093e-05    0.00010648    0.000215926   9.24895e-05   3.97632e-05      10     
end_path:out1:RootOutput                          1.0681e-05    1.4275e-05    2.1721e-05    1.32495e-05   3.2938e-06       10     
end_path:out1:RootOutput(write)                     3.13374       3.92236       4.38561       4.05602      0.433277        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5133.09 MB
  Peak resident set size usage (VmHWM): 4233.73 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.35 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.78 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.20 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11015532
-rw-r--r-- 1 pltdune04 pltdune 2547106787 Dec 13 20:13 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2416819110 Dec 13 20:10 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2255034799 Dec 13 21:36 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2032463268 Dec 13 17:37 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1947546876 Dec 13 17:20 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   80319160 Dec 13 21:29 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     243004 Dec 13 21:36 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Dec 13 21:36 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Dec 13 21:36 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Dec 13 21:36 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 13 20:13 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 13 17:37 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 13 21:36 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Dec 13 17:12 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Dec 13 21:36 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Dec 13 20:21 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Dec 13 20:13 debugprod.log
justIN time: 2025-12-18 23:23:56 UTC       justIN version: 01.05.03