justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 270481.0@dunegpschedd01.fnal.gov

Jobsub ID270481.0@dunegpschedd01.fnal.gov
Workflow ID11376
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-28 08:49:45
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep206
Last heartbeat2025-12-28 13:15:28
From worker nodeHostnameheplnc159.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-28 08:50:57
Input filesmonte-carlo-011376-000001
JobscriptExit code0
Real time4h (15786s)
CPU time4h (15193s = 96%)
Max RSS bytes4442148864 (4236 MiB)
Outputting started2025-12-28 13:14:04
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11376/1/001/reco_stage1.root
Finished2025-12-28 13:15:28
Saved logsjustin-logs:270481.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

dRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 145900 traces, 0 summary
Retagger: tagging trace set: gauss with 107176 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 107176 traces tagged "gauss"
FrameSaver: q=3.63937e+06 n=1863905 tag=gauss
wclsFrameSaver: saving 145900 traces tagged "wiener"
FrameSaver: q=3.85981e+06 n=1624917 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 44903 XUs and 54811 XVs -> 948 XUVs
C:0 T:1 147046 XUs and 132093 XVs -> 27711 XUVs
C:0 T:2 130781 XUs and 199994 XVs -> 13261 XUVs
C:0 T:3 55902 XUs and 65793 XVs -> 452 XUVs
C:0 T:4 10118 XUs and 14636 XVs -> 85 XUVs
C:0 T:5 42972 XUs and 52319 XVs -> 4773 XUVs
C:0 T:6 129366 XUs and 120916 XVs -> 8089 XUVs
C:0 T:7 44279 XUs and 41241 XVs -> 496 XUVs
C:0 T:8 3480 XUs and 5030 XVs -> 57 XUVs
C:0 T:9 19723 XUs and 34178 XVs -> 2492 XUVs
C:0 T:10 28931 XUs and 12749 XVs -> 2830 XUVs
C:0 T:11 41 XUs and 18 XVs -> 3 XUVs
61197 XUVs total
14041 collection wire objects
55655 potential space points
Neighbour search...
8402361 tests to find 3634938 neighbours
Iterating with no regularization...
Begin: 6.83901e+07
0 4.86518e+07
1 4.74336e+07
2 4.71956e+07
3 4.71189e+07
4 4.70855e+07
Now with regularization...
Begin: 3.71548e+07
0 3.71073e+07
1 3.70711e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411391093
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411391093
fLifetime: 30000 [us]
28-Dec-2025 13:14:01 GMT  Closed output file "reco_stage1.root"
28-Dec-2025 13:14:01 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          374.502       533.957       1090.43       465.386       200.312        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00132865    0.00488225    0.00874697    0.00456008    0.00240322       10     
reco:ophit:OpHitFinder                             0.265962      0.398025      0.524112      0.402643      0.065495        10     
reco:opflash:OpFlashFinder                         0.181125      0.243938       0.38679      0.249678      0.0588213       10     
reco:opslicer:OpSlicer                             0.547054      0.913955       1.37342      0.905901      0.239976        10     
reco:caldata:DataPrepModule                         5.47293       6.91484       7.71844       7.18257      0.766826        10     
reco:wclsdatasp:WireCellToolkit                     35.5099       40.6139       45.2068       41.4427       3.08456        10     
reco:gaushit:GausHitFinder                         0.834442       1.43451       2.41121       1.3177       0.469945        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000442994   0.000701196   0.000913911   0.000746109   0.000146174      10     
reco:reco3d:SpacePointSolver                        14.4427       25.3209       45.1159       23.8605        8.22          10     
reco:hitpdune:DisambigFromSpacePoints               1.52365       2.42546       4.15467       2.29108      0.862184        10     
reco:pandora:StandardPandora                        24.4275       109.218       552.011       43.3009       155.737        10     
reco:pandoraWriter:StandardPandora                 0.403117      0.571241      0.895252      0.523129      0.162831        10     
reco:pandoraTrack:LArPandoraTrackCreation           4.46267       7.21486       15.0712       5.66486       3.14537        10     
reco:pandoraShower:LArPandoraShowerCreation         3.42451       6.60338       11.5985       5.86163       2.36449        10     
reco:pandoracalo:Calorimetry                        2.68736       3.80784       5.96999       3.78495       1.02344        10     
reco:pandoracalonosce:Calorimetry                   2.32168       3.29906       5.17693       3.56126      0.864107        10     
reco:pandorapid:Chi2ParticleID                    0.00495046    0.00769016     0.0108076    0.00793319     0.0015873       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0423036     0.0691626     0.0904177     0.0730857     0.0169637       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00486526    0.00810947     0.0111399    0.00779529    0.00196402       10     
reco:pandoraShowercalo:ShowerCalorimetry            3.75874       6.63538       8.64432       6.90686       1.29775        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       3.5096        6.52982       7.66432       6.76086       1.16128        10     
reco:emtrkmichelid:EmTrackMichelId                  195.108       242.733       284.785       244.882       28.2093        10     
reco:crttag:SingleCRTMatchingProducer              0.0146709     0.0189965     0.0246642     0.0188666    0.00279228       10     
reco:crtreco:TwoCRTMatchingProducer               0.00904361     0.0125461     0.0163308     0.0131695     0.0019428       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.899286       1.10829       1.44241       1.11072      0.151529        10     
reco:pandora2Track:LArPandoraTrackCreation          11.8184       20.3727       30.5604       20.0518       5.02101        10     
reco:pandora2calo:Calorimetry                       6.17321       10.2056       14.5995       9.29818       2.79782        10     
reco:pandora2calonosce:Calorimetry                  6.24533       9.97119       15.4264       8.86016       3.1838         10     
reco:pandora2pid:Chi2ParticleID                    0.0110348     0.0212973     0.0295893     0.0214025    0.00616183       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0579913     0.100137      0.131137      0.103621      0.0223121       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.011543      0.0208421     0.0291482     0.0206361    0.00596551       10     
reco:pandora2Shower:LArPandoraShowerCreation        4.60116       7.15064       10.3827       6.79395       1.86071        10     
reco:pandora2Showercalo:ShowerCalorimetry           5.86864       8.80712       12.5195       8.89211       1.96666        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      5.21804       7.32089       10.8068       7.44534       1.42179        10     
[art]:TriggerResults:TriggerResultInserter        6.0604e-05    0.000101009   0.000196169   7.73905e-05   4.18939e-05      10     
end_path:out1:RootOutput                          1.2724e-05    1.51918e-05   2.3264e-05    1.4463e-05    2.95792e-06      10     
end_path:out1:RootOutput(write)                     2.75849       3.71511       4.77947       3.61393       0.59333        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5316.58 MB
  Peak resident set size usage (VmHWM): 4442.15 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.31 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.38 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.18 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11033792
-rw-r--r-- 1 pltdune04 pltdune 2570920125 Dec 28 11:42 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2440755385 Dec 28 11:40 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2291369849 Dec 28 13:14 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 1990858707 Dec 28 09:14 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1920188446 Dec 28 08:58 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   83892290 Dec 28 13:08 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     243080 Dec 28 13:14 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Dec 28 13:14 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Dec 28 13:14 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Dec 28 13:14 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 28 11:42 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 28 09:14 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Dec 28 13:14 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Dec 28 08:50 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Dec 28 13:14 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Dec 28 11:50 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Dec 28 11:42 debugprod.log
justIN time: 2026-02-07 02:18:59 UTC       justIN version: 01.06.00