justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255664.0@dunegpschedd01.fnal.gov

Jobsub ID255664.0@dunegpschedd01.fnal.gov
Workflow ID10537
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-11-23 12:38:51
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep206
Last heartbeat2025-11-23 16:10:23
From worker nodeHostnameheplnc160.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-23 12:39:36
Input filesmonte-carlo-010537-000001
JobscriptExit code0
Real time3h (11826s)
CPU time3h (11270s = 95%)
Max RSS bytes3965374464 (3781 MiB)
Outputting started2025-11-23 15:56:43
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10537/1/001/reco_stage1.root
Finished2025-11-23 16:10:23
Saved logsjustin-logs:255664.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 95904 traces, 0 summary
Retagger: tagging trace set: gauss with 75422 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 75422 traces tagged "gauss"
FrameSaver: q=2.75995e+06 n=1327117 tag=gauss
wclsFrameSaver: saving 95904 traces tagged "wiener"
FrameSaver: q=2.92953e+06 n=1193122 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 28060 XUs and 34347 XVs -> 468 XUVs
C:0 T:1 52295 XUs and 108740 XVs -> 7983 XUVs
C:0 T:2 33395 XUs and 51854 XVs -> 2820 XUVs
C:0 T:3 17466 XUs and 20485 XVs -> 150 XUVs
C:0 T:4 8106 XUs and 10426 XVs -> 129 XUVs
C:0 T:5 23955 XUs and 22362 XVs -> 2863 XUVs
C:0 T:6 29045 XUs and 26068 XVs -> 2859 XUVs
C:0 T:7 10387 XUs and 7826 XVs -> 110 XUVs
C:0 T:8 9343 XUs and 10090 XVs -> 86 XUVs
C:0 T:9 50863 XUs and 73132 XVs -> 5477 XUVs
C:0 T:10 48734 XUs and 17332 XVs -> 3406 XUVs
C:0 T:11 136 XUs and 59 XVs -> 10 XUVs
26361 XUVs total
7957 collection wire objects
22839 potential space points
Neighbour search...
1906359 tests to find 951210 neighbours
Iterating with no regularization...
Begin: 8.52995e+07
0 6.20655e+07
1 6.11076e+07
2 6.10404e+07
3 6.10273e+07
Now with regularization...
Begin: 5.15627e+07
0 5.14944e+07
1 5.14798e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410690272
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410690272
fLifetime: 30000 [us]
23-Nov-2025 15:56:41 GMT  Closed output file "reco_stage1.root"
23-Nov-2025 15:56:41 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          231.944       348.029       459.329       344.156       65.0245        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00213993    0.00418675    0.00986096    0.00357817    0.00221524       10     
reco:ophit:OpHitFinder                             0.240566      0.337444      0.402329      0.348509      0.054261        10     
reco:opflash:OpFlashFinder                         0.102943      0.166089      0.201858      0.167987      0.0294402       10     
reco:opslicer:OpSlicer                             0.489812      0.741518       1.03222      0.717726      0.169762        10     
reco:caldata:DataPrepModule                         5.44956       6.92942       8.07318       7.21962      0.856588        10     
reco:wclsdatasp:WireCellToolkit                     29.9819       36.6795       40.3323       37.3701       3.11676        10     
reco:gaushit:GausHitFinder                         0.794463       1.31498       1.81987       1.24361      0.367077        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000311253   0.000609837   0.000859679   0.000662384   0.000158874      10     
reco:reco3d:SpacePointSolver                        5.4495        14.9819       23.0198       15.5183       5.05729        10     
reco:hitpdune:DisambigFromSpacePoints              0.865729       1.60277       2.40806       1.53354      0.532312        10     
reco:pandora:StandardPandora                        17.4938       31.3031       48.3346       28.8454       9.5828         10     
reco:pandoraWriter:StandardPandora                 0.288686      0.496165      0.658472      0.471328      0.119331        10     
reco:pandoraTrack:LArPandoraTrackCreation           2.04106       3.57923       6.38824       3.17711       1.16369        10     
reco:pandoraShower:LArPandoraShowerCreation         1.41811       3.88447       7.0659        3.37142       1.62972        10     
reco:pandoracalo:Calorimetry                        1.1913        2.1358        3.30989       2.05416      0.596574        10     
reco:pandoracalonosce:Calorimetry                   1.05163       1.8377        3.31701       1.63356      0.644106        10     
reco:pandorapid:Chi2ParticleID                    0.00366298    0.00595257    0.00936377    0.00609569    0.00186339       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.038115      0.0545757     0.089693      0.0468918     0.0190444       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00377917    0.00541211     0.0076835    0.00478265    0.00145648       10     
reco:pandoraShowercalo:ShowerCalorimetry            1.60822       3.72853       6.61733       3.70237       1.54721        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       1.86624       3.74862       5.89295       3.74814       1.38563        10     
reco:emtrkmichelid:EmTrackMichelId                  136.006       192.433       244.11        192.006       31.2075        10     
reco:crttag:SingleCRTMatchingProducer              0.0118252     0.0163325     0.0233234     0.0150121    0.00380769       10     
reco:crtreco:TwoCRTMatchingProducer               0.00542372    0.00912513     0.0129578    0.00890484    0.00219596       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.602968      0.859368       1.10799      0.863352      0.147946        10     
reco:pandora2Track:LArPandoraTrackCreation          4.74503       11.7685       19.8413       11.3791       4.64007        10     
reco:pandora2calo:Calorimetry                       2.50304       6.11539       10.2569       6.12148       2.2849         10     
reco:pandora2calonosce:Calorimetry                  2.51817       5.71005       10.0003       5.13233       2.41125        10     
reco:pandora2pid:Chi2ParticleID                   0.00913523     0.0158429     0.0249029     0.0149981    0.00538054       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0443668     0.0841498     0.119088      0.0781479     0.0235964       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00876942     0.0159666     0.0238134     0.0161163    0.00502238       10     
reco:pandora2Shower:LArPandoraShowerCreation        1.74158       4.45134       6.97594       3.95743       1.60326        10     
reco:pandora2Showercalo:ShowerCalorimetry           2.06346       5.10495       8.20985       4.7717        1.72348        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      1.94519       4.60581       7.04096       4.41397       1.57469        10     
[art]:TriggerResults:TriggerResultInserter        4.2148e-05    7.42317e-05   0.000148848   6.8869e-05    2.65737e-05      10     
end_path:out1:RootOutput                           9.889e-06    1.89926e-05   3.7109e-05    1.57695e-05   8.50104e-06      10     
end_path:out1:RootOutput(write)                     1.91725       3.17966       4.06489       3.22172      0.556218        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4819.59 MB
  Peak resident set size usage (VmHWM): 3965.37 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.32 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.37 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.19 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9462460
-rw-r--r-- 1 pltdune04 pltdune 2245453603 Nov 23 14:56 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2133696506 Nov 23 14:54 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 1903690698 Nov 23 15:56 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 1706129815 Nov 23 12:59 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1631495068 Nov 23 12:46 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   68477550 Nov 23 15:53 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     242726 Nov 23 15:56 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Nov 23 15:56 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Nov 23 15:56 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Nov 23 15:56 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Nov 23 14:56 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Nov 23 12:59 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Nov 23 15:56 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Nov 23 12:39 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Nov 23 15:56 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Nov 23 15:01 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Nov 23 14:56 debugprod.log
justIN time: 2026-02-08 21:32:27 UTC       justIN version: 01.06.00