justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 282175.1@dunegpschedd01.fnal.gov

Jobsub ID282175.1@dunegpschedd01.fnal.gov
Workflow ID12100
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-19 14:19:12
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat2026-01-19 19:02:10
From worker nodeHostnameheplnc157.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-19 14:20:03
Input filesmonte-carlo-012100-000001
JobscriptExit code0
Real time4h (16835s)
CPU time4h (15883s = 94%)
Max RSS bytes4320624640 (4120 MiB)
Outputting started2026-01-19 19:00:39
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12100/1/001/reco_stage1.root
Finished2026-01-19 19:02:10
Saved logsjustin-logs:282175.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 136931 traces, 0 summary
Retagger: tagging trace set: gauss with 107355 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 107355 traces tagged "gauss"
FrameSaver: q=3.61923e+06 n=1931083 tag=gauss
wclsFrameSaver: saving 136931 traces tagged "wiener"
FrameSaver: q=3.81508e+06 n=1724821 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 46104 XUs and 40779 XVs -> 593 XUVs
C:0 T:1 106081 XUs and 91907 XVs -> 6044 XUVs
C:0 T:2 176180 XUs and 125074 XVs -> 17894 XUVs
C:0 T:3 63740 XUs and 45170 XVs -> 460 XUVs
C:0 T:4 18551 XUs and 15810 XVs -> 622 XUVs
C:0 T:5 63947 XUs and 44479 XVs -> 4141 XUVs
C:0 T:6 58795 XUs and 77491 XVs -> 3107 XUVs
C:0 T:7 27380 XUs and 34304 XVs -> 202 XUVs
C:0 T:8 6271 XUs and 4615 XVs -> 35 XUVs
C:0 T:9 35566 XUs and 36058 XVs -> 2102 XUVs
C:0 T:10 56533 XUs and 84597 XVs -> 12752 XUVs
C:0 T:11 24 XUs and 12 XVs -> 4 XUVs
47956 XUVs total
12321 collection wire objects
43694 potential space points
Neighbour search...
7747788 tests to find 3264438 neighbours
Iterating with no regularization...
Begin: 7.42903e+07
0 6.10765e+07
1 6.02906e+07
2 6.017e+07
3 6.0133e+07
Now with regularization...
Begin: 5.0881e+07
0 5.0837e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411838275
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411838275
fLifetime: 30000 [us]
19-Jan-2026 19:00:37 GMT  Closed output file "reco_stage1.root"
19-Jan-2026 19:00:37 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          362.547       496.708       631.824       475.191       84.0382        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00133475    0.00501151    0.00801338    0.00520971    0.00215283       10     
reco:ophit:OpHitFinder                              0.32994      0.417073      0.517955      0.418518      0.0500286       10     
reco:opflash:OpFlashFinder                          0.18746      0.251106      0.329209      0.242982      0.0398659       10     
reco:opslicer:OpSlicer                             0.845148       1.04171       1.43585      0.996394      0.182597        10     
reco:caldata:DataPrepModule                         6.49356       7.70204       8.33889       7.86133      0.482576        10     
reco:wclsdatasp:WireCellToolkit                     41.8156       43.7382       45.9168       43.3916       1.49804        10     
reco:gaushit:GausHitFinder                          1.44952       1.85513       2.24019       1.89334      0.261822        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000572886   0.000763472   0.000982395   0.000776964   0.000143303      10     
reco:reco3d:SpacePointSolver                        20.5221       26.2513       31.0135       26.341        3.66991        10     
reco:hitpdune:DisambigFromSpacePoints               1.91084       2.60192       3.6008        2.38738      0.569421        10     
reco:pandora:StandardPandora                        28.0866       46.3847       67.9626       40.1064       15.1677        10     
reco:pandoraWriter:StandardPandora                 0.521446      0.680345      0.804144      0.665892      0.0968628       10     
reco:pandoraTrack:LArPandoraTrackCreation           3.51504       6.57545       8.6357        7.07702       1.45883        10     
reco:pandoraShower:LArPandoraShowerCreation         3.20086       7.37544       12.2454       7.16287       2.74601        10     
reco:pandoracalo:Calorimetry                        2.19046       3.74319       4.92567       3.78207      0.836393        10     
reco:pandoracalonosce:Calorimetry                   1.84302       3.38592       4.62439       3.37899      0.791586        10     
reco:pandorapid:Chi2ParticleID                    0.00713108    0.00886181     0.0101997    0.00903823    0.000928233      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0686878     0.0855653     0.102919      0.0841769     0.0116948       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00744042    0.00859613    0.00984958    0.00834745    0.000789192      10     
reco:pandoraShowercalo:ShowerCalorimetry            2.8487        7.70896       11.6683       6.75425       2.88686        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       3.19926       7.28878       10.6075       6.82078       2.48258        10     
reco:emtrkmichelid:EmTrackMichelId                  200.394       257.74        310.462       250.613       35.5735        10     
reco:crttag:SingleCRTMatchingProducer              0.0154082     0.0222197     0.0311085     0.0200763     0.0057257       10     
reco:crtreco:TwoCRTMatchingProducer               0.00945043     0.0139674     0.0211137     0.0128397    0.00397155       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.961892       1.16057       1.38322       1.11727      0.151374        10     
reco:pandora2Track:LArPandoraTrackCreation           10.87        21.1013       32.5904       20.1457       6.60724        10     
reco:pandora2calo:Calorimetry                       5.1152        10.4517       15.9304       9.85768       3.1821         10     
reco:pandora2calonosce:Calorimetry                  4.51761       9.96008       16.1148       9.35865       3.33065        10     
reco:pandora2pid:Chi2ParticleID                   0.00970696     0.0209234     0.0269554     0.0210352    0.00466081       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0668358      0.11199      0.152981      0.109473      0.0231515       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.015471      0.0213644     0.0259713     0.021381     0.00330537       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.55314       7.48197       12.3869       7.45595       2.38231        10     
reco:pandora2Showercalo:ShowerCalorimetry            4.283        9.07011       14.7711       8.98734       2.93126        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      4.25412       8.18205       13.6525       7.56225       2.70246        10     
[art]:TriggerResults:TriggerResultInserter        6.9851e-05    0.000105257   0.000211797   9.1592e-05    4.04625e-05      10     
end_path:out1:RootOutput                          1.2633e-05    1.46596e-05   2.3844e-05    1.34605e-05   3.20685e-06      10     
end_path:out1:RootOutput(write)                     2.68526       4.09097       4.86955       4.14547      0.669237        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5214.43 MB
  Peak resident set size usage (VmHWM): 4320.62 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.35 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.86 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.21 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11048036
-rw-r--r-- 1 pltdune04 pltdune 2556282972 Jan 19 17:35 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2426590509 Jan 19 17:32 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2270463471 Jan 19 19:00 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2023450585 Jan 19 14:52 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1955002165 Jan 19 14:31 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   80781710 Jan 19 18:54 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     242916 Jan 19 19:00 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Jan 19 19:00 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Jan 19 19:00 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Jan 19 19:00 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Jan 19 17:35 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Jan 19 14:52 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Jan 19 19:00 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Jan 19 14:20 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Jan 19 19:00 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Jan 19 17:42 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Jan 19 17:35 debugprod.log
justIN time: 2026-02-05 17:08:42 UTC       justIN version: 01.06.00