justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 229905.0@dunegpschedd02.fnal.gov

Jobsub ID229905.0@dunegpschedd02.fnal.gov
Workflow ID9084
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-17 10:20:52
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce2
Last heartbeat2025-10-17 13:57:41
From worker nodeHostnamewn046.hep
cpuinfoAMD EPYC 7402 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-17 10:22:52
Input filesmonte-carlo-009084-000001
JobscriptExit code0
Real time3h (12018s)
CPU time3h (11586s = 96%)
Max RSS bytes4525457408 (4315 MiB)
Outputting started2025-10-17 13:43:12
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09084/1/001/reco_stage1.root
Finished2025-10-17 13:57:41
Saved logsjustin-logs:229905.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

sedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 145920 traces, 0 summary
Retagger: tagging trace set: gauss with 113624 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 113624 traces tagged "gauss"
FrameSaver: q=3.83986e+06 n=2011811 tag=gauss
wclsFrameSaver: saving 145920 traces tagged "wiener"
FrameSaver: q=4.04052e+06 n=1786670 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 24687 XUs and 27535 XVs -> 315 XUVs
C:0 T:1 43593 XUs and 43829 XVs -> 2715 XUVs
C:0 T:2 126147 XUs and 144088 XVs -> 9587 XUVs
C:0 T:3 59197 XUs and 57274 XVs -> 1259 XUVs
C:0 T:4 17424 XUs and 15830 XVs -> 158 XUVs
C:0 T:5 70797 XUs and 48902 XVs -> 6687 XUVs
C:0 T:6 89021 XUs and 108941 XVs -> 7452 XUVs
C:0 T:7 36704 XUs and 44159 XVs -> 716 XUVs
C:0 T:8 10633 XUs and 11487 XVs -> 116 XUVs
C:0 T:9 96377 XUs and 97332 XVs -> 7270 XUVs
C:0 T:10 57184 XUs and 32690 XVs -> 6148 XUVs
C:0 T:11 58 XUs and 73 XVs -> 4 XUVs
42427 XUVs total
12458 collection wire objects
35361 potential space points
Neighbour search...
3099617 tests to find 1546562 neighbours
Iterating with no regularization...
Begin: 7.79648e+07
0 6.70871e+07
1 6.638e+07
2 6.62685e+07
3 6.62344e+07
Now with regularization...
Begin: 5.50242e+07
0 5.50153e+07
PcaShowerParticleBuildingAlgorithm::OpeningAngle - principal eigenvalue less than or equal to 0.
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 409944016
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 409944016
fLifetime: 30000 [us]
17-Oct-2025 14:43:09 BST  Closed output file "reco_stage1.root"
17-Oct-2025 14:43:09 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          275.304       395.403       511.629       391.659       62.509         10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000934309   0.00367645    0.00553016    0.00397991    0.00140922       10     
reco:ophit:OpHitFinder                             0.210857       0.30738      0.455185      0.273226      0.0755658       10     
reco:opflash:OpFlashFinder                         0.126637       0.20527      0.308177      0.186122      0.0560888       10     
reco:opslicer:OpSlicer                             0.455068      0.782937       1.27153      0.656938      0.270067        10     
reco:caldata:DataPrepModule                         4.25535       5.08268        6.753        4.42224       1.01631        10     
reco:wclsdatasp:WireCellToolkit                     29.3889       33.7473       40.6736       32.4652       3.5137         10     
reco:gaushit:GausHitFinder                          0.80684       1.05125       1.48118       1.01565      0.170041        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000455518   0.000629408   0.000783255   0.000615814   9.81577e-05      10     
reco:reco3d:SpacePointSolver                        6.59229       14.6334       23.4683       13.8146       4.3463         10     
reco:hitpdune:DisambigFromSpacePoints              0.941779       1.61133       2.1308        1.57659      0.319197        10     
reco:pandora:StandardPandora                        17.6336       35.8409       51.4577       35.0702       10.5081        10     
reco:pandoraWriter:StandardPandora                 0.436372      0.616744      0.890096      0.639044      0.130683        10     
reco:pandoraTrack:LArPandoraTrackCreation           2.46147       4.85847       7.82722       4.61919       1.40056        10     
reco:pandoraShower:LArPandoraShowerCreation         2.46659       4.97961       8.34501       4.62871       1.6351         10     
reco:pandoracalo:Calorimetry                        1.33334       2.33117       3.2063        2.27079      0.496538        10     
reco:pandoracalonosce:Calorimetry                   1.19645       2.09403       3.01833        2.084       0.482783        10     
reco:pandorapid:Chi2ParticleID                    0.00437291    0.00564783    0.00744336    0.00549445    0.000818657      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0403743     0.0551284     0.0742683     0.0540189     0.0082292       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00418537    0.00535042    0.00711434    0.00531744    0.000758488      10     
reco:pandoraShowercalo:ShowerCalorimetry            2.44331       4.70564       7.26552       4.60325       1.32692        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.36242       4.52947       7.07002       4.29345       1.33466        10     
reco:emtrkmichelid:EmTrackMichelId                  168.286       227.526       301.825       227.779       35.1974        10     
reco:crttag:SingleCRTMatchingProducer             0.00973289     0.0166112     0.0216486     0.016871     0.00387372       10     
reco:crtreco:TwoCRTMatchingProducer               0.00598235    0.00963355     0.0140367    0.00927466    0.00222252       10     
reco:anodepiercerst0:T0RecoAnodePiercers            0.64714      0.875799       1.0248       0.885965      0.112237        10     
reco:pandora2Track:LArPandoraTrackCreation          9.46253       15.7701       22.9705       14.8071       3.91095        10     
reco:pandora2calo:Calorimetry                       4.4737        6.98502       9.97557       6.07796       1.90173        10     
reco:pandora2calonosce:Calorimetry                  4.76056       6.43413       9.8454        5.77152       1.58603        10     
reco:pandora2pid:Chi2ParticleID                    0.0114712     0.0147042     0.0239714     0.0141344    0.00340813       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0527163     0.0705106     0.121026      0.0655374     0.0182832       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0110797     0.014415      0.0235325     0.0139246    0.00334159       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.12888       5.44183       7.75505       4.9503        1.41906        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.24813       5.50416       7.90636       5.4633        1.14051        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      2.94133       5.3827        9.52621       4.98664       1.66422        10     
[art]:TriggerResults:TriggerResultInserter        4.1328e-05    5.52522e-05   0.000112832   4.80755e-05   2.02618e-05      10     
end_path:out1:RootOutput                          1.0199e-05    1.25026e-05   1.6571e-05    1.17175e-05   1.9802e-06       10     
end_path:out1:RootOutput(write)                     2.49751       3.77672       5.10106       3.78128      0.748944        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5342.7 MB
  Peak resident set size usage (VmHWM): 4525.46 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.21 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.14 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.12 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11127944
-rw-r--r--. 1 dune004 dune 2586402238 Oct 17 13:34 detsim_stage2.root
-rw-r--r--. 1 dune004 dune 2452722428 Oct 17 13:32 detsim_stage1.root
-rw-r--r--. 1 dune004 dune 2318550902 Oct 17 14:43 reco_stage1.root
-rw-r--r--. 1 dune004 dune 2024368244 Oct 17 11:43 g4_stage2.root
-rw-r--r--. 1 dune004 dune 1926667664 Oct 17 11:30 g4_stage1.root
-rw-r--r--. 1 dune004 dune   85685840 Oct 17 14:38 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune     243225 Oct 17 14:43 jobscript.log
-rw-r--r--. 1 dune004 dune     217088 Oct 17 14:43 mem.db
-rw-r--r--. 1 dune004 dune      62376 Oct 17 14:43 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune      36864 Oct 17 14:43 time.db
-rw-r--r--. 1 dune004 dune        519 Oct 17 13:34 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 17 11:43 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 17 14:43 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune004 dune         52 Oct 17 11:22 all-input-dids.txt
-rw-r--r--. 1 dune004 dune          7 Oct 17 14:43 justin-processed-pfns.txt
-rw-r--r--. 1 dune004 dune          0 Oct 17 13:41 ProtoDUNE.log
-rw-r--r--. 1 dune004 dune          0 Oct 17 13:34 debugprod.log
justIN time: 2025-11-03 18:43:35 UTC       justIN version: 01.05.01