justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 232882.1@dunegpschedd02.fnal.gov

Jobsub ID232882.1@dunegpschedd02.fnal.gov
Workflow ID9335
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-25 14:37:25
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce2
Last heartbeat2025-10-25 19:35:48
From worker nodeHostnamewn039.hep
cpuinfoAMD EPYC 7402 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-25 14:38:38
Input filesmonte-carlo-009335-000001
JobscriptExit code0
Real time4h (15491s)
CPU time4h (14940s = 96%)
Max RSS bytes4327534592 (4127 MiB)
Outputting started2025-10-25 18:56:51
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09335/1/001/reco_stage1.root
Finished2025-10-25 19:35:48
Saved logsjustin-logs:232882.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

igitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 127364 traces, 0 summary
Retagger: tagging trace set: gauss with 96146 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 96146 traces tagged "gauss"
FrameSaver: q=3.32909e+06 n=1712029 tag=gauss
wclsFrameSaver: saving 127364 traces tagged "wiener"
FrameSaver: q=3.5256e+06 n=1508735 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 30349 XUs and 28024 XVs -> 409 XUVs
C:0 T:1 83533 XUs and 62574 XVs -> 9149 XUVs
C:0 T:2 101955 XUs and 101148 XVs -> 5158 XUVs
C:0 T:3 47957 XUs and 47992 XVs -> 210 XUVs
C:0 T:4 12556 XUs and 8759 XVs -> 106 XUVs
C:0 T:5 60399 XUs and 31072 XVs -> 6174 XUVs
C:0 T:6 124969 XUs and 115126 XVs -> 9631 XUVs
C:0 T:7 37762 XUs and 32583 XVs -> 290 XUVs
C:0 T:8 7201 XUs and 6241 XVs -> 148 XUVs
C:0 T:9 67379 XUs and 55452 XVs -> 11797 XUVs
C:0 T:10 47175 XUs and 75881 XVs -> 8914 XUVs
C:0 T:11 70 XUs and 38 XVs -> 10 XUVs
51996 XUVs total
12159 collection wire objects
48085 potential space points
Neighbour search...
8887795 tests to find 3962874 neighbours
Iterating with no regularization...
Begin: 6.50839e+07
0 5.37351e+07
1 5.30217e+07
2 5.29072e+07
3 5.28688e+07
Now with regularization...
Begin: 4.33413e+07
0 4.327e+07
1 4.32241e+07
2 4.31911e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410108566
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410108566
fLifetime: 30000 [us]
25-Oct-2025 19:56:48 BST  Closed output file "reco_stage1.root"
25-Oct-2025 19:56:48 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          389.818       532.455       748.476       512.921       101.61         10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00104819    0.00536266    0.00869984    0.00553941    0.00220385       10     
reco:ophit:OpHitFinder                             0.354029      0.390587      0.461092      0.382374      0.0352647       10     
reco:opflash:OpFlashFinder                         0.195008       0.2254       0.288456      0.217887      0.029829        10     
reco:opslicer:OpSlicer                             0.921572       1.0609        1.34861       1.02474      0.126349        10     
reco:caldata:DataPrepModule                         6.55696       6.84986       7.10026       6.87378      0.179992        10     
reco:wclsdatasp:WireCellToolkit                     39.2546       43.5656       46.934        43.8983       2.10237        10     
reco:gaushit:GausHitFinder                          1.16912       1.69237       2.33631       1.67271      0.298761        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000684161   0.000866724   0.00106912    0.000869497   0.000123318      10     
reco:reco3d:SpacePointSolver                        13.5623       21.1773       36.8717       18.3726       7.03433        10     
reco:hitpdune:DisambigFromSpacePoints               1.31537       2.38371       3.8021        2.4329       0.665271        10     
reco:pandora:StandardPandora                        36.0661       55.1427       117.449       46.4228       23.1979        10     
reco:pandoraWriter:StandardPandora                 0.544379      0.857836       1.20941      0.886906      0.179103        10     
reco:pandoraTrack:LArPandoraTrackCreation           3.20987       6.05836       9.85855       5.58784       1.95232        10     
reco:pandoraShower:LArPandoraShowerCreation         3.28193       6.8683        12.2452       6.67936       2.69997        10     
reco:pandoracalo:Calorimetry                        1.7332        3.18376       4.81449       3.03558      0.907454        10     
reco:pandoracalonosce:Calorimetry                   1.5803        2.93832       4.53465       2.8376       0.860219        10     
reco:pandorapid:Chi2ParticleID                     0.0062317    0.00817612     0.0110428    0.00764208    0.00166613       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0668135     0.0849323     0.111995      0.0815729     0.0125967       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00546266    0.00759238    0.00952066    0.00748279    0.00126111       10     
reco:pandoraShowercalo:ShowerCalorimetry            3.1196        6.94334       12.8631       6.70183       2.75265        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.95954       6.66801       12.1449       6.37899       2.62478        10     
reco:emtrkmichelid:EmTrackMichelId                  234.641       300.874       382.517       292.529       43.7529        10     
reco:crttag:SingleCRTMatchingProducer              0.0120622     0.0201865     0.0281937     0.0183844    0.00531387       10     
reco:crtreco:TwoCRTMatchingProducer               0.00914363     0.0139321     0.0291526     0.0118797    0.00556731       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.899018       1.10714       1.39605       1.07556      0.125422        10     
reco:pandora2Track:LArPandoraTrackCreation          10.5263       20.2403       33.9685       19.5503       6.76877        10     
reco:pandora2calo:Calorimetry                       4.69166       9.24765       15.1257       8.88718       3.02545        10     
reco:pandora2calonosce:Calorimetry                  4.3271        8.69393       14.2408       8.15252       2.82186        10     
reco:pandora2pid:Chi2ParticleID                    0.0156466     0.0204311     0.0259136     0.0200569    0.00293215       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0827761     0.106165      0.127991      0.104168      0.0129004       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0148894     0.0197867     0.0241317     0.0193478     0.0028155       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.95431       7.0373        11.2214       6.72651       2.08138        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.94681       7.61133       12.6055       7.11106       2.36981        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.59221       6.79546       10.4884       6.72083       1.89339        10     
[art]:TriggerResults:TriggerResultInserter        7.1014e-05    9.21978e-05   0.000208914   8.2205e-05    3.95249e-05      10     
end_path:out1:RootOutput                          1.1993e-05    1.42489e-05     2.1e-05     1.3876e-05    2.40664e-06      10     
end_path:out1:RootOutput(write)                     3.42211       4.38444       5.61785       4.43597      0.669339        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5152.93 MB
  Peak resident set size usage (VmHWM): 4327.53 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.12 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.30 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.25 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.16 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10694232
-rw-r--r--. 1 dune004 dune 2497021020 Oct 25 18:25 detsim_stage2.root
-rw-r--r--. 1 dune004 dune 2362573723 Oct 25 18:21 detsim_stage1.root
-rw-r--r--. 1 dune004 dune 2207593047 Oct 25 19:56 reco_stage1.root
-rw-r--r--. 1 dune004 dune 1946967119 Oct 25 16:04 g4_stage2.root
-rw-r--r--. 1 dune004 dune 1855299968 Oct 25 15:46 g4_stage1.root
-rw-r--r--. 1 dune004 dune   80819330 Oct 25 19:51 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune     243086 Oct 25 19:56 jobscript.log
-rw-r--r--. 1 dune004 dune     217088 Oct 25 19:56 mem.db
-rw-r--r--. 1 dune004 dune      62376 Oct 25 19:56 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune      36864 Oct 25 19:56 time.db
-rw-r--r--. 1 dune004 dune        519 Oct 25 18:25 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 25 16:04 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 25 19:56 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune004 dune         52 Oct 25 15:38 all-input-dids.txt
-rw-r--r--. 1 dune004 dune          7 Oct 25 19:56 justin-processed-pfns.txt
-rw-r--r--. 1 dune004 dune          0 Oct 25 18:33 ProtoDUNE.log
-rw-r--r--. 1 dune004 dune          0 Oct 25 18:25 debugprod.log
justIN time: 2025-11-03 18:41:14 UTC       justIN version: 01.05.01