justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 20846.0@dunegpschedd01.fnal.gov

Jobsub ID20846.0@dunegpschedd01.fnal.gov
Workflow ID376
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-08-04 18:10:09
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce02
Last heartbeat2025-08-04 22:37:16
From worker nodeHostnamecn510.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-08-04 18:18:18
Input filesmonte-carlo-000376-000001
JobscriptExit code0
Real time4h (15338s)
CPU time4h (15044s = 98%)
Max RSS bytes3993559040 (3808 MiB)
Outputting started2025-08-04 22:33:57
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/00376/1/001/reco_stage1.root
Finished2025-08-04 22:37:16
Saved logsjustin-logs:20846.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

re:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 95344 traces, 0 summary
Retagger: tagging trace set: gauss with 72207 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 72207 traces tagged "gauss"
FrameSaver: q=2.52328e+06 n=1287612 tag=gauss
wclsFrameSaver: saving 95344 traces tagged "wiener"
FrameSaver: q=2.67121e+06 n=1140676 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 17451 XUs and 22833 XVs -> 143 XUVs
C:0 T:1 29507 XUs and 47178 XVs -> 3813 XUVs
C:0 T:2 179126 XUs and 127328 XVs -> 17075 XUVs
C:0 T:3 61873 XUs and 33359 XVs -> 458 XUVs
C:0 T:4 7947 XUs and 9689 XVs -> 103 XUVs
C:0 T:5 19567 XUs and 20256 XVs -> 2851 XUVs
C:0 T:6 112816 XUs and 76196 XVs -> 4680 XUVs
C:0 T:7 40393 XUs and 27725 XVs -> 347 XUVs
C:0 T:8 3683 XUs and 2765 XVs -> 30 XUVs
C:0 T:9 17425 XUs and 16164 XVs -> 1005 XUVs
C:0 T:10 31004 XUs and 31375 XVs -> 6660 XUVs
C:0 T:11 89 XUs and 40 XVs -> 8 XUVs
37173 XUVs total
9139 collection wire objects
34303 potential space points
Neighbour search...
6053639 tests to find 2595366 neighbours
Iterating with no regularization...
Begin: 6.44573e+07
0 5.12604e+07
1 5.05956e+07
2 5.05003e+07
3 5.04701e+07
Now with regularization...
Begin: 4.34358e+07
0 4.3394e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 408461888
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 408461888
fLifetime: 30000 [us]
04-Aug-2025 23:33:54 BST  Closed output file "reco_stage1.root"
04-Aug-2025 23:33:54 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          388.724       639.261       909.066       637.217       186.528        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00167432    0.00432139    0.00768154    0.00377351    0.00182501       10     
reco:ophit:OpHitFinder                             0.237559      0.390169      0.612145      0.374981      0.102554        10     
reco:opflash:OpFlashFinder                         0.135828       0.21903      0.357118      0.197682      0.0679126       10     
reco:opslicer:OpSlicer                             0.593811      0.940091       1.47873      0.943969      0.287182        10     
reco:caldata:DataPrepModule                         7.0934        9.38737       11.505        9.28308       1.18647        10     
reco:wclsdatasp:WireCellToolkit                     59.6848       69.5189       80.3381       70.034        6.01635        10     
reco:gaushit:GausHitFinder                         0.958605       1.99451       2.95472       2.1187        0.6357         10     
reco:nhitsfilter:NumberOfHitsFilter               0.000528029   0.000895712   0.00122148    0.000915535   0.000253384      10     
reco:reco3d:SpacePointSolver                        6.29279       19.0799       29.9924       18.1222       8.30819        10     
reco:hitpdune:DisambigFromSpacePoints               1.02868       3.17944       4.9908        3.32605       1.43844        10     
reco:pandora:StandardPandora                        17.1322       51.6363       81.9248       45.982        21.7191        10     
reco:pandoraWriter:StandardPandora                 0.341787      0.726871      0.947877      0.789407      0.207311        10     
reco:pandoraTrack:LArPandoraTrackCreation           5.5333        12.1387       20.3616       12.0395       4.69473        10     
reco:pandoraShower:LArPandoraShowerCreation         4.85471       14.1515       25.188        14.0441       7.12435        10     
reco:pandoracalo:Calorimetry                        2.7986         6.023        10.7057       6.11933       2.48435        10     
reco:pandoracalonosce:Calorimetry                   2.69831       5.63669        9.976        5.45329        2.399         10     
reco:pandorapid:Chi2ParticleID                    0.00479808    0.00814266     0.0104988    0.00770095     0.0016672       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0558537     0.0856967     0.125215      0.0812689     0.0207261       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00553662    0.00781849     0.0104756    0.00748066    0.00156679       10     
reco:pandoraShowercalo:ShowerCalorimetry            4.31347       14.4532       28.2087       14.3523       8.0292         10     
reco:pandoraShowercalonosce:ShowerCalorimetry       4.03932       13.8572       27.7884       13.9144       7.71709        10     
reco:emtrkmichelid:EmTrackMichelId                  197.337       288.204       396.637       293.677       63.2903        10     
reco:crttag:SingleCRTMatchingProducer              0.0267766     0.0370413     0.0520647     0.0369856    0.00917664       10     
reco:crtreco:TwoCRTMatchingProducer                0.0228563     0.0327309     0.0431991     0.0337142    0.00760938       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.10404       1.60757       2.36667       1.53959       0.43672        10     
reco:pandora2Track:LArPandoraTrackCreation          20.3353       40.2596       71.9823       36.8068       18.5664        10     
reco:pandora2calo:Calorimetry                       8.06985       18.2921       34.4063       16.8091       9.32438        10     
reco:pandora2calonosce:Calorimetry                  8.14214       17.8242       33.4499       15.9933       9.12432        10     
reco:pandora2pid:Chi2ParticleID                    0.0105929      0.01953      0.0308819     0.0176765    0.00647524       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0712934     0.108298       0.15106      0.101319      0.0277403       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0104471     0.0189375     0.0297425     0.0161578     0.0058879       10     
reco:pandora2Shower:LArPandoraShowerCreation        7.35165       13.523        21.6044       13.2909       5.39387        10     
reco:pandora2Showercalo:ShowerCalorimetry           7.55868       16.3795       30.0343       15.2138       8.09443        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      6.98234       15.5474       26.585        15.2804       7.41192        10     
[art]:TriggerResults:TriggerResultInserter        6.2875e-05    0.000105815   0.000218631   9.70475e-05   4.12446e-05      10     
end_path:out1:RootOutput                           7.529e-06    1.17253e-05   1.9526e-05    1.15855e-05   2.89669e-06      10     
end_path:out1:RootOutput(write)                     2.41682       3.75637       5.68833       3.7454        1.00179        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4797.69 MB
  Peak resident set size usage (VmHWM): 3993.56 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.10 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.36 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   5.99 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.34 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9056560
-rw-r--r-- 1 pildune22 pildune 2165327819 Aug  4 21:44 detsim_stage2.root
-rw-r--r-- 1 pildune22 pildune 2059018717 Aug  4 21:41 detsim_stage1.root
-rw-r--r-- 1 pildune22 pildune 1823825069 Aug  4 23:33 reco_stage1.root
-rw-r--r-- 1 pildune22 pildune 1606902215 Aug  4 19:45 g4_stage2.root
-rw-r--r-- 1 pildune22 pildune 1550639581 Aug  4 19:26 g4_stage1.root
-rw-r--r-- 1 pildune22 pildune   67587430 Aug  4 23:28 Pandora_Events.pndr
-rw-r--r-- 1 pildune22 pildune     242523 Aug  4 23:33 jobscript.log
-rw-r--r-- 1 pildune22 pildune     217088 Aug  4 23:33 mem.db
-rw-r--r-- 1 pildune22 pildune      62376 Aug  4 23:33 Pandora_Geometry.xml
-rw-r--r-- 1 pildune22 pildune      36864 Aug  4 23:33 time.db
-rw-r--r-- 1 pildune22 pildune        519 Aug  4 21:44 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Aug  4 19:45 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Aug  4 23:33 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune22 pildune         52 Aug  4 19:18 all-input-dids.txt
-rw-r--r-- 1 pildune22 pildune          7 Aug  4 23:33 justin-processed-pfns.txt
-rw-r--r-- 1 pildune22 pildune          0 Aug  4 21:54 ProtoDUNE.log
-rw-r--r-- 1 pildune22 pildune          0 Aug  4 21:44 debugprod.log
justIN time: 2025-08-04 23:59:08 UTC       justIN version: 01.04.00