justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 238591.1@dunegpschedd01.fnal.gov

Jobsub ID238591.1@dunegpschedd01.fnal.gov
Workflow ID9350
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-26 07:14:19
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat2025-10-26 12:08:27
From worker nodeHostnameheplnc152.pp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-26 07:15:13
Input filesmonte-carlo-009350-000001
JobscriptExit code0
Real time4h (17498s)
CPU time4h (16713s = 95%)
Max RSS bytes4389732352 (4186 MiB)
Outputting started2025-10-26 12:06:52
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09350/1/001/reco_stage1.root
Finished2025-10-26 12:08:27
Saved logsjustin-logs:238591.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

KeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 148706 traces, 0 summary
Retagger: tagging trace set: gauss with 114826 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 114826 traces tagged "gauss"
FrameSaver: q=4.03459e+06 n=2058333 tag=gauss
wclsFrameSaver: saving 148706 traces tagged "wiener"
FrameSaver: q=4.2919e+06 n=1832539 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 47468 XUs and 47309 XVs -> 755 XUVs
C:0 T:1 97525 XUs and 103197 XVs -> 6941 XUVs
C:0 T:2 102346 XUs and 93967 XVs -> 7922 XUVs
C:0 T:3 43483 XUs and 39277 XVs -> 447 XUVs
C:0 T:4 8998 XUs and 9037 XVs -> 50 XUVs
C:0 T:5 31614 XUs and 21645 XVs -> 2260 XUVs
C:0 T:6 116992 XUs and 127157 XVs -> 7043 XUVs
C:0 T:7 44085 XUs and 43162 XVs -> 452 XUVs
C:0 T:8 10823 XUs and 10958 XVs -> 124 XUVs
C:0 T:9 71162 XUs and 89384 XVs -> 5248 XUVs
C:0 T:10 108304 XUs and 80545 XVs -> 12503 XUVs
C:0 T:11 500 XUs and 317 XVs -> 38 XUVs
43783 XUVs total
15012 collection wire objects
39878 potential space points
Neighbour search...
4031306 tests to find 1840806 neighbours
Iterating with no regularization...
Begin: 1.15818e+08
0 9.09588e+07
1 8.90888e+07
2 8.88737e+07
3 8.88108e+07
Now with regularization...
Begin: 7.42109e+07
0 7.41247e+07
1 7.40913e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410122313
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410122313
fLifetime: 30000 [us]
26-Oct-2025 12:06:49 GMT  Closed output file "reco_stage1.root"
26-Oct-2025 12:06:49 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          369.794       630.277       755.68        650.174       103.808        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00146634    0.00517968    0.00948498     0.0056281    0.00273354       10     
reco:ophit:OpHitFinder                              0.26622      0.386201      0.480175      0.399321      0.0602661       10     
reco:opflash:OpFlashFinder                         0.171539      0.244641      0.295363      0.245896      0.0367477       10     
reco:opslicer:OpSlicer                             0.559713       1.03782       1.35125       1.0618       0.231943        10     
reco:caldata:DataPrepModule                         5.62839       7.07418       7.53113       7.14929      0.516789        10     
reco:wclsdatasp:WireCellToolkit                     35.0772       42.8547       48.0003       44.4294       4.19982        10     
reco:gaushit:GausHitFinder                         0.892091       1.82093       2.2342        1.96527      0.387721        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000721622   0.000931571   0.00112102    0.000973703   0.000135531      10     
reco:reco3d:SpacePointSolver                        11.0673       25.6695       51.9206       23.8464       10.4434        10     
reco:hitpdune:DisambigFromSpacePoints               1.07932       2.81083       3.74178       2.91599      0.740228        10     
reco:pandora:StandardPandora                        34.2502       67.975        86.5723       69.7311       15.3291        10     
reco:pandoraWriter:StandardPandora                 0.570351      0.774592      0.902105      0.790561      0.108588        10     
reco:pandoraTrack:LArPandoraTrackCreation           4.50478       8.67935       10.5687       9.20604       1.82298        10     
reco:pandoraShower:LArPandoraShowerCreation         5.28405       11.3564       15.4043       11.8484       2.73069        10     
reco:pandoracalo:Calorimetry                        2.30259       4.70841       5.86622       5.23704       1.29917        10     
reco:pandoracalonosce:Calorimetry                   2.06868       4.39281       5.41972       4.94839       1.18905        10     
reco:pandorapid:Chi2ParticleID                    0.00704116     0.0100103     0.0123188     0.010087     0.00151646       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0638299     0.0973417     0.127739      0.102341      0.0206419       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00508399    0.00907341     0.0113347    0.00974937    0.00188419       10     
reco:pandoraShowercalo:ShowerCalorimetry            4.69717       10.8637       13.3352       11.0619       2.46947        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       4.4424        10.4464       13.9854       10.4288       2.3841         10     
reco:emtrkmichelid:EmTrackMichelId                  222.743       335.604       401.567       349.078       46.4439        10     
reco:crttag:SingleCRTMatchingProducer              0.0174098     0.0258745     0.0416271     0.0232406    0.00662111       10     
reco:crtreco:TwoCRTMatchingProducer               0.00732226     0.017414      0.0206558     0.0183654    0.00373326       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.841152       1.28259       1.61028       1.27018      0.232852        10     
reco:pandora2Track:LArPandoraTrackCreation          9.60912       30.1937       39.6881       32.2766       7.96045        10     
reco:pandora2calo:Calorimetry                       3.89646       14.3468       18.5641        15.56        4.2308         10     
reco:pandora2calonosce:Calorimetry                  3.92114       13.2729       16.5643       14.7576        3.515         10     
reco:pandora2pid:Chi2ParticleID                    0.0130141     0.0236376     0.031183      0.0258126    0.00616083       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0570842     0.115531      0.158338      0.125437      0.0323954       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0128434     0.0227571     0.0305084     0.0242387    0.00578161       10     
reco:pandora2Shower:LArPandoraShowerCreation        4.49405       9.97662       13.6437       10.177        2.57211        10     
reco:pandora2Showercalo:ShowerCalorimetry           4.83511       10.669        14.2651       11.1224       2.85401        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      2.8691        8.67153       12.5154       8.77072       2.58199        10     
[art]:TriggerResults:TriggerResultInserter        5.6336e-05    8.21738e-05   0.000143861   7.2126e-05    2.92564e-05      10     
end_path:out1:RootOutput                          1.1181e-05    1.40876e-05   2.1881e-05    1.34255e-05   3.05679e-06      10     
end_path:out1:RootOutput(write)                     3.34581       4.62775       5.89732       4.69115      0.734155        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5228.72 MB
  Peak resident set size usage (VmHWM): 4389.73 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.30 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.45 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.18 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11470212
-rw-r--r-- 1 pltdune04 pltdune 2652810046 Oct 26 10:18 detsim_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 2517575177 Oct 26 10:15 detsim_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2403478467 Oct 26 12:06 reco_stage1.root
-rw-r--r-- 1 pltdune04 pltdune 2084431152 Oct 26 07:42 g4_stage2.root
-rw-r--r-- 1 pltdune04 pltdune 1996479009 Oct 26 07:24 g4_stage1.root
-rw-r--r-- 1 pltdune04 pltdune   90107840 Oct 26 11:57 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune     243018 Oct 26 12:06 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     217088 Oct 26 12:06 mem.db
-rw-r--r-- 1 pltdune04 pltdune      62376 Oct 26 12:06 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune      36864 Oct 26 12:06 time.db
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 26 10:18 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 26 07:42 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune04 pltdune        519 Oct 26 12:06 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune04 pltdune         52 Oct 26 07:15 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune          7 Oct 26 12:06 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune          0 Oct 26 10:25 ProtoDUNE.log
-rw-r--r-- 1 pltdune04 pltdune          0 Oct 26 10:18 debugprod.log
justIN time: 2025-11-03 18:40:57 UTC       justIN version: 01.05.01