justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 232468.1@dunegpschedd01.fnal.gov

Jobsub ID232468.1@dunegpschedd01.fnal.gov
Workflow ID8825
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-10 10:17:52
SiteUK_Bristol
EntryCMSHTPC_T2_UK_SGrid_Bristol_lcgce02
Last heartbeat2025-10-10 16:33:31
From worker nodeHostnamehd75.dice.priv
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit259200 (72 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-10 10:18:50
Input filesmonte-carlo-008825-000001
JobscriptExit code0
Real time6h (22383s)
CPU time6h (21823s = 97%)
Max RSS bytes4488380416 (4280 MiB)
Outputting started2025-10-10 16:31:54
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/08825/1/001/reco_stage1.root
Finished2025-10-10 16:33:31
Saved logsjustin-logs:232468.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

lBasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 203546 traces, 0 summary
Retagger: tagging trace set: gauss with 153706 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 153706 traces tagged "gauss"
FrameSaver: q=5.27519e+06 n=2731628 tag=gauss
wclsFrameSaver: saving 203546 traces tagged "wiener"
FrameSaver: q=5.60879e+06 n=2427980 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 59304 XUs and 51445 XVs -> 865 XUVs
C:0 T:1 134364 XUs and 104875 XVs -> 6743 XUVs
C:0 T:2 227935 XUs and 250950 XVs -> 12992 XUVs
C:0 T:3 93284 XUs and 86221 XVs -> 1077 XUVs
C:0 T:4 11329 XUs and 14383 XVs -> 124 XUVs
C:0 T:5 37821 XUs and 38176 XVs -> 3691 XUVs
C:0 T:6 207724 XUs and 177564 XVs -> 13150 XUVs
C:0 T:7 75267 XUs and 61831 XVs -> 820 XUVs
C:0 T:8 8584 XUs and 11350 XVs -> 151 XUVs
C:0 T:9 74843 XUs and 126579 XVs -> 13540 XUVs
C:0 T:10 88621 XUs and 67508 XVs -> 9618 XUVs
C:0 T:11 1051 XUs and 832 XVs -> 123 XUVs
62894 XUVs total
19789 collection wire objects
56561 potential space points
Neighbour search...
5643191 tests to find 2664708 neighbours
Iterating with no regularization...
Begin: 1.09015e+08
0 9.24479e+07
1 9.11229e+07
2 9.09364e+07
3 9.0884e+07
Now with regularization...
Begin: 7.567e+07
0 7.56523e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 409803151
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 409803151
fLifetime: 30000 [us]
10-Oct-2025 16:31:52 UTC  Closed output file "reco_stage1.root"
10-Oct-2025 16:31:52 UTC  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          423.156       653.926       1010.69        604.5        178.662        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00113362    0.00436417    0.00888501    0.00469953    0.00219299       10     
reco:ophit:OpHitFinder                             0.363532      0.424994      0.497572      0.428097      0.0428132       10     
reco:opflash:OpFlashFinder                         0.261791      0.316888      0.421321      0.295857      0.0503302       10     
reco:opslicer:OpSlicer                              0.99841       1.24177       1.49502       1.27377      0.168814        10     
reco:caldata:DataPrepModule                         6.96911       7.32843       7.5281        7.36902      0.146075        10     
reco:wclsdatasp:WireCellToolkit                     43.2448       47.602        54.0736       47.3176       2.98388        10     
reco:gaushit:GausHitFinder                          1.51432       2.12622       3.06457       2.02133      0.470005        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000517184   0.000747237   0.000922608   0.000752863   0.000113727      10     
reco:reco3d:SpacePointSolver                        12.4782       27.1214       48.603        28.5676       11.5437        10     
reco:hitpdune:DisambigFromSpacePoints               1.72164       3.19769       5.50747       2.98221       1.11569        10     
reco:pandora:StandardPandora                        33.388        82.9017       175.781       61.4008       47.2954        10     
reco:pandoraWriter:StandardPandora                 0.501555      0.717464       0.95534      0.694193      0.152104        10     
reco:pandoraTrack:LArPandoraTrackCreation           6.30841       9.86279       19.5651       7.83305       4.12001        10     
reco:pandoraShower:LArPandoraShowerCreation         5.46946       11.6652       27.7286       9.76984       6.39849        10     
reco:pandoracalo:Calorimetry                        3.26594       5.03623       8.80521       4.37367       1.82209        10     
reco:pandoracalonosce:Calorimetry                   2.98888       4.50578       7.59498       3.89664       1.55748        10     
reco:pandorapid:Chi2ParticleID                    0.00842738      0.01033      0.0130986    0.00968919    0.00178321       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0694968     0.101879      0.133582       0.1053       0.0186014       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00800818    0.00980033     0.0126532    0.00896606    0.00177497       10     
reco:pandoraShowercalo:ShowerCalorimetry            5.38639       10.8326       22.8444       9.52342       5.13292        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       5.19761       10.2097       18.3578       9.42897       3.94964        10     
reco:emtrkmichelid:EmTrackMichelId                  235.878       330.959       443.737        318.1        62.7484        10     
reco:crttag:SingleCRTMatchingProducer              0.017356      0.0263768     0.0340282     0.0264931    0.00440116       10     
reco:crtreco:TwoCRTMatchingProducer                0.011294      0.0163507     0.0214447     0.0168437    0.00298119       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.11284       1.50742       1.81787       1.56731      0.224784        10     
reco:pandora2Track:LArPandoraTrackCreation          16.5357       30.4112       50.6943       28.6634       11.0378        10     
reco:pandora2calo:Calorimetry                       7.32191       13.9444       22.3681       13.0661       4.8909         10     
reco:pandora2calonosce:Calorimetry                  6.8883        13.3934       21.2892       12.2209       4.78321        10     
reco:pandora2pid:Chi2ParticleID                    0.0203164     0.0267938     0.0363327     0.0245796    0.00598394       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0957197     0.129481      0.174975      0.126986      0.0253254       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0194833     0.0258232     0.0346358     0.0240257    0.00545358       10     
reco:pandora2Shower:LArPandoraShowerCreation        5.88276       11.0826       18.241        10.3296       3.84839        10     
reco:pandora2Showercalo:ShowerCalorimetry           6.28089       12.1276       25.4849       10.6026       5.31096        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      5.54452       10.1238       16.7147       9.3501        3.37123        10     
[art]:TriggerResults:TriggerResultInserter        4.8451e-05    0.00011067    0.000358335   6.9265e-05    9.74462e-05      10     
end_path:out1:RootOutput                           9.859e-06    1.46286e-05   2.8103e-05    1.4227e-05    5.15418e-06      10     
end_path:out1:RootOutput(write)                     3.21325       4.77916       7.01461       4.70947       1.04683        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5300.48 MB
  Peak resident set size usage (VmHWM): 4488.38 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.10 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.27 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.75 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.14 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11538032
-rw-r--r-- 1 dnpil001 users 2666077712 Oct 10 14:39 detsim_stage2.root
-rw-r--r-- 1 dnpil001 users 2523652792 Oct 10 14:36 detsim_stage1.root
-rw-r--r-- 1 dnpil001 users 2415846932 Oct 10 16:31 reco_stage1.root
-rw-r--r-- 1 dnpil001 users 2106906931 Oct 10 10:51 g4_stage2.root
-rw-r--r-- 1 dnpil001 users 2011853681 Oct 10 10:27 g4_stage1.root
-rw-r--r-- 1 dnpil001 users   89989260 Oct 10 16:19 Pandora_Events.pndr
-rw-r--r-- 1 dnpil001 users     243001 Oct 10 16:31 jobscript.log
-rw-r--r-- 1 dnpil001 users     217088 Oct 10 16:31 mem.db
-rw-r--r-- 1 dnpil001 users      62376 Oct 10 16:31 Pandora_Geometry.xml
-rw-r--r-- 1 dnpil001 users      36864 Oct 10 16:31 time.db
-rw-r--r-- 1 dnpil001 users        519 Oct 10 14:39 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dnpil001 users        519 Oct 10 10:51 g4_protoDUNE_hist.root
-rw-r--r-- 1 dnpil001 users        519 Oct 10 16:31 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dnpil001 users         52 Oct 10 10:18 all-input-dids.txt
-rw-r--r-- 1 dnpil001 users          7 Oct 10 16:31 justin-processed-pfns.txt
-rw-r--r-- 1 dnpil001 users          0 Oct 10 14:47 ProtoDUNE.log
-rw-r--r-- 1 dnpil001 users          0 Oct 10 14:39 debugprod.log
justIN time: 2025-11-05 04:50:26 UTC       justIN version: 01.05.01