justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 238115.0@dunegpschedd01.fnal.gov

Jobsub ID238115.0@dunegpschedd01.fnal.gov
Workflow ID9309
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-24 07:36:45
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce2
Last heartbeat2025-10-24 11:11:37
From worker nodeHostnamewn002.hep
cpuinfoIntel(R) Core(TM) i7-5960X CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-24 07:37:37
Input filesmonte-carlo-009309-000001
JobscriptExit code0
Real time3h (12706s)
CPU time3h (12346s = 97%)
Max RSS bytes4348260352 (4146 MiB)
Outputting started2025-10-24 11:09:24
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09309/1/001/reco_stage1.root
Finished2025-10-24 11:11:37
Saved logsjustin-logs:238115.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

sedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 138685 traces, 0 summary
Retagger: tagging trace set: gauss with 105780 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 105780 traces tagged "gauss"
FrameSaver: q=3.65645e+06 n=1832668 tag=gauss
wclsFrameSaver: saving 138685 traces tagged "wiener"
FrameSaver: q=3.90359e+06 n=1622000 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 34534 XUs and 40687 XVs -> 645 XUVs
C:0 T:1 83268 XUs and 93596 XVs -> 7476 XUVs
C:0 T:2 59516 XUs and 79790 XVs -> 2491 XUVs
C:0 T:3 34147 XUs and 39373 XVs -> 204 XUVs
C:0 T:4 17680 XUs and 14417 XVs -> 213 XUVs
C:0 T:5 66805 XUs and 62098 XVs -> 7192 XUVs
C:0 T:6 119462 XUs and 120789 XVs -> 8273 XUVs
C:0 T:7 32184 XUs and 37458 XVs -> 441 XUVs
C:0 T:8 7277 XUs and 5883 XVs -> 71 XUVs
C:0 T:9 50174 XUs and 77167 XVs -> 6383 XUVs
C:0 T:10 68129 XUs and 183470 XVs -> 20998 XUVs
C:0 T:11 724 XUs and 531 XVs -> 63 XUVs
54450 XUVs total
12361 collection wire objects
50887 potential space points
Neighbour search...
9704805 tests to find 4078714 neighbours
Iterating with no regularization...
Begin: 8.35885e+07
0 6.55063e+07
1 6.42002e+07
2 6.39853e+07
3 6.39114e+07
4 6.38754e+07
Now with regularization...
Begin: 5.30194e+07
0 5.29398e+07
1 5.28883e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410082073
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410082073
fLifetime: 30000 [us]
24-Oct-2025 12:09:21 BST  Closed output file "reco_stage1.root"
24-Oct-2025 12:09:21 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          253.252       362.637       543.373       360.712       83.1798        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000969757   0.00293669    0.00473178     0.0030224    0.00128425       10     
reco:ophit:OpHitFinder                             0.197489      0.246918      0.297128      0.245564      0.0307857       10     
reco:opflash:OpFlashFinder                         0.131289      0.183799      0.240547      0.181423      0.0369486       10     
reco:opslicer:OpSlicer                              0.50383       0.65609      0.853289      0.616254      0.105805        10     
reco:caldata:DataPrepModule                         4.79271       4.95303       5.26448       4.92568      0.126271        10     
reco:wclsdatasp:WireCellToolkit                     36.9417       42.8748       48.5526       43.6953       3.71388        10     
reco:gaushit:GausHitFinder                          1.03997       1.34871       1.72068       1.29142      0.237624        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000416426   0.000585102   0.000796936   0.000598514   0.000131426      10     
reco:reco3d:SpacePointSolver                        7.83977       15.772        24.5721       16.0844       5.17383        10     
reco:hitpdune:DisambigFromSpacePoints               1.2152        2.38135       3.63033       2.29425      0.732518        10     
reco:pandora:StandardPandora                        18.6048       41.8689       85.115        38.9058       18.1186        10     
reco:pandoraWriter:StandardPandora                 0.293059      0.446001      0.918383      0.392525      0.175342        10     
reco:pandoraTrack:LArPandoraTrackCreation           2.89627       5.42939       9.70538       5.63625       2.00154        10     
reco:pandoraShower:LArPandoraShowerCreation         2.60729       5.39736       11.1609       5.26825       2.47555        10     
reco:pandoracalo:Calorimetry                        1.44227       2.58015       3.85677       2.78588      0.765268        10     
reco:pandoracalonosce:Calorimetry                   1.29233       2.33255       3.64255       2.51958      0.708445        10     
reco:pandorapid:Chi2ParticleID                    0.00460212    0.00558307    0.00706289    0.00548631    0.000769621      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0409273     0.0621492     0.0807898     0.0648878     0.011493        10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00432296     0.0053271    0.00611935    0.00539729    0.000631266      10     
reco:pandoraShowercalo:ShowerCalorimetry            2.55686       5.32242       10.5258       5.35585       2.2912         10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.4714        5.20958       10.2732       5.22332       2.27273        10     
reco:emtrkmichelid:EmTrackMichelId                  127.064       172.216       229.717       171.59        30.7972        10     
reco:crttag:SingleCRTMatchingProducer             0.00909128     0.0141806     0.0177659     0.014063     0.00289962       10     
reco:crtreco:TwoCRTMatchingProducer               0.00699655     0.0105062     0.0149207     0.0104782    0.00250351       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.15189       1.58915       1.97846       1.56078      0.257348        10     
reco:pandora2Track:LArPandoraTrackCreation          8.78506       17.1208       35.4997       16.0686       7.69778        10     
reco:pandora2calo:Calorimetry                       3.85323       7.41244       13.8183       7.16266       2.88156        10     
reco:pandora2calonosce:Calorimetry                  3.62595       6.93363       12.451        6.85191       2.57514        10     
reco:pandora2pid:Chi2ParticleID                    0.0110176     0.0137269     0.0179606     0.0134768    0.00230462       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0526836     0.0786095     0.104557      0.0799752     0.0144452       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0107728     0.0136381     0.0176436     0.0134259    0.00228544       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.02795       5.46898       9.55974       5.36006       1.90129        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.41901       6.35234       10.8518       6.38103       2.1388         10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.12755       5.80976       9.8723        5.93453       1.97302        10     
[art]:TriggerResults:TriggerResultInserter        2.6313e-05    3.40268e-05   8.3479e-05    2.7232e-05    1.68181e-05      10     
end_path:out1:RootOutput                           3.86e-06     4.8754e-06     9.424e-06     4.532e-06    1.53986e-06      10     
end_path:out1:RootOutput(write)                     1.8137        2.42797        3.214        2.43197      0.435692        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5147.61 MB
  Peak resident set size usage (VmHWM): 4348.26 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.18 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.27 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.14 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11042776
-rw-r--r--. 1 dune004 dune 2550668359 Oct 24 11:06 detsim_stage2.root
-rw-r--r--. 1 dune004 dune 2420777721 Oct 24 11:04 detsim_stage1.root
-rw-r--r--. 1 dune004 dune 2249178769 Oct 24 12:09 reco_stage1.root
-rw-r--r--. 1 dune004 dune 2043704070 Oct 24 09:03 g4_stage2.root
-rw-r--r--. 1 dune004 dune 1964964336 Oct 24 08:47 g4_stage1.root
-rw-r--r--. 1 dune004 dune   77894100 Oct 24 12:05 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune     243168 Oct 24 12:09 jobscript.log
-rw-r--r--. 1 dune004 dune     217088 Oct 24 12:09 mem.db
-rw-r--r--. 1 dune004 dune      62376 Oct 24 12:09 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune      36864 Oct 24 12:09 time.db
-rw-r--r--. 1 dune004 dune        519 Oct 24 11:06 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 24 09:03 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 24 12:09 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune004 dune         52 Oct 24 08:37 all-input-dids.txt
-rw-r--r--. 1 dune004 dune          7 Oct 24 12:09 justin-processed-pfns.txt
-rw-r--r--. 1 dune004 dune          0 Oct 24 11:13 ProtoDUNE.log
-rw-r--r--. 1 dune004 dune          0 Oct 24 11:06 debugprod.log
justIN time: 2025-11-03 18:40:57 UTC       justIN version: 01.05.01