justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 235272.1@dunegpschedd02.fnal.gov

Jobsub ID235272.1@dunegpschedd02.fnal.gov
Workflow ID9462
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-30 07:25:24
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce02
Last heartbeat2025-10-30 11:46:08
From worker nodeHostnamecn072.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-30 07:26:21
Input filesmonte-carlo-009462-000001
JobscriptExit code0
Real time4h (15376s)
CPU time4h (15120s = 98%)
Max RSS bytes4578816000 (4366 MiB)
Outputting started2025-10-30 11:42:38
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09462/1/001/reco_stage1.root
Finished2025-10-30 11:46:08
Saved logsjustin-logs:235272.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ning tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 129974 traces, 0 summary
Retagger: tagging trace set: gauss with 98307 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 98307 traces tagged "gauss"
FrameSaver: q=3.59623e+06 n=1795082 tag=gauss
wclsFrameSaver: saving 129974 traces tagged "wiener"
FrameSaver: q=3.81757e+06 n=1604516 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35072 XUs and 39270 XVs -> 435 XUVs
C:0 T:1 70444 XUs and 68548 XVs -> 5452 XUVs
C:0 T:2 86184 XUs and 139155 XVs -> 7686 XUVs
C:0 T:3 46635 XUs and 47117 XVs -> 400 XUVs
C:0 T:4 13713 XUs and 17666 XVs -> 121 XUVs
C:0 T:5 62869 XUs and 58938 XVs -> 5617 XUVs
C:0 T:6 85937 XUs and 83181 XVs -> 5367 XUVs
C:0 T:7 38847 XUs and 36071 XVs -> 598 XUVs
C:0 T:8 13377 XUs and 14018 XVs -> 230 XUVs
C:0 T:9 108701 XUs and 131804 XVs -> 13999 XUVs
C:0 T:10 10510 XUs and 7260 XVs -> 1170 XUVs
C:0 T:11 32 XUs and 17 XVs -> 4 XUVs
41079 XUVs total
11766 collection wire objects
36312 potential space points
Neighbour search...
2928060 tests to find 1467476 neighbours
Iterating with no regularization...
Begin: 6.73201e+07
0 5.39234e+07
1 5.29936e+07
2 5.28525e+07
3 5.28067e+07
Now with regularization...
Begin: 4.21091e+07
0 4.20735e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410202974
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410202974
fLifetime: 30000 [us]
30-Oct-2025 11:42:35 GMT  Closed output file "reco_stage1.root"
30-Oct-2025 11:42:35 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          515.206       720.619       1200.21       713.223       181.443        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00130958    0.00470516     0.0104856    0.00442908    0.00244555       10     
reco:ophit:OpHitFinder                              0.25767      0.351594      0.462442      0.356689      0.0783107       10     
reco:opflash:OpFlashFinder                         0.222144      0.280084      0.404545      0.241602      0.0675792       10     
reco:opslicer:OpSlicer                             0.633663      0.894147       1.19194      0.903648      0.203583        10     
reco:caldata:DataPrepModule                         5.07052       7.24539       9.3504        8.06338       1.70397        10     
reco:wclsdatasp:WireCellToolkit                     48.6802       60.3197        73.1         62.2868       9.58161        10     
reco:gaushit:GausHitFinder                          1.18839       1.92376       2.74564       1.72968       0.50978        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000849702   0.00107687    0.00161024    0.00101284    0.000227114      10     
reco:reco3d:SpacePointSolver                        8.63227       19.3937       27.5357       19.1357       6.07781        10     
reco:hitpdune:DisambigFromSpacePoints               1.44787       3.34336       6.67999       2.58169       1.56445        10     
reco:pandora:StandardPandora                        36.6796       76.7438       189.428       64.9369       42.6505        10     
reco:pandoraWriter:StandardPandora                 0.484058      0.719445       1.20361      0.648809      0.219439        10     
reco:pandoraTrack:LArPandoraTrackCreation           11.3259       18.4425       30.0283       17.7104       5.18407        10     
reco:pandoraShower:LArPandoraShowerCreation         12.4385       20.573        34.1881       20.0547       5.86219        10     
reco:pandoracalo:Calorimetry                        5.55434       8.68833       14.6873       8.63974       2.47334        10     
reco:pandoracalonosce:Calorimetry                   5.25995       8.25079       13.7611       7.77268       2.38472        10     
reco:pandorapid:Chi2ParticleID                    0.00581045    0.00925922     0.0162709    0.00811145    0.00325604       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0571453     0.0839314      0.1676       0.0758126     0.031269        10     
reco:pandoracalipidnoxyzt:Chi2ParticleID           0.0056879     0.0082858     0.0161503     0.0065983    0.00319513       10     
reco:pandoraShowercalo:ShowerCalorimetry            11.7723       19.7333       36.9113       18.7914       6.92345        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       11.9272       19.539        35.4262       18.2919       6.76749        10     
reco:emtrkmichelid:EmTrackMichelId                  182.293       275.869       439.407       270.608       70.4372        10     
reco:crttag:SingleCRTMatchingProducer              0.0302528     0.0399742     0.0602383     0.039513      0.0076677       10     
reco:crtreco:TwoCRTMatchingProducer                0.0263632      0.0345       0.0456865     0.0347821    0.00504065       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.10195       1.55972       2.42337       1.34128      0.444132        10     
reco:pandora2Track:LArPandoraTrackCreation          43.7701       62.315        100.165       61.2498       15.2907        10     
reco:pandora2calo:Calorimetry                       16.613        28.8512       48.5102        28.03        8.30269        10     
reco:pandora2calonosce:Calorimetry                  15.1972       25.2894       45.2391       23.7198       8.52701        10     
reco:pandora2pid:Chi2ParticleID                    0.0121706     0.0215193     0.0352944     0.0210024    0.00736219       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0675207     0.107862      0.168271      0.108336      0.0318679       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0117629     0.0225542     0.0327672     0.0234003    0.00662673       10     
reco:pandora2Shower:LArPandoraShowerCreation        11.8518       16.1925       26.2339       15.4985       4.08686        10     
reco:pandora2Showercalo:ShowerCalorimetry           13.6915       21.6122       35.7848       21.3622       5.74948        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      13.1196       18.2883       26.1746       17.908        3.61441        10     
[art]:TriggerResults:TriggerResultInserter        4.6764e-05    7.69944e-05   0.000206614   6.01165e-05   4.58179e-05      10     
end_path:out1:RootOutput                           7.394e-06    1.02164e-05    2.046e-05    8.4725e-06    3.83309e-06      10     
end_path:out1:RootOutput(write)                     2.25864       3.65356       4.77383       3.87116      0.809684        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5383.76 MB
  Peak resident set size usage (VmHWM): 4578.82 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.29 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.49 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.25 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11269556
-rw-r--r-- 1 pildune22 pildune 2612729302 Oct 30 09:39 detsim_stage2.root
-rw-r--r-- 1 pildune22 pildune 2480207213 Oct 30 09:35 detsim_stage1.root
-rw-r--r-- 1 pildune22 pildune 2324305024 Oct 30 11:42 reco_stage1.root
-rw-r--r-- 1 pildune22 pildune 2064035769 Oct 30 07:56 g4_stage2.root
-rw-r--r-- 1 pildune22 pildune 1976590032 Oct 30 07:34 g4_stage1.root
-rw-r--r-- 1 pildune22 pildune   81349860 Oct 30 11:32 Pandora_Events.pndr
-rw-r--r-- 1 pildune22 pildune     243234 Oct 30 11:42 jobscript.log
-rw-r--r-- 1 pildune22 pildune     217088 Oct 30 11:42 mem.db
-rw-r--r-- 1 pildune22 pildune      62376 Oct 30 11:42 Pandora_Geometry.xml
-rw-r--r-- 1 pildune22 pildune      36864 Oct 30 11:42 time.db
-rw-r--r-- 1 pildune22 pildune        519 Oct 30 09:39 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Oct 30 07:56 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Oct 30 11:42 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune22 pildune         52 Oct 30 07:26 all-input-dids.txt
-rw-r--r-- 1 pildune22 pildune          7 Oct 30 11:42 justin-processed-pfns.txt
-rw-r--r-- 1 pildune22 pildune          0 Oct 30 09:46 ProtoDUNE.log
-rw-r--r-- 1 pildune22 pildune          0 Oct 30 09:39 debugprod.log
justIN time: 2025-11-04 01:53:56 UTC       justIN version: 01.05.01