justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269313.0@dunegpschedd01.fnal.gov

Jobsub ID269313.0@dunegpschedd01.fnal.gov
Workflow ID11285
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-19 20:07:18
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2025-12-19 23:09:55
From worker nodeHostnamenode2b07.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-19 20:08:36
Input filesmonte-carlo-011285-000001
JobscriptExit code0
Real time3h (10830s)
CPU time2h (10712s = 98%)
Max RSS bytes4382273536 (4179 MiB)
Outputting started2025-12-19 23:09:07
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11285/1/001/reco_stage1.root
Finished2025-12-19 23:09:55
Saved logsjustin-logs:269313.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

igitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 144070 traces, 0 summary
Retagger: tagging trace set: gauss with 106845 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 106845 traces tagged "gauss"
FrameSaver: q=3.82361e+06 n=1845730 tag=gauss
wclsFrameSaver: saving 144070 traces tagged "wiener"
FrameSaver: q=4.05919e+06 n=1618123 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 27938 XUs and 29011 XVs -> 218 XUVs
C:0 T:1 48231 XUs and 57865 XVs -> 3268 XUVs
C:0 T:2 125749 XUs and 156099 XVs -> 10028 XUVs
C:0 T:3 53898 XUs and 62673 XVs -> 571 XUVs
C:0 T:4 12281 XUs and 10598 XVs -> 126 XUVs
C:0 T:5 45508 XUs and 63722 XVs -> 7526 XUVs
C:0 T:6 148424 XUs and 154895 XVs -> 11137 XUVs
C:0 T:7 61762 XUs and 57982 XVs -> 840 XUVs
C:0 T:8 6428 XUs and 6553 XVs -> 62 XUVs
C:0 T:9 33447 XUs and 46802 XVs -> 2807 XUVs
C:0 T:10 62319 XUs and 27910 XVs -> 10220 XUVs
C:0 T:11 599 XUs and 378 XVs -> 90 XUVs
46893 XUVs total
11691 collection wire objects
42180 potential space points
Neighbour search...
5368236 tests to find 2542664 neighbours
Iterating with no regularization...
Begin: 8.52097e+07
0 7.13957e+07
1 7.05224e+07
2 7.03823e+07
3 7.03388e+07
Now with regularization...
Begin: 5.9509e+07
0 5.94746e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411219551
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411219551
fLifetime: 30000 [us]
19-Dec-2025 23:09:05 GMT  Closed output file "reco_stage1.root"
19-Dec-2025 23:09:05 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          327.992       404.167       513.363       382.705       60.7703        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000716109   0.00335936    0.00504635    0.00379457    0.00132765       10     
reco:ophit:OpHitFinder                             0.295087      0.340172      0.390528      0.332063      0.0289785       10     
reco:opflash:OpFlashFinder                         0.213836      0.282153      0.368941      0.282226      0.0437092       10     
reco:opslicer:OpSlicer                             0.521721      0.682235      0.837764      0.676969      0.0953648       10     
reco:caldata:DataPrepModule                         5.27088       5.46784       5.72772       5.45188      0.117607        10     
reco:wclsdatasp:WireCellToolkit                     43.4364       47.1052       49.292        47.7456       1.87997        10     
reco:gaushit:GausHitFinder                          1.44576       1.64905       2.10178       1.59761      0.208047        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000618199   0.000735282    0.0010395    0.000707226   0.000111701      10     
reco:reco3d:SpacePointSolver                        9.00985       16.9838       20.3457       19.2945       3.9484         10     
reco:hitpdune:DisambigFromSpacePoints               1.42013       1.94838       2.65028       1.79336      0.378411        10     
reco:pandora:StandardPandora                        32.2104       45.792        64.6688       42.8954       11.3152        10     
reco:pandoraWriter:StandardPandora                 0.419099      0.493921      0.597706      0.477995      0.0608639       10     
reco:pandoraTrack:LArPandoraTrackCreation           4.94891       6.75868       10.8338       6.2042        1.83311        10     
reco:pandoraShower:LArPandoraShowerCreation         4.2925        7.48445       13.2073       6.63031       2.66063        10     
reco:pandoracalo:Calorimetry                        2.51816       3.28836       4.62269       3.15989      0.689599        10     
reco:pandoracalonosce:Calorimetry                   2.29748       3.03175       4.45857       2.88386      0.714262        10     
reco:pandorapid:Chi2ParticleID                    0.00558193    0.00625474    0.00805042    0.00596732    0.000729896      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0430468     0.0547309     0.0673244     0.0536254    0.00689174       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00562978    0.00614825    0.00702397    0.00595575    0.000500845      10     
reco:pandoraShowercalo:ShowerCalorimetry            4.24731       7.09131       11.1082       6.36553       2.17819        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       4.14174       6.80435       10.7432       6.05741       2.03845        10     
reco:emtrkmichelid:EmTrackMichelId                  154.972       183.03        221.788       175.909       22.1358        10     
reco:crttag:SingleCRTMatchingProducer              0.0131387     0.0196848     0.0242397     0.0204761    0.00318468       10     
reco:crtreco:TwoCRTMatchingProducer               0.00799766     0.0133563     0.0189458     0.0123182    0.00313465       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.782461       1.24807       1.56909       1.22684      0.211042        10     
reco:pandora2Track:LArPandoraTrackCreation          13.6228       21.4754       35.1829       20.0837       6.91033        10     
reco:pandora2calo:Calorimetry                       6.71534       9.68957       15.3847       9.05307       2.73471        10     
reco:pandora2calonosce:Calorimetry                  6.1169        9.03452       13.8491       8.34113       2.55989        10     
reco:pandora2pid:Chi2ParticleID                    0.0135923     0.0156912     0.0189881     0.0149929    0.00168817       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0602578     0.0708897     0.087042      0.0693153    0.00943911       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0136059     0.0157744     0.0188209     0.0153583    0.00170271       10     
reco:pandora2Shower:LArPandoraShowerCreation        4.57732       6.58895       9.38186       6.00865       1.51512        10     
reco:pandora2Showercalo:ShowerCalorimetry           5.44391       7.73198       11.1942       7.27743       1.75807        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      4.98781       6.90267       9.65448       6.4419         1.483         10     
[art]:TriggerResults:TriggerResultInserter         3.397e-05    4.77406e-05   9.2944e-05    4.36315e-05   1.54768e-05      10     
end_path:out1:RootOutput                           6.11e-06     7.8876e-06    1.1958e-05    7.5385e-06    1.60806e-06      10     
end_path:out1:RootOutput(write)                     2.4227        2.91883       3.63789       2.80633      0.374653        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5187.05 MB
  Peak resident set size usage (VmHWM): 4382.27 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.21 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.48 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.14 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11298676
-rw-r--r-- 1 gl05pi8 eddie_users 2607113828 Dec 19 21:59 detsim_stage2.root
-rw-r--r-- 1 gl05pi8 eddie_users 2467685065 Dec 19 21:57 detsim_stage1.root
-rw-r--r-- 1 gl05pi8 eddie_users 2342259464 Dec 19 23:09 reco_stage1.root
-rw-r--r-- 1 gl05pi8 eddie_users 2080401176 Dec 19 20:29 g4_stage2.root
-rw-r--r-- 1 gl05pi8 eddie_users 1984159268 Dec 19 20:14 g4_stage1.root
-rw-r--r-- 1 gl05pi8 eddie_users   87354210 Dec 19 23:04 Pandora_Events.pndr
-rw-r--r-- 1 gl05pi8 eddie_users     491436 Dec 19 23:09 jobscript.log
-rw-r--r-- 1 gl05pi8 eddie_users     217088 Dec 19 23:09 mem.db
-rw-r--r-- 1 gl05pi8 eddie_users      62376 Dec 19 23:09 Pandora_Geometry.xml
-rw-r--r-- 1 gl05pi8 eddie_users      36864 Dec 19 23:09 time.db
-rw-r--r-- 1 gl05pi8 eddie_users        519 Dec 19 21:59 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 gl05pi8 eddie_users        519 Dec 19 20:29 g4_protoDUNE_hist.root
-rw-r--r-- 1 gl05pi8 eddie_users        519 Dec 19 23:09 protoDUNE_reco1_hist.root
-rw-r--r-- 1 gl05pi8 eddie_users         52 Dec 19 20:08 all-input-dids.txt
-rw-r--r-- 1 gl05pi8 eddie_users          7 Dec 19 23:09 justin-processed-pfns.txt
-rw-r--r-- 1 gl05pi8 eddie_users          0 Dec 19 22:07 ProtoDUNE.log
-rw-r--r-- 1 gl05pi8 eddie_users          0 Dec 19 22:00 debugprod.log
justIN time: 2026-02-07 06:18:14 UTC       justIN version: 01.06.00