justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263521.0@dunegpschedd02.fnal.gov

Jobsub ID263521.0@dunegpschedd02.fnal.gov
Workflow ID11290
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-20 03:57:41
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2025-12-20 06:38:58
From worker nodeHostnamenode2b07.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-20 03:58:48
Input filesmonte-carlo-011290-000001
JobscriptExit code0
Real time2h (9550s)
CPU time2h (9439s = 98%)
Max RSS bytes4237324288 (4041 MiB)
Outputting started2025-12-20 06:37:59
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11290/1/001/reco_stage1.root
Finished2025-12-20 06:38:48
Saved logsjustin-logs:263521.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

nning tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 141211 traces, 0 summary
Retagger: tagging trace set: gauss with 105488 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 105488 traces tagged "gauss"
FrameSaver: q=3.70135e+06 n=1873148 tag=gauss
wclsFrameSaver: saving 141211 traces tagged "wiener"
FrameSaver: q=3.93775e+06 n=1658016 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 37894 XUs and 44770 XVs -> 461 XUVs
C:0 T:1 96176 XUs and 84472 XVs -> 7904 XUVs
C:0 T:2 120629 XUs and 125423 XVs -> 6774 XUVs
C:0 T:3 54472 XUs and 47839 XVs -> 350 XUVs
C:0 T:4 18544 XUs and 17480 XVs -> 1166 XUVs
C:0 T:5 88823 XUs and 82362 XVs -> 12646 XUVs
C:0 T:6 80807 XUs and 67112 XVs -> 10772 XUVs
C:0 T:7 27533 XUs and 23507 XVs -> 592 XUVs
C:0 T:8 5987 XUs and 8761 XVs -> 142 XUVs
C:0 T:9 54368 XUs and 143356 XVs -> 18499 XUVs
C:0 T:10 41311 XUs and 25224 XVs -> 3228 XUVs
C:0 T:11 171 XUs and 119 XVs -> 22 XUVs
62556 XUVs total
12696 collection wire objects
58716 potential space points
Neighbour search...
12785762 tests to find 5508456 neighbours
Iterating with no regularization...
Begin: 7.88453e+07
0 6.10015e+07
1 5.98314e+07
2 5.96817e+07
3 5.96262e+07
Now with regularization...
Begin: 4.8919e+07
0 4.8847e+07
1 4.87916e+07
2 4.87483e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411226025
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411226025
fLifetime: 30000 [us]
20-Dec-2025 06:37:57 GMT  Closed output file "reco_stage1.root"
20-Dec-2025 06:37:57 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          207.59        382.12        516.031       391.262       95.1212        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00078325    0.00328622    0.00520311    0.00344655    0.00137593       10     
reco:ophit:OpHitFinder                             0.263109      0.288978        0.346        0.27386      0.0256651       10     
reco:opflash:OpFlashFinder                         0.182662      0.237474      0.308812      0.221553      0.0439869       10     
reco:opslicer:OpSlicer                             0.487889      0.588995      0.722802      0.577603      0.0753901       10     
reco:caldata:DataPrepModule                         4.79441       5.09248       5.91448       4.93126      0.340853        10     
reco:wclsdatasp:WireCellToolkit                     39.4415       40.5398       41.9208       40.5038      0.856364        10     
reco:gaushit:GausHitFinder                         0.838387       1.3348        1.88336       1.2966       0.301007        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000466537   0.000706888   0.000821923   0.000731492   0.000119084      10     
reco:reco3d:SpacePointSolver                        4.50653       16.2505       28.4542       16.2141       7.43106        10     
reco:hitpdune:DisambigFromSpacePoints              0.729426       1.55902        2.335        1.56822      0.494513        10     
reco:pandora:StandardPandora                        11.7442       37.174        55.2289       39.8416       14.8451        10     
reco:pandoraWriter:StandardPandora                  0.27741      0.439746      0.547216      0.450395      0.0828132       10     
reco:pandoraTrack:LArPandoraTrackCreation           3.8442        8.17404       12.6088       8.87865       2.9036         10     
reco:pandoraShower:LArPandoraShowerCreation         3.95933       10.239        17.4718       10.8611       4.45055        10     
reco:pandoracalo:Calorimetry                        1.72173       3.88475       5.7423        4.16863       1.35334        10     
reco:pandoracalonosce:Calorimetry                   1.58135       3.62719       5.45965       3.78225       1.30815        10     
reco:pandorapid:Chi2ParticleID                    0.00377516    0.00547117    0.00676606    0.00546673    0.000935422      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.030219      0.0488521     0.0661282     0.0507369     0.0100282       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00367764    0.00531956    0.00649742    0.00538739    0.000861932      10     
reco:pandoraShowercalo:ShowerCalorimetry            3.08513       9.05809       15.7074       9.6697        3.97991        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.98183       8.88419       15.2729       10.012        3.82106        10     
reco:emtrkmichelid:EmTrackMichelId                  97.2189       155.545       191.669       162.52        29.8607        10     
reco:crttag:SingleCRTMatchingProducer              0.013673      0.0233355     0.029905      0.0254591    0.00536657       10     
reco:crtreco:TwoCRTMatchingProducer                0.0110798     0.0177392     0.023661      0.0176549    0.00465421       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.684828       1.03395       1.29334       1.09669      0.198394        10     
reco:pandora2Track:LArPandoraTrackCreation          10.1208       26.3995       41.6823       23.8818       10.4896        10     
reco:pandora2calo:Calorimetry                       4.0383        11.7019       20.2916       10.1827       4.94151        10     
reco:pandora2calonosce:Calorimetry                  3.84024       11.2816       18.4578       9.32028       4.99543        10     
reco:pandora2pid:Chi2ParticleID                   0.00878892     0.0132876     0.0176287     0.0129716     0.0027624       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0425858     0.0614762     0.0809334     0.0617293     0.0117085       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00931516     0.0127555     0.0163442     0.0125084    0.00218263       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.54542       8.60697       14.5997       8.02369       3.32105        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.14334       9.4381        16.1247       9.16927       3.95136        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      2.65217       7.92483       12.4925       8.1497        3.22365        10     
[art]:TriggerResults:TriggerResultInserter        3.6764e-05    4.88592e-05   9.7932e-05    4.4924e-05    1.68489e-05      10     
end_path:out1:RootOutput                           4.023e-06    6.4898e-06    1.3041e-05     5.685e-06    2.46828e-06      10     
end_path:out1:RootOutput(write)                     1.49421       2.47571       3.15465       2.51677      0.494371        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5040.95 MB
  Peak resident set size usage (VmHWM): 4237.32 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.20 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.15 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.13 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10706484
-rw-r--r-- 1 gl05pi8 eddie_users 2493383662 Dec 20 05:32 detsim_stage2.root
-rw-r--r-- 1 gl05pi8 eddie_users 2361328833 Dec 20 05:30 detsim_stage1.root
-rw-r--r-- 1 gl05pi8 eddie_users 2207939024 Dec 20 06:37 reco_stage1.root
-rw-r--r-- 1 gl05pi8 eddie_users 1953054238 Dec 20 04:17 g4_stage2.root
-rw-r--r-- 1 gl05pi8 eddie_users 1865496643 Dec 20 04:04 g4_stage1.root
-rw-r--r-- 1 gl05pi8 eddie_users   81363720 Dec 20 06:33 Pandora_Events.pndr
-rw-r--r-- 1 gl05pi8 eddie_users     491223 Dec 20 06:37 jobscript.log
-rw-r--r-- 1 gl05pi8 eddie_users     217088 Dec 20 06:37 mem.db
-rw-r--r-- 1 gl05pi8 eddie_users      62376 Dec 20 06:37 Pandora_Geometry.xml
-rw-r--r-- 1 gl05pi8 eddie_users      36864 Dec 20 06:37 time.db
-rw-r--r-- 1 gl05pi8 eddie_users        519 Dec 20 05:32 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 gl05pi8 eddie_users        519 Dec 20 04:17 g4_protoDUNE_hist.root
-rw-r--r-- 1 gl05pi8 eddie_users        519 Dec 20 06:37 protoDUNE_reco1_hist.root
-rw-r--r-- 1 gl05pi8 eddie_users         52 Dec 20 03:58 all-input-dids.txt
-rw-r--r-- 1 gl05pi8 eddie_users          7 Dec 20 06:37 justin-processed-pfns.txt
-rw-r--r-- 1 gl05pi8 eddie_users          0 Dec 20 05:37 ProtoDUNE.log
-rw-r--r-- 1 gl05pi8 eddie_users          0 Dec 20 05:32 debugprod.log
justIN time: 2026-02-07 06:33:53 UTC       justIN version: 01.06.00