justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 296254.1@dunegpschedd02.fnal.gov

Jobsub ID296254.1@dunegpschedd02.fnal.gov
Workflow ID12465
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-28 08:06:26
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce512
Last heartbeat2026-01-28 12:00:01
From worker nodeHostnameb9p10p1820.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-28 08:08:26
Input filesmonte-carlo-012465-000001
JobscriptExit code0
Real time3h (13813s)
CPU time3h (13156s = 95%)
Max RSS bytes4086009856 (3896 MiB)
Outputting started2026-01-28 11:58:40
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12465/1/001/reco_stage1.root
Finished2026-01-28 12:00:01
Saved logsjustin-logs:296254.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

re:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 128330 traces, 0 summary
Retagger: tagging trace set: gauss with 97471 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 97471 traces tagged "gauss"
FrameSaver: q=3.39636e+06 n=1701445 tag=gauss
wclsFrameSaver: saving 128330 traces tagged "wiener"
FrameSaver: q=3.59934e+06 n=1495660 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35963 XUs and 36191 XVs -> 912 XUVs
C:0 T:1 59156 XUs and 55497 XVs -> 4272 XUVs
C:0 T:2 147529 XUs and 198921 XVs -> 10548 XUVs
C:0 T:3 60928 XUs and 59700 XVs -> 709 XUVs
C:0 T:4 14759 XUs and 13155 XVs -> 198 XUVs
C:0 T:5 63552 XUs and 50122 XVs -> 4553 XUVs
C:0 T:6 107985 XUs and 83955 XVs -> 4720 XUVs
C:0 T:7 41109 XUs and 30980 XVs -> 272 XUVs
C:0 T:8 6598 XUs and 5923 XVs -> 51 XUVs
C:0 T:9 36292 XUs and 40969 XVs -> 2386 XUVs
C:0 T:10 82419 XUs and 13586 XVs -> 9231 XUVs
C:0 T:11 9 XUs and 5 XVs -> 2 XUVs
37854 XUVs total
11210 collection wire objects
34392 potential space points
Neighbour search...
3875698 tests to find 1766316 neighbours
Iterating with no regularization...
Begin: 7.55486e+07
0 5.60621e+07
1 5.4792e+07
2 5.46051e+07
3 5.45475e+07
4 5.45247e+07
Now with regularization...
Begin: 4.44012e+07
0 4.43663e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 412014086
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412014086
fLifetime: 30000 [us]
28-Jan-2026 12:58:38 CET  Closed output file "reco_stage1.root"
28-Jan-2026 12:58:38 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          253.332       299.587       347.741       297.003       33.7258        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00132084    0.00325933    0.00508761    0.00311269    0.00122542       10     
reco:ophit:OpHitFinder                             0.195167      0.268628       0.36977      0.267562      0.0600332       10     
reco:opflash:OpFlashFinder                         0.110797      0.147849      0.195891      0.140368      0.0306927       10     
reco:opslicer:OpSlicer                              0.35978      0.639258      0.855605      0.632859      0.167047        10     
reco:caldata:DataPrepModule                         4.02563       5.15639       6.92428       4.71684      0.978976        10     
reco:wclsdatasp:WireCellToolkit                     28.0263       31.0677       34.1053       30.8821       1.82278        10     
reco:gaushit:GausHitFinder                         0.767656       1.21341       1.75039       1.21926      0.279488        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000368142   0.00054114    0.000776404   0.000552637   0.000110794      10     
reco:reco3d:SpacePointSolver                        10.2248       14.9884       24.5241       14.1386       3.96347        10     
reco:hitpdune:DisambigFromSpacePoints              0.959447       1.48914       2.18245       1.46721       0.37675        10     
reco:pandora:StandardPandora                        18.8284       25.9265       35.1071       23.9659       5.11217        10     
reco:pandoraWriter:StandardPandora                 0.267631      0.348048       0.56181      0.301361      0.0925961       10     
reco:pandoraTrack:LArPandoraTrackCreation           1.64786       2.62219       3.54662       2.59494      0.491796        10     
reco:pandoraShower:LArPandoraShowerCreation         2.24878       3.10248       3.88763       3.34469      0.601689        10     
reco:pandoracalo:Calorimetry                        1.17693       1.72741       2.14978       1.81307      0.334418        10     
reco:pandoracalonosce:Calorimetry                   1.10447       1.60321       2.38727       1.50109      0.433385        10     
reco:pandorapid:Chi2ParticleID                    0.00328862    0.00474738    0.00774576    0.00442258    0.00124973       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0336894     0.0455135     0.0740648     0.0410161     0.0125685       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID           0.0034184     0.004362     0.00667074    0.00395338    0.00103691       10     
reco:pandoraShowercalo:ShowerCalorimetry            2.38945       3.73498       5.68861       3.44404      0.929012        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.25979       3.44161       4.93151       3.28697      0.899874        10     
reco:emtrkmichelid:EmTrackMichelId                  143.702       166.964       195.776       163.029       16.7631        10     
reco:crttag:SingleCRTMatchingProducer             0.00969693     0.0140002     0.0178383     0.014276     0.00278756       10     
reco:crtreco:TwoCRTMatchingProducer               0.00583903    0.00814897    0.00989132     0.0084777    0.00129759       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.609427      0.892286       1.19552      0.863304      0.161194        10     
reco:pandora2Track:LArPandoraTrackCreation          5.51163       9.33002       12.4728       9.4176        1.95558        10     
reco:pandora2calo:Calorimetry                       3.08238       4.96542       7.41797       4.53076       1.21763        10     
reco:pandora2calonosce:Calorimetry                  2.94926       4.76011       7.32641       4.53595       1.14154        10     
reco:pandora2pid:Chi2ParticleID                   0.00757206     0.0112522     0.0178364     0.0104711     0.002994        10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0404216     0.0537231     0.0752389     0.049541      0.0104365       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0077343     0.0102086     0.0154292     0.010042      0.0021677       10     
reco:pandora2Shower:LArPandoraShowerCreation        2.06896       3.55004       5.5048        3.42656      0.930006        10     
reco:pandora2Showercalo:ShowerCalorimetry           2.67275       4.68894       7.83099       4.52467       1.4362         10     
reco:pandora2Showercalonosce:ShowerCalorimetry      2.48962       4.22996       6.6359        4.26027       1.07185        10     
[art]:TriggerResults:TriggerResultInserter         4.023e-05    6.3927e-05    0.00014179     5.66e-05     2.98494e-05      10     
end_path:out1:RootOutput                           6.51e-06     9.3121e-06    1.6271e-05     8.455e-06    2.63172e-06      10     
end_path:out1:RootOutput(write)                     1.89239       2.48306       2.91706       2.56134      0.292422        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4934.64 MB
  Peak resident set size usage (VmHWM): 4086.01 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.22 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.21 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.13 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9599304
-rw-r--r--. 1 duneprd np-comp 2269860477 Jan 28 12:06 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2155612818 Jan 28 12:04 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 1954143521 Jan 28 12:58 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 1718990806 Jan 28 09:31 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1656397564 Jan 28 09:17 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp   74064890 Jan 28 12:55 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp     242755 Jan 28 12:58 jobscript.log
-rw-r--r--. 1 duneprd np-comp     217088 Jan 28 12:58 mem.db
-rw-r--r--. 1 duneprd np-comp      62376 Jan 28 12:58 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp      36864 Jan 28 12:58 time.db
-rw-r--r--. 1 duneprd np-comp        519 Jan 28 12:06 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jan 28 09:31 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jan 28 12:58 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp         52 Jan 28 09:08 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp          7 Jan 28 12:58 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp          0 Jan 28 12:12 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp          0 Jan 28 12:06 debugprod.log
justIN time: 2026-02-04 18:09:32 UTC       justIN version: 01.06.00