justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265242.1@dunegpschedd02.fnal.gov

Jobsub ID265242.1@dunegpschedd02.fnal.gov
Workflow ID11437
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-31 09:13:40
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2025-12-31 12:48:58
From worker nodeHostnameccwcondor0587
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-31 09:14:42
Input filesmonte-carlo-011437-000001
JobscriptExit code0
Real time3h (12766s)
CPU time3h (12212s = 95%)
Max RSS bytes4301848576 (4102 MiB)
Outputting started2025-12-31 12:47:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11437/1/001/reco_stage1.root
Finished2025-12-31 12:48:58
Saved logsjustin-logs:265242.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

BasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 97534 traces, 0 summary
Retagger: tagging trace set: gauss with 75071 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 75071 traces tagged "gauss"
FrameSaver: q=2.54284e+06 n=1324238 tag=gauss
wclsFrameSaver: saving 97534 traces tagged "wiener"
FrameSaver: q=2.67973e+06 n=1165744 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 25182 XUs and 15161 XVs -> 103 XUVs
C:0 T:1 35376 XUs and 25106 XVs -> 2363 XUVs
C:0 T:2 51700 XUs and 103778 XVs -> 3943 XUVs
C:0 T:3 26728 XUs and 39276 XVs -> 239 XUVs
C:0 T:4 8664 XUs and 6792 XVs -> 146 XUVs
C:0 T:5 61165 XUs and 28562 XVs -> 11568 XUVs
C:0 T:6 95429 XUs and 109467 XVs -> 6131 XUVs
C:0 T:7 34145 XUs and 38102 XVs -> 416 XUVs
C:0 T:8 6839 XUs and 6291 XVs -> 57 XUVs
C:0 T:9 35769 XUs and 44428 XVs -> 2129 XUVs
C:0 T:10 31122 XUs and 18037 XVs -> 4915 XUVs
32010 XUVs total
8648 collection wire objects
30194 potential space points
Neighbour search...
4409426 tests to find 2028638 neighbours
Iterating with no regularization...
Begin: 4.4865e+07
0 3.70612e+07
1 3.65096e+07
2 3.64297e+07
3 3.64066e+07
Now with regularization...
Begin: 2.97722e+07
0 2.97355e+07
1 2.97129e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411451448
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411451448
fLifetime: 30000 [us]
31-Dec-2025 13:47:26 CET  Closed output file "reco_stage1.root"
31-Dec-2025 13:47:26 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          295.223       412.825       539.861       410.593       69.5965        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                             0.0014241    0.00607489     0.0103382    0.00633729    0.00287162       10     
reco:ophit:OpHitFinder                             0.272304      0.321653      0.359793      0.332212      0.0264312       10     
reco:opflash:OpFlashFinder                         0.134502      0.172212      0.212294      0.173493      0.0245905       10     
reco:opslicer:OpSlicer                              0.40381       0.6945       0.844158      0.721499      0.124227        10     
reco:caldata:DataPrepModule                         5.29533       6.84064       7.44781       7.13034      0.703991        10     
reco:wclsdatasp:WireCellToolkit                     36.6864       43.1831       47.8771       43.6318       2.88712        10     
reco:gaushit:GausHitFinder                         0.976237       1.33022       1.54354       1.36093      0.170853        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000467876   0.000730643   0.00121968    0.000653633   0.000227943      10     
reco:reco3d:SpacePointSolver                        13.3855       22.3646       60.4943       19.9708       13.2746        10     
reco:hitpdune:DisambigFromSpacePoints               1.12729       1.58068       2.1918        1.50908      0.359633        10     
reco:pandora:StandardPandora                        20.3851       34.9675       51.9319       35.1632       10.197         10     
reco:pandoraWriter:StandardPandora                 0.399608       0.54401      0.696857      0.547529      0.0763943       10     
reco:pandoraTrack:LArPandoraTrackCreation           3.49073       6.72011       8.19499       7.28108       1.37682        10     
reco:pandoraShower:LArPandoraShowerCreation         4.38129       7.65729       11.8598       7.8662        2.30425        10     
reco:pandoracalo:Calorimetry                        2.05313       3.99582       5.20071       4.12538      0.928222        10     
reco:pandoracalonosce:Calorimetry                   1.90289       3.79832       5.22361       3.76792       0.91146        10     
reco:pandorapid:Chi2ParticleID                    0.00563118    0.00796192    0.00984558    0.00836585    0.00132019       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0492751     0.0695727     0.0792968     0.0722622    0.00861212       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00595887    0.00737023     0.0081239    0.00749573    0.000649041      10     
reco:pandoraShowercalo:ShowerCalorimetry            4.54673       8.0857        11.3127       8.28242       2.49718        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       4.22743       7.42359       10.8656       7.42236       2.23867        10     
reco:emtrkmichelid:EmTrackMichelId                  153.594       193.07        233.171       190.463       22.7671        10     
reco:crttag:SingleCRTMatchingProducer              0.0193209     0.0259156     0.0421869     0.0244222    0.00682498       10     
reco:crtreco:TwoCRTMatchingProducer                0.0137677     0.0178537     0.0223111     0.0175319    0.00254272       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.676603      0.867235       1.14394      0.889285      0.139794        10     
reco:pandora2Track:LArPandoraTrackCreation          13.7673       19.7672       26.1758       19.2817       4.11997        10     
reco:pandora2calo:Calorimetry                       7.39714       11.1934       14.9921       11.3552       2.78208        10     
reco:pandora2calonosce:Calorimetry                  4.38908       10.0974       15.0163       9.64508       3.34617        10     
reco:pandora2pid:Chi2ParticleID                   0.00836383     0.0164991     0.0224818     0.0167313    0.00338404       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0469632     0.0868346     0.0998384     0.0907483     0.0150649       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00890683     0.0163745     0.0194053     0.0170237    0.00287858       10     
reco:pandora2Shower:LArPandoraShowerCreation        4.02488       7.42458       10.473        7.47635       1.86279        10     
reco:pandora2Showercalo:ShowerCalorimetry           4.41812       8.93305       12.3145       9.07575       2.69435        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      4.7133        8.4412        12.0566       9.42274       2.76695        10     
[art]:TriggerResults:TriggerResultInserter        6.9269e-05    0.000115369   0.000182471   0.000110531   3.48512e-05      10     
end_path:out1:RootOutput                          1.3456e-05    2.00666e-05   2.8082e-05    1.9201e-05    4.44756e-06      10     
end_path:out1:RootOutput(write)                     1.75913       2.86804       3.62845       2.94815      0.500458        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5126.52 MB
  Peak resident set size usage (VmHWM): 4301.85 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.33 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.24 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.18 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9406860
-rw-r--r-- 1 dune001 lbno 2233758945 Dec 31 12:36 detsim_stage2.root
-rw-r--r-- 1 dune001 lbno 2126050599 Dec 31 12:33 detsim_stage1.root
-rw-r--r-- 1 dune001 lbno 1875327411 Dec 31 13:47 reco_stage1.root
-rw-r--r-- 1 dune001 lbno 1705386332 Dec 31 10:35 g4_stage2.root
-rw-r--r-- 1 dune001 lbno 1627492019 Dec 31 10:22 g4_stage1.root
-rw-r--r-- 1 dune001 lbno   63993950 Dec 31 13:43 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno     242961 Dec 31 13:47 jobscript.log
-rw-r--r-- 1 dune001 lbno     217088 Dec 31 13:47 mem.db
-rw-r--r-- 1 dune001 lbno      62376 Dec 31 13:47 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno      36864 Dec 31 13:47 time.db
-rw-r--r-- 1 dune001 lbno        519 Dec 31 12:36 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno        519 Dec 31 10:35 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno        519 Dec 31 13:47 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 lbno         52 Dec 31 10:14 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno          7 Dec 31 13:47 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno          0 Dec 31 12:44 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno          0 Dec 31 12:36 debugprod.log
justIN time: 2026-02-06 23:31:52 UTC       justIN version: 01.06.00