justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255665.1@dunegpschedd01.fnal.gov

Jobsub ID255665.1@dunegpschedd01.fnal.gov
Workflow ID10538
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-11-23 12:38:51
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce504
Last heartbeat2025-11-23 15:28:24
From worker nodeHostnameb9p02p6866.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-23 12:39:27
Input filesmonte-carlo-010538-000001
JobscriptExit code0
Real time2h (10009s)
CPU time2h (9413s = 94%)
Max RSS bytes4015157248 (3829 MiB)
Outputting started2025-11-23 15:26:17
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10538/1/001/reco_stage1.root
Finished2025-11-23 15:28:24
Saved logsjustin-logs:255665.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 117694 traces, 0 summary
Retagger: tagging trace set: gauss with 90508 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 90508 traces tagged "gauss"
FrameSaver: q=3.17091e+06 n=1604805 tag=gauss
wclsFrameSaver: saving 117694 traces tagged "wiener"
FrameSaver: q=3.32627e+06 n=1411943 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 32331 XUs and 42816 XVs -> 376 XUVs
C:0 T:1 64407 XUs and 83566 XVs -> 6169 XUVs
C:0 T:2 68268 XUs and 64993 XVs -> 2798 XUVs
C:0 T:3 35546 XUs and 28307 XVs -> 129 XUVs
C:0 T:4 15539 XUs and 9616 XVs -> 128 XUVs
C:0 T:5 75475 XUs and 38250 XVs -> 5559 XUVs
C:0 T:6 109795 XUs and 72384 XVs -> 4842 XUVs
C:0 T:8 5798 XUs and 6399 XVs -> 94 XUVs
C:0 T:9 31562 XUs and 58065 XVs -> 3202 XUVs
C:0 T:10 33142 XUs and 17195 XVs -> 3042 XUVs
C:0 T:11 65 XUs and 44 XVs -> 10 XUVs
26349 XUVs total
10423 collection wire objects
24215 potential space points
Neighbour search...
1583593 tests to find 795868 neighbours
Iterating with no regularization...
Begin: 8.56769e+07
0 7.39204e+07
1 7.3243e+07
2 7.31497e+07
3 7.31202e+07
Now with regularization...
Begin: 6.36934e+07
0 6.36629e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410690262
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410690262
fLifetime: 30000 [us]
23-Nov-2025 16:26:15 CET  Closed output file "reco_stage1.root"
23-Nov-2025 16:26:15 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          196.054       248.629       359.74        237.378       50.1793        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000806836   0.00304735    0.00441798    0.00349377    0.00119847       10     
reco:ophit:OpHitFinder                             0.188072      0.233945      0.263032      0.240464      0.0203105       10     
reco:opflash:OpFlashFinder                          0.10206      0.139932       0.17139      0.140614      0.0204484       10     
reco:opslicer:OpSlicer                             0.380256      0.478092      0.586868      0.482977      0.0639877       10     
reco:caldata:DataPrepModule                         3.81287       4.40366       5.40962       4.31854      0.500434        10     
reco:wclsdatasp:WireCellToolkit                     25.9097       28.2303       31.9429       27.838        2.05154        10     
reco:gaushit:GausHitFinder                         0.574737      0.981026       1.73733      0.940627       0.33732        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000287402   0.000422196   0.000650404   0.000360403   0.00013253       10     
reco:reco3d:SpacePointSolver                        6.1375        11.4296       18.8965       11.4835        4.296         10     
reco:hitpdune:DisambigFromSpacePoints              0.530154       1.1446        1.83306       1.13924      0.362601        10     
reco:pandora:StandardPandora                        12.7206       22.0452       43.3701       19.1859       8.7553         10     
reco:pandoraWriter:StandardPandora                 0.215749      0.295305      0.381005       0.28368      0.052275        10     
reco:pandoraTrack:LArPandoraTrackCreation           1.20315       2.27879       3.52082       2.3172       0.740745        10     
reco:pandoraShower:LArPandoraShowerCreation         1.17153       2.77477       5.2952        2.59835       1.20839        10     
reco:pandoracalo:Calorimetry                       0.782122       1.51231       3.0634        1.30002      0.651161        10     
reco:pandoracalonosce:Calorimetry                  0.683119       1.35474       3.45536       1.19206      0.748585        10     
reco:pandorapid:Chi2ParticleID                    0.00273171    0.00377196    0.00689788    0.00344471    0.00117235       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0286343     0.0378135     0.0576691     0.0351747    0.00785428       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00244819    0.00351662    0.00521049    0.00336208    0.000822996      10     
reco:pandoraShowercalo:ShowerCalorimetry            1.14777       2.94751       4.96453       2.68172       1.26581        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       1.07677       2.74333       4.51556       2.57644       1.08011        10     
reco:emtrkmichelid:EmTrackMichelId                  106.845       137.366       188.75        131.759       24.244         10     
reco:crttag:SingleCRTMatchingProducer              0.0081307     0.0109606     0.0142051     0.0107186    0.00186038       10     
reco:crtreco:TwoCRTMatchingProducer               0.00456126    0.00629126     0.0085403    0.00631736    0.00113192       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.590783      0.701546      0.928657      0.649135      0.108776        10     
reco:pandora2Track:LArPandoraTrackCreation          4.12239       7.61982       11.9558       7.31155       2.53407        10     
reco:pandora2calo:Calorimetry                       1.89469       4.07949       6.50846       3.93368       1.49904        10     
reco:pandora2calonosce:Calorimetry                  1.82658       3.85652       6.17372       3.81689       1.43866        10     
reco:pandora2pid:Chi2ParticleID                   0.00617143    0.00890119     0.0125343    0.00897486    0.00183977       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0324006     0.0454476     0.0565715     0.0456715    0.00679545       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00596325    0.00866637     0.0109377    0.00901893    0.00162799       10     
reco:pandora2Shower:LArPandoraShowerCreation        1.37332       2.72458       4.76574       2.50625      0.994922        10     
reco:pandora2Showercalo:ShowerCalorimetry           1.60861       3.64004       6.16393       3.30595       1.50494        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      1.67114       3.23843       5.38995       3.17627       1.07814        10     
[art]:TriggerResults:TriggerResultInserter         3.541e-05    5.49554e-05   0.000113191    4.756e-05    2.28574e-05      10     
end_path:out1:RootOutput                           5.52e-06     8.2462e-06    1.2741e-05     8.115e-06    1.87957e-06      10     
end_path:out1:RootOutput(write)                     1.51517       2.19727       2.98236       2.09664      0.482446        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4865.94 MB
  Peak resident set size usage (VmHWM): 4015.16 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.20 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.76 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9493348
-rw-r--r--. 1 duneprd np-comp 2252099451 Nov 23 15:41 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2139501218 Nov 23 15:40 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 1921288633 Nov 23 16:26 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 1705978958 Nov 23 13:56 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1630908422 Nov 23 13:47 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp   70796240 Nov 23 16:23 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp     243054 Nov 23 16:26 jobscript.log
-rw-r--r--. 1 duneprd np-comp     217088 Nov 23 16:26 mem.db
-rw-r--r--. 1 duneprd np-comp      62376 Nov 23 16:26 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp      36864 Nov 23 16:26 time.db
-rw-r--r--. 1 duneprd np-comp        519 Nov 23 15:41 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Nov 23 13:56 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Nov 23 16:26 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp         52 Nov 23 13:39 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp          7 Nov 23 16:26 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp          0 Nov 23 15:47 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp          0 Nov 23 15:41 debugprod.log
justIN time: 2026-02-08 21:38:20 UTC       justIN version: 01.06.00