justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301418.1@dunegpschedd01.fnal.gov

Jobsub ID301418.1@dunegpschedd01.fnal.gov
Workflow ID12427
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-27 08:23:10
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce507
Last heartbeat2026-01-27 11:59:35
From worker nodeHostnameb9p11p6894.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-27 08:24:07
Input filesmonte-carlo-012427-000001
JobscriptExit code0
Real time3h (12838s)
CPU time3h (11380s = 88%)
Max RSS bytes4250812416 (4053 MiB)
Outputting started2026-01-27 11:58:06
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12427/1/001/reco_stage1.root
Finished2026-01-27 11:59:35
Saved logsjustin-logs:301418.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

are:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 130400 traces, 0 summary
Retagger: tagging trace set: gauss with 98455 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 98455 traces tagged "gauss"
FrameSaver: q=3.44808e+06 n=1757003 tag=gauss
wclsFrameSaver: saving 130400 traces tagged "wiener"
FrameSaver: q=3.66191e+06 n=1561496 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 40044 XUs and 26178 XVs -> 316 XUVs
C:0 T:1 101846 XUs and 55738 XVs -> 5357 XUVs
C:0 T:2 72647 XUs and 102950 XVs -> 4533 XUVs
C:0 T:3 35141 XUs and 41281 XVs -> 508 XUVs
C:0 T:4 10310 XUs and 11288 XVs -> 96 XUVs
C:0 T:5 35197 XUs and 27868 XVs -> 3043 XUVs
C:0 T:6 118720 XUs and 147670 XVs -> 7692 XUVs
C:0 T:7 46778 XUs and 55501 XVs -> 580 XUVs
C:0 T:8 10089 XUs and 9478 XVs -> 154 XUVs
C:0 T:9 57932 XUs and 69527 XVs -> 4650 XUVs
C:0 T:10 30630 XUs and 29395 XVs -> 3031 XUVs
C:0 T:11 172 XUs and 128 XVs -> 20 XUVs
29980 XUVs total
11508 collection wire objects
26565 potential space points
Neighbour search...
1141879 tests to find 623748 neighbours
Iterating with no regularization...
Begin: 6.9644e+07
0 5.41576e+07
1 5.3354e+07
2 5.32471e+07
3 5.32186e+07
Now with regularization...
Begin: 4.3351e+07
0 4.33152e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411994243
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411994243
fLifetime: 30000 [us]
27-Jan-2026 12:58:03 CET  Closed output file "reco_stage1.root"
27-Jan-2026 12:58:03 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          269.619       324.559       491.599       303.138       64.3044        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000995855   0.00288349    0.00422902    0.00280984    0.00103049       10     
reco:ophit:OpHitFinder                             0.181912      0.254275      0.363412       0.23476      0.0551867       10     
reco:opflash:OpFlashFinder                          0.10222      0.136718      0.199656      0.131558      0.0253577       10     
reco:opslicer:OpSlicer                             0.281289      0.615334       1.16724      0.614928      0.224167        10     
reco:caldata:DataPrepModule                         4.0079        5.48166       6.92036       5.56933       1.07529        10     
reco:wclsdatasp:WireCellToolkit                     28.7317       32.5974       37.9452       32.4924       3.24842        10     
reco:gaushit:GausHitFinder                         0.851772       1.18895       1.78559       1.07448      0.281511        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000314005   0.000514397   0.000732971   0.000504957   0.000127881      10     
reco:reco3d:SpacePointSolver                        9.06931       19.5032       45.2236       17.135        11.2565        10     
reco:hitpdune:DisambigFromSpacePoints               1.12173       1.65683       3.11931       1.40303      0.607493        10     
reco:pandora:StandardPandora                        22.7108       34.1901       79.8212       26.8542       16.6859        10     
reco:pandoraWriter:StandardPandora                 0.272357      0.411691      0.660514      0.405417      0.101301        10     
reco:pandoraTrack:LArPandoraTrackCreation           1.79622       2.8795        5.68919       2.6448        1.06181        10     
reco:pandoraShower:LArPandoraShowerCreation         2.09671       3.37841       6.34752       2.9991        1.19859        10     
reco:pandoracalo:Calorimetry                        1.18157       1.77694       3.39838       1.57189      0.615949        10     
reco:pandoracalonosce:Calorimetry                   1.00324       1.64744       3.2458        1.47005      0.613884        10     
reco:pandorapid:Chi2ParticleID                    0.00362649    0.00545606    0.00804834    0.00540597    0.00139553       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0360813     0.0594147     0.0860428     0.0583164     0.0156012       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00367802    0.00524953    0.00772882    0.00508075    0.00125402       10     
reco:pandoraShowercalo:ShowerCalorimetry            1.88596       3.81477       7.0015        3.7235        1.39571        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       1.83035       3.54396       6.18331       3.33337       1.18996        10     
reco:emtrkmichelid:EmTrackMichelId                  149.241       176.204       233.904       169.582       24.0016        10     
reco:crttag:SingleCRTMatchingProducer             0.00843153     0.013025      0.0176644     0.0133494    0.00297545       10     
reco:crtreco:TwoCRTMatchingProducer               0.00518808    0.00785866     0.0116298    0.00761416    0.00179324       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.596178      0.829222       1.06869      0.803751      0.148751        10     
reco:pandora2Track:LArPandoraTrackCreation          6.23632       9.45379       13.3851       8.7545        2.2242         10     
reco:pandora2calo:Calorimetry                       2.94496       5.14786        6.656        5.32869       1.26237        10     
reco:pandora2calonosce:Calorimetry                  2.78533       4.80973       6.57121       4.86526       1.14455        10     
reco:pandora2pid:Chi2ParticleID                   0.00845383     0.011813      0.0162197     0.0108318    0.00299797       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0440305     0.0602832     0.0867364     0.0614617     0.0137462       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00798976     0.0111112     0.0156413     0.010522     0.00265729       10     
reco:pandora2Shower:LArPandoraShowerCreation        2.21938       3.52385       5.19858       3.30863      0.930032        10     
reco:pandora2Showercalo:ShowerCalorimetry           2.63341       4.41032       6.47089       4.4221        1.08058        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      2.38541       4.17224       5.72853       4.25966      0.988549        10     
[art]:TriggerResults:TriggerResultInserter        4.3451e-05    6.34571e-05   0.000134272   5.7186e-05    2.55441e-05      10     
end_path:out1:RootOutput                           8.14e-06     1.00822e-05    1.669e-05     8.915e-06    2.44381e-06      10     
end_path:out1:RootOutput(write)                     2.11395       2.66479       3.18964       2.58266       0.35982        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5083.96 MB
  Peak resident set size usage (VmHWM): 4250.81 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.24 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.47 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.14 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9778452
-rw-r--r--. 1 duneprd np-comp 2311081297 Jan 27 11:59 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2202879591 Jan 27 11:55 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 1998080422 Jan 27 12:58 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 1744811134 Jan 27 09:54 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1679991621 Jan 27 09:35 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp   75677490 Jan 27 12:53 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp     243122 Jan 27 12:58 jobscript.log
-rw-r--r--. 1 duneprd np-comp     217088 Jan 27 12:58 mem.db
-rw-r--r--. 1 duneprd np-comp      62376 Jan 27 12:58 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp      36864 Jan 27 12:58 time.db
-rw-r--r--. 1 duneprd np-comp        519 Jan 27 11:59 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jan 27 09:54 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jan 27 12:58 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp         52 Jan 27 09:24 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp          7 Jan 27 12:58 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp          0 Jan 27 12:07 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp          0 Jan 27 11:59 debugprod.log
justIN time: 2026-02-04 19:29:21 UTC       justIN version: 01.06.00