justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265673.1@dunegpschedd02.fnal.gov

Jobsub ID265673.1@dunegpschedd02.fnal.gov
Workflow ID11489
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-03 13:51:51
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce513
Last heartbeat2026-01-03 16:42:13
From worker nodeHostnameb9p04p5106.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-03 13:52:29
Input filesmonte-carlo-011489-000001
JobscriptExit code0
Real time2h (10102s)
CPU time2h (8986s = 88%)
Max RSS bytes4012228608 (3826 MiB)
Outputting started2026-01-03 16:40:52
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11489/1/001/reco_stage1.root
Finished2026-01-03 16:42:13
Saved logsjustin-logs:265673.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

nning tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 144480 traces, 0 summary
Retagger: tagging trace set: gauss with 106468 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 106468 traces tagged "gauss"
FrameSaver: q=3.69389e+06 n=1814119 tag=gauss
wclsFrameSaver: saving 144480 traces tagged "wiener"
FrameSaver: q=3.95759e+06 n=1583400 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 36049 XUs and 38440 XVs -> 304 XUVs
C:0 T:1 87499 XUs and 76789 XVs -> 5208 XUVs
C:0 T:2 217828 XUs and 102020 XVs -> 11541 XUVs
C:0 T:3 51012 XUs and 42383 XVs -> 486 XUVs
C:0 T:4 15149 XUs and 14969 XVs -> 205 XUVs
C:0 T:5 73259 XUs and 50945 XVs -> 8393 XUVs
C:0 T:6 66777 XUs and 55564 XVs -> 3114 XUVs
C:0 T:7 26534 XUs and 24393 XVs -> 287 XUVs
C:0 T:8 10405 XUs and 7812 XVs -> 99 XUVs
C:0 T:9 94705 XUs and 81637 XVs -> 9859 XUVs
C:0 T:10 80985 XUs and 34407 XVs -> 14531 XUVs
C:0 T:11 330 XUs and 185 XVs -> 48 XUVs
54075 XUVs total
12743 collection wire objects
50282 potential space points
Neighbour search...
8522030 tests to find 3869246 neighbours
Iterating with no regularization...
Begin: 8.88739e+07
0 6.91999e+07
1 6.8086e+07
2 6.79237e+07
3 6.78738e+07
Now with regularization...
Begin: 5.72984e+07
0 5.72189e+07
1 5.71644e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411515887
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411515887
fLifetime: 30000 [us]
03-Jan-2026 17:40:51 CET  Closed output file "reco_stage1.root"
03-Jan-2026 17:40:51 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          175.27        234.941       281.958       241.285       33.4314        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000849833   0.00305325    0.00513004    0.00317452    0.00142029       10     
reco:ophit:OpHitFinder                             0.176588      0.220889      0.247851      0.223293      0.0205994       10     
reco:opflash:OpFlashFinder                         0.0834346      0.13483      0.182922      0.135457      0.0249809       10     
reco:opslicer:OpSlicer                             0.313459      0.463276      0.557181      0.485376      0.0712689       10     
reco:caldata:DataPrepModule                         3.87549       4.07301       4.42555       4.00113      0.167611        10     
reco:wclsdatasp:WireCellToolkit                     24.7973       27.4026       28.7562       27.6035       1.17885        10     
reco:gaushit:GausHitFinder                         0.526371      0.758887      0.900017      0.765332       0.1117         10     
reco:nhitsfilter:NumberOfHitsFilter               0.000272804   0.000351274   0.000430207   0.00035317    4.69294e-05      10     
reco:reco3d:SpacePointSolver                        6.30563       12.9429       25.7576       12.443        5.47262        10     
reco:hitpdune:DisambigFromSpacePoints              0.602528       1.07734       1.29844       1.14211      0.225608        10     
reco:pandora:StandardPandora                        11.4212       20.9228       31.667        20.5284       6.08821        10     
reco:pandoraWriter:StandardPandora                 0.220688      0.295108      0.350242      0.304021      0.0395357       10     
reco:pandoraTrack:LArPandoraTrackCreation           1.20496       2.19809        2.78         2.26937      0.443865        10     
reco:pandoraShower:LArPandoraShowerCreation         1.07431       2.40108       3.46516       2.62436      0.713535        10     
reco:pandoracalo:Calorimetry                       0.777003       1.50273       2.44612       1.44381      0.427379        10     
reco:pandoracalonosce:Calorimetry                   0.7005        1.38246       2.18729       1.35884       0.38316        10     
reco:pandorapid:Chi2ParticleID                    0.00332146    0.00416039    0.00644503    0.00386712    0.000928587      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0237871     0.038771      0.0645895     0.0347557     0.0123419       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID           0.0027198    0.00386971    0.00617884    0.00348238    0.00106654       10     
reco:pandoraShowercalo:ShowerCalorimetry            0.99465       2.69335       4.16188       2.90994      0.900994        10     
reco:pandoraShowercalonosce:ShowerCalorimetry      0.956338       2.6045        4.03108       2.84918      0.884038        10     
reco:emtrkmichelid:EmTrackMichelId                  92.1638       127.467       157.41        129.635       18.0995        10     
reco:crttag:SingleCRTMatchingProducer             0.00654514    0.00863252     0.010791     0.00888446    0.00145509       10     
reco:crtreco:TwoCRTMatchingProducer                0.0040886    0.00547232    0.00719257    0.00555344    0.000841038      10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.410462      0.669598      0.953003      0.633048      0.172486        10     
reco:pandora2Track:LArPandoraTrackCreation          3.0743        7.18351       10.9218       7.52861       2.11692        10     
reco:pandora2calo:Calorimetry                       1.65558       3.74488       5.01007       4.26696       1.01502        10     
reco:pandora2calonosce:Calorimetry                  1.59483       3.63403       4.76704       4.08548       1.02035        10     
reco:pandora2pid:Chi2ParticleID                    0.0060003     0.008322      0.010106     0.00882064    0.00116553       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0272149     0.041954      0.0503136     0.0427546     0.0062383       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00583382    0.00817601     0.0101383    0.00864163    0.00122145       10     
reco:pandora2Shower:LArPandoraShowerCreation        1.2385        2.54618       3.1269        2.78141       0.56121        10     
reco:pandora2Showercalo:ShowerCalorimetry           1.63796       3.30836       4.27576       3.74269      0.839616        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      1.30024       3.05582       3.88874       3.46267      0.788124        10     
[art]:TriggerResults:TriggerResultInserter        3.6361e-05    5.03547e-05   0.000128932   4.00905e-05   2.66684e-05      10     
end_path:out1:RootOutput                           8.13e-06     1.00132e-05    1.494e-05     9.495e-06    1.84786e-06      10     
end_path:out1:RootOutput(write)                     1.46002       2.05983       2.35018       2.09137       0.26543        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4840.03 MB
  Peak resident set size usage (VmHWM): 4012.23 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.17 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.55 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.10 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9448932
-rw-r--r--. 1 duneprd np-comp 2245899802 Jan  3 16:58 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2134126028 Jan  3 16:57 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 1906258723 Jan  3 17:40 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 1696147675 Jan  3 15:16 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1623915041 Jan  3 14:59 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp   68739460 Jan  3 17:37 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp     242968 Jan  3 17:40 jobscript.log
-rw-r--r--. 1 duneprd np-comp     217088 Jan  3 17:40 mem.db
-rw-r--r--. 1 duneprd np-comp      62376 Jan  3 17:40 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp      36864 Jan  3 17:40 time.db
-rw-r--r--. 1 duneprd np-comp        519 Jan  3 16:59 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jan  3 15:16 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jan  3 17:40 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp         52 Jan  3 14:52 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp          7 Jan  3 17:40 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp          0 Jan  3 17:03 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp          0 Jan  3 16:59 debugprod.log
justIN time: 2026-02-06 22:18:29 UTC       justIN version: 01.06.00