justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264365.10@dunegpschedd01.fnal.gov

Jobsub ID264365.10@dunegpschedd01.fnal.gov
Workflow ID11030
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 11:05:54
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 18:59:52
From worker nodeHostnamedunegli-7832233-0-fnpc18004.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 11:06:21
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T013158Z_gen_003117_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (28393s)
CPU time7h (28016s = 98%)
Max RSS bytes3049590784 (2908 MiB)
Outputting started2025-12-06 18:59:35
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11030/1/001/analysisLowE_20251206T110622Z.root
Finished2025-12-06 18:59:52
Saved logsjustin-logs:264365.10-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

put 2: 0.0239951, 0.0720117, 0.898151, 0.0058418, 
Output 3: 0.972875, 0.0226097, 0.00138657, 0.00312879, 
Output 4: 0.492087, 0.436575, 0.0588731, 0.0124642, 
Output 5: 0.317488, 0.473189, 0.16003, 0.0492935, 
Output 6: 0.0665569, 0.147788, 0.107406, 0.678249, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 31170 at 06-Dec-2025 18:11:11 UTC
Boundary wire vector sizes: 6803, 6741, 6762
minwire 0: 22
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1842, 2341
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0689675, 
Output 1: 0.0229137, 0.0372907, 0.0704527, 0.869343, 
Output 2: 0.103699, 0.329819, 0.507711, 0.058772, 
Output 3: 0.932991, 0.0389377, 0.00917529, 0.0188956, 
Output 4: 0.462379, 0.467269, 0.0644673, 0.00588455, 
Output 5: 0.88032, 0.107529, 0.00986808, 0.00228254, 
Output 6: 0.00944583, 0.0247826, 0.0399997, 0.925772, 

06-Dec-2025 18:58:07 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 18:58:07 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/28/3a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T013158Z_gen_003117_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2637.34       2813.34       2987.56       2819.23       97.9534        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00184659    0.00996949     0.036928     0.00629129     0.0104994       10     
reco:pandora:StandardPandora                            2633.74       2809.02       2983.73       2815.01       98.0161        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00222306     0.0329899     0.139444      0.0128786     0.0390951       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00182754    0.00879026     0.0260818     0.0074739    0.00632545       10     
reco:pandoracalo:Calorimetry                          0.00058759     0.0102569     0.0460674    0.000999584    0.0154783       10     
reco:pandorapid:Chi2ParticleID                        9.7374e-05    0.00052809     0.0035505    0.000165768   0.00101329       10     
reco:cvnmap:CVNMapper                                  0.0453188     0.0586602     0.0759105     0.0570152     0.0110413       10     
reco:cvneva:CVNEvaluator                                2.15612       3.44488       5.10161       3.33815      0.841965        10     
reco:energyrecnumu:EnergyReco                          0.0037209     0.0810651     0.216864      0.0728906     0.0703989       10     
reco:energyrecnue:EnergyReco                          0.00227963    0.00682457     0.0176395    0.00262454    0.00637755       10     
reco:energyrecnc:EnergyReco                            0.0143269     0.0722243     0.142775      0.0662759     0.0564681       10     
[art]:TriggerResults:TriggerResultInserter            2.2202e-05    3.81751e-05   0.000142239   2.5303e-05    3.49706e-05      10     
end_path:out1:RootOutput                               1.027e-05    1.45534e-05   4.3241e-05    1.14865e-05   9.58981e-06      10     
end_path:out1:RootOutput(write)                        0.562925       0.59534      0.670348      0.580002      0.036664        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21783.9 MB
  Peak resident set size usage (VmHWM): 3049.59 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 371.675 | hit correction : 1.46558
hit initial : 332.74 | hit correction : 1.46518
hit initial : 212.752 | hit correction : 1.46455
hit initial : 98.5012 | hit correction : 1.46429
 *** Total Charge : 5294.53
 Looking at view: 1 | Number of hits in view: 24
hit initial : 62.3208 | hit correction : 1.46186
hit initial : 24.0302 | hit correction : 1.46184
hit initial : 144.782 | hit correction : 1.47075
hit initial : 130.178 | hit correction : 1.47054
hit initial : 55.5371 | hit correction : 1.47033
hit initial : 136.447 | hit correction : 1.47037
hit initial : 215.087 | hit correction : 1.47055
hit initial : 280.565 | hit correction : 1.46992
hit initial : 254.893 | hit correction : 1.46907
hit initial : 249.815 | hit correction : 1.46844
hit initial : 186.267 | hit correction : 1.46786
hit initial : 158.61 | hit correction : 1.46733
hit initial : 143.134 | hit correction : 1.46697
hit initial : 136.557 | hit correction : 1.46658
hit initial : 143.769 | hit correction : 1.46617
hit initial : 189.864 | hit correction : 1.46577
hit initial : 245.159 | hit correction : 1.46547
hit initial : 170.702 | hit correction : 1.46524
hit initial : 132.457 | hit correction : 1.46485
hit initial : 130.79 | hit correction : 1.46453
hit initial : 124.534 | hit correction : 1.46425
hit initial : 60.0482 | hit correction : 1.46409
 *** Total Charge : 4953.6
 Looking at view: 2 | Number of hits in view: 22
Begin processing the 10th record. run: 5027 subRun: 0 event: 31170 at 06-Dec-2025 18:59:29 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  36
Added hit list length: 36 | Max was set to: -3.40282e+38
True Neutron Energy: 939.572
True Neutron Energy: 941.263
True Neutron Energy: 939.727
True Electron Energy: 26.9763
Completed MCParticle Loop
True Neutrino Energy: 44.2327
 Size of all hits: 36
hit initial : 193.932 | hit correction : 1.31419
hit initial : 404.717 | hit correction : 1.3142
hit initial : 349.841 | hit correction : 1.31431
hit initial : 275.945 | hit correction : 1.31469
hit initial : 223.978 | hit correction : 1.31499
hit initial : 193.602 | hit correction : 1.31541
hit initial : 174.184 | hit correction : 1.31575
hit initial : 141.816 | hit correction : 1.31594
hit initial : 67.7836 | hit correction : 1.31602
hit initial : 19.7267 | hit correction : 1.31764
hit initial : 94.8486 | hit correction : 1.32403
hit initial : 45.9734 | hit correction : 1.32399
hit initial : 99.8015 | hit correction : 1.32458
hit initial : 107.086 | hit correction : 1.32446
hit initial : 147.163 | hit correction : 1.32459
 *** Total Charge : 3344.93
 Looking at view: 1 | Number of hits in view: 15
hit initial : 46.6064 | hit correction : 1.32459
hit initial : 379.209 | hit correction : 1.32443
hit initial : 76.82 | hit correction : 1.32457
hit initial : 34.7942 | hit correction : 1.30109
hit initial : 152.075 | hit correction : 1.30106
hit initial : 20.3459 | hit correction : 1.30106
hit initial : 44.3806 | hit correction : 1.30618
hit initial : 92.0696 | hit correction : 1.30619
hit initial : 154.642 | hit correction : 1.30744
hit initial : 34.6032 | hit correction : 1.30748
hit initial : 77.3231 | hit correction : 1.3075
hit initial : 180.619 | hit correction : 1.31412
hit initial : 152.864 | hit correction : 1.31415
hit initial : 347.981 | hit correction : 1.31422
hit initial : 114.416 | hit correction : 1.31426
hit initial : 231.657 | hit correction : 1.31445
hit initial : 297.794 | hit correction : 1.31478
hit initial : 248.229 | hit correction : 1.31521
hit initial : 279.725 | hit correction : 1.31572
hit initial : 172.478 | hit correction : 1.31598
hit initial : 29.2773 | hit correction : 1.32399
 *** Total Charge : 4164.31
 Looking at view: 2 | Number of hits in view: 21
06-Dec-2025 18:59:34 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.123316      0.227036      0.771351      0.154958      0.184461        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00054501    0.000780829   0.00152462    0.000691713   0.000266404      10     
end_path:ana:AnalyzeEvents         0.122532      0.225994      0.770112      0.154086      0.184377        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19478 MB
  Peak resident set size usage (VmHWM): 1534.84 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:11:02 UTC       justIN version: 01.06.00