justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266180.0@dunegpschedd01.fnal.gov

Jobsub ID266180.0@dunegpschedd01.fnal.gov
Workflow ID11111
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 17:05:11
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 16:24:37
From worker nodeHostnamedunegli-7867871-0-fnpc9064.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 08:49:24
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T193052Z_gen_002375_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (27299s)
CPU time7h (27060s = 99%)
Max RSS bytes2915426304 (2780 MiB)
Outputting started2025-12-11 16:24:24
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11111/1/001/analysisLowE_20251211T084925Z.root
Finished2025-12-11 16:24:37
Saved logsjustin-logs:266180.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

59467, 0.115326, 0.118773, 0.679954, 
Output 2: 0.0457508, 0.184861, 0.757977, 0.0114104, 
Output 3: 0.954143, 0.0398042, 0.00238607, 0.00366675, 
Output 4: 0.460246, 0.465681, 0.0655151, 0.00855708, 
Output 5: 0.179644, 0.668649, 0.136309, 0.0153979, 
Output 6: 0.0739214, 0.153346, 0.127629, 0.645104, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 23750 at 11-Dec-2025 15:44:20 UTC
Boundary wire vector sizes: 6563, 6554, 6616
minwire 0: 9
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1909, 2408
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0816582, 
Output 1: 0.0379997, 0.0479201, 0.0812192, 0.832861, 
Output 2: 0.0985048, 0.350933, 0.510895, 0.0396672, 
Output 3: 0.940848, 0.0460465, 0.00568442, 0.00742122, 
Output 4: 0.367238, 0.544623, 0.0815708, 0.00656893, 
Output 5: 0.802757, 0.182169, 0.0129699, 0.00210382, 
Output 6: 0.0136309, 0.0525263, 0.0713864, 0.862457, 

11-Dec-2025 16:23:19 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 16:23:19 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/a2/b9/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T193052Z_gen_002375_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2331.06       2696.7        3343.22       2705.88       290.747        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00319005     0.0112869     0.0209579    0.00951564    0.00477156       10     
reco:pandora:StandardPandora                            2328.41       2693.42       3335.95        2703         289.668        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000527348    0.0430447     0.227656      0.0079945     0.0666087       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000536747   0.00685718     0.0255875    0.00578994    0.00661549       10     
reco:pandoracalo:Calorimetry                          0.000334454    0.014152      0.0542015    0.00213979     0.0202107       10     
reco:pandorapid:Chi2ParticleID                        8.9198e-05    0.000443376   0.00198987    0.000161255   0.00062363       10     
reco:cvnmap:CVNMapper                                  0.0530257     0.0803813     0.143987      0.0703865     0.0256168       10     
reco:cvneva:CVNEvaluator                                1.76217       2.33188       5.86118       1.9722        1.17985        10     
reco:energyrecnumu:EnergyReco                          0.0115689       0.104       0.211869      0.113417      0.0661434       10     
reco:energyrecnue:EnergyReco                          0.00214995    0.00689682     0.0138805    0.00548062    0.00476389       10     
reco:energyrecnc:EnergyReco                           0.00810871     0.0596324     0.136739      0.0140902     0.0587959       10     
[art]:TriggerResults:TriggerResultInserter            2.3176e-05    4.23668e-05   0.000133281   3.18695e-05   3.09245e-05      10     
end_path:out1:RootOutput                               5.447e-06    1.2029e-05    4.1731e-05     9.489e-06    1.00078e-05      10     
end_path:out1:RootOutput(write)                        0.403264      0.622413      0.763153      0.642735      0.093916        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12008.3 MB
  Peak resident set size usage (VmHWM): 2915.43 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
True Electron Energy: 5.86789
Completed MCParticle Loop
True Neutrino Energy: 11.6287
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 23749 at 11-Dec-2025 16:24:13 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  55
Added hit list length: 55 | Max was set to: -3.40282e+38
True Electron Energy: 44.0612
Completed MCParticle Loop
True Neutrino Energy: 59.6085
 Size of all hits: 55
hit initial : 56.457 | hit correction : 1.28436
hit initial : 145.688 | hit correction : 1.28012
hit initial : 161.634 | hit correction : 1.2801
hit initial : 51.3919 | hit correction : 1.28007
hit initial : 31.5348 | hit correction : 1.28897
hit initial : 44.3618 | hit correction : 1.28254
hit initial : 226.448 | hit correction : 1.28264
hit initial : 101.919 | hit correction : 1.28255
hit initial : 139.724 | hit correction : 1.28317
hit initial : 553.349 | hit correction : 1.28414
hit initial : 460.624 | hit correction : 1.28459
hit initial : 355.27 | hit correction : 1.285
hit initial : 256.192 | hit correction : 1.28549
hit initial : 240.082 | hit correction : 1.28599
hit initial : 218.629 | hit correction : 1.28643
hit initial : 222.917 | hit correction : 1.28693
hit initial : 224.944 | hit correction : 1.2875
hit initial : 234.368 | hit correction : 1.28794
hit initial : 289.063 | hit correction : 1.28829
hit initial : 262.003 | hit correction : 1.28834
hit initial : 86.2397 | hit correction : 1.28829
 *** Total Charge : 5607.24
 Looking at view: 0 | Number of hits in view: 21
hit initial : 135.886 | hit correction : 1.28008
hit initial : 169.438 | hit correction : 1.28012
hit initial : 55.6401 | hit correction : 1.28015
hit initial : 73.0167 | hit correction : 1.28435
hit initial : 25.7767 | hit correction : 1.2834
hit initial : 55.0319 | hit correction : 1.28253
hit initial : 87.0751 | hit correction : 1.28321
hit initial : 111.101 | hit correction : 1.28255
hit initial : 129.818 | hit correction : 1.2832
hit initial : 47.6836 | hit correction : 1.28252
hit initial : 281.446 | hit correction : 1.28443
hit initial : 290.236 | hit correction : 1.28468
hit initial : 461.172 | hit correction : 1.28514
hit initial : 365.452 | hit correction : 1.28597
hit initial : 406.601 | hit correction : 1.28681
hit initial : 471.342 | hit correction : 1.28786
hit initial : 437.123 | hit correction : 1.28825
hit initial : 145.307 | hit correction : 1.28837
 *** Total Charge : 4819.04
 Looking at view: 1 | Number of hits in view: 18
hit initial : 39.3379 | hit correction : 1.28255
hit initial : 205.97 | hit correction : 1.28006
hit initial : 172.746 | hit correction : 1.28014
hit initial : 20.8205 | hit correction : 1.28024
hit initial : 84.9253 | hit correction : 1.28258
hit initial : 399.747 | hit correction : 1.28265
hit initial : 172.031 | hit correction : 1.28327
hit initial : 214.552 | hit correction : 1.28364
hit initial : 547.175 | hit correction : 1.28436
hit initial : 791.422 | hit correction : 1.28486
hit initial : 475.738 | hit correction : 1.28583
hit initial : 338.2 | hit correction : 1.28671
hit initial : 324.806 | hit correction : 1.28754
hit initial : 377.344 | hit correction : 1.28819
hit initial : 120.844 | hit correction : 1.28816
hit initial : 281.516 | hit correction : 1.28841
 *** Total Charge : 5868.91
 Looking at view: 2 | Number of hits in view: 16
Begin processing the 10th record. run: 5026 subRun: 0 event: 23750 at 11-Dec-2025 16:24:18 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.574
True Electron Energy: 20.9337
Completed MCParticle Loop
True Neutrino Energy: 24.223
 Size of all hits: 0
11-Dec-2025 16:24:23 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0733421     0.134618      0.210561       0.13525      0.0425553       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000349691   0.000486632   0.000788301   0.000442012   0.000130051      10     
end_path:ana:AnalyzeEvents         0.072876      0.133976      0.209956      0.134584      0.0425513       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9807.21 MB
  Peak resident set size usage (VmHWM): 1535.09 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 15:01:02 UTC       justIN version: 01.06.00