justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266043.23@dunegpschedd01.fnal.gov

Jobsub ID266043.23@dunegpschedd01.fnal.gov
Workflow ID11087
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 13:59:01
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-11 19:24:50
From worker nodeHostnamedunegli-8028879-0-fnpc9056.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 08:39:18
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T233757Z_gen_004221_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (38710s)
CPU time10h (37932s = 97%)
Max RSS bytes2985697280 (2847 MiB)
Outputting started2025-12-11 19:24:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11087/1/001/analysisLowE_20251211T083919Z.root
Finished2025-12-11 19:24:50
Saved logsjustin-logs:266043.23-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

15, 0.555762, 
Output 2: 0.0381952, 0.157134, 0.783347, 0.0213241, 
Output 3: 0.957435, 0.0290302, 0.0049968, 0.0085378, 
Output 4: 0.368491, 0.542032, 0.0799945, 0.00948185, 
Output 5: 0.288268, 0.475815, 0.193326, 0.0425911, 
Output 6: 0.0358471, 0.086348, 0.0924804, 0.785325, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 42210 at 11-Dec-2025 18:26:23 UTC
Boundary wire vector sizes: 6608, 6424, 6561
minwire 0: 44
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1925, 2424
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.135458, 
Output 1: 0.0914639, 0.0612369, 0.142302, 0.704998, 
Output 2: 0.0539052, 0.231993, 0.688058, 0.0260434, 
Output 3: 0.968384, 0.0185226, 0.00398416, 0.00910938, 
Output 4: 0.475607, 0.426991, 0.0847734, 0.0126287, 
Output 5: 0.527576, 0.408034, 0.0561489, 0.00824197, 
Output 6: 0.0176739, 0.055579, 0.0716954, 0.855052, 

11-Dec-2025 19:22:57 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 19:22:57 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/75/96/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T233757Z_gen_004221_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3386.49       3831.23       4371.22       3763.1        300.294        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00458464     0.0191511     0.0356173     0.0199908    0.00723983       10     
reco:pandora:StandardPandora                            3383.62       3787.7        4300.66       3692.74       275.944        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00253622     0.0767399     0.348302      0.0421032     0.0980146       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00342664     0.0163066     0.0750542    0.00965939     0.0200212       10     
reco:pandoracalo:Calorimetry                          0.000623344    0.033931      0.0982111    0.00961296     0.0407099       10     
reco:pandorapid:Chi2ParticleID                        0.000152237   0.00107313    0.00600976    0.000276557   0.00178881       10     
reco:cvnmap:CVNMapper                                  0.0733274     0.117398      0.153725      0.116424      0.0230021       10     
reco:cvneva:CVNEvaluator                                1.98968       2.84709       8.34082       2.2409        1.83418        10     
reco:energyrecnumu:EnergyReco                          0.0122361      26.9637       68.3272      0.158206       32.9431        10     
reco:energyrecnue:EnergyReco                          0.00243942     0.0103372     0.0199452     0.0107992    0.00668177       10     
reco:energyrecnc:EnergyReco                            0.0145044      12.7963       65.3426      0.0162253      25.5213        10     
[art]:TriggerResults:TriggerResultInserter            2.6589e-05    5.94771e-05   0.000182087   5.05095e-05   4.18002e-05      10     
end_path:out1:RootOutput                               8.846e-06    2.19459e-05   5.6741e-05    1.60605e-05   1.33067e-05      10     
end_path:out1:RootOutput(write)                        0.567611      0.641927      0.831197      0.623124      0.0707643       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12084.6 MB
  Peak resident set size usage (VmHWM): 2985.7 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
True Neutrino Energy: 8.84858
 Size of all hits: 0
Begin processing the 8th record. run: 5026 subRun: 0 event: 42208 at 11-Dec-2025 19:24:10 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 21.6713
Completed MCParticle Loop
True Neutrino Energy: 27.0547
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 42209 at 11-Dec-2025 19:24:16 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Electron Energy: 11.8657
Completed MCParticle Loop
True Neutrino Energy: 19.6518
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 42210 at 11-Dec-2025 19:24:22 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  50
Added hit list length: 50 | Max was set to: -3.40282e+38
True Neutron Energy: 939.569
True Electron Energy: 28.7726
Completed MCParticle Loop
True Neutrino Energy: 34.1778
 Size of all hits: 50
hit initial : 96.8245 | hit correction : 1.38023
hit initial : 41.189 | hit correction : 1.38024
hit initial : 34.784 | hit correction : 1.38405
hit initial : 89.0639 | hit correction : 1.38531
hit initial : 74.2088 | hit correction : 1.38416
hit initial : 192.141 | hit correction : 1.38528
hit initial : 141.858 | hit correction : 1.38439
hit initial : 361.144 | hit correction : 1.38807
hit initial : 46.0018 | hit correction : 1.38529
hit initial : 53.4983 | hit correction : 1.38453
hit initial : 67.6343 | hit correction : 1.3835
hit initial : 351.23 | hit correction : 1.38896
hit initial : 305.601 | hit correction : 1.38773
hit initial : 183.429 | hit correction : 1.3835
hit initial : 164.056 | hit correction : 1.38929
hit initial : 136.643 | hit correction : 1.38777
hit initial : 106.84 | hit correction : 1.38347
hit initial : 57.1392 | hit correction : 1.38792
 *** Total Charge : 3470.32
 Looking at view: 0 | Number of hits in view: 18
hit initial : 61.5315 | hit correction : 1.39532
hit initial : 72.3429 | hit correction : 1.39534
hit initial : 71.6954 | hit correction : 1.38952
hit initial : 152.22 | hit correction : 1.38936
hit initial : 43.4528 | hit correction : 1.38539
hit initial : 158.568 | hit correction : 1.38532
hit initial : 87.4264 | hit correction : 1.38429
hit initial : 69.782 | hit correction : 1.38528
hit initial : 68.7512 | hit correction : 1.38419
hit initial : 55.0635 | hit correction : 1.38517
hit initial : 132.494 | hit correction : 1.3842
hit initial : 38.8176 | hit correction : 1.38468
hit initial : 135.312 | hit correction : 1.38353
hit initial : 101.032 | hit correction : 1.38753
hit initial : 272.861 | hit correction : 1.38769
hit initial : 306.684 | hit correction : 1.38797
hit initial : 228.587 | hit correction : 1.38853
hit initial : 201.658 | hit correction : 1.38903
 *** Total Charge : 3133.27
 Looking at view: 1 | Number of hits in view: 18
hit initial : 40.6395 | hit correction : 1.38955
hit initial : 167.016 | hit correction : 1.38942
hit initial : 147.016 | hit correction : 1.38746
hit initial : 66.2933 | hit correction : 1.38538
hit initial : 215.008 | hit correction : 1.38535
hit initial : 127.702 | hit correction : 1.3841
hit initial : 142.694 | hit correction : 1.38513
hit initial : 160.391 | hit correction : 1.38431
hit initial : 115.006 | hit correction : 1.38469
hit initial : 165.387 | hit correction : 1.38762
hit initial : 230.198 | hit correction : 1.38792
hit initial : 231.597 | hit correction : 1.38817
hit initial : 170.053 | hit correction : 1.38869
hit initial : 187.717 | hit correction : 1.38908
 *** Total Charge : 3005.28
 Looking at view: 2 | Number of hits in view: 14
11-Dec-2025 19:24:28 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.120289      0.174278      0.226258      0.178749      0.0342765       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000735195   0.00996415     0.0547866    0.000807765    0.0185948       10     
end_path:ana:AnalyzeEvents         0.118916      0.164041      0.215009      0.160357      0.0306516       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9812.49 MB
  Peak resident set size usage (VmHWM): 1536 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:29:00 UTC       justIN version: 01.06.00