justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258304.0@dunegpschedd02.fnal.gov

Jobsub ID258304.0@dunegpschedd02.fnal.gov
Workflow ID11029
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 00:04:18
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 07:59:09
From worker nodeHostnamedunegli-7989277-0-fnpc17126.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:39:50
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T222520Z_gen_000273_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (22744s)
CPU time6h (22511s = 98%)
Max RSS bytes3039604736 (2898 MiB)
Outputting started2025-12-06 07:58:56
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11029/1/001/analysisLowE_20251206T013951Z.root
Finished2025-12-06 07:59:09
Saved logsjustin-logs:258304.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

97, 0.652289, 0.0638225, 
Output 3: 0.969372, 0.0101391, 0.00421546, 0.0162731, 
Output 4: 0.938117, 0.0545919, 0.00568224, 0.00160882, 
Output 5: 0.479986, 0.294959, 0.165012, 0.0600435, 
Output 6: 0.0270331, 0.057525, 0.0626301, 0.852812, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 2730 at 06-Dec-2025 07:14:29 UTC
Boundary wire vector sizes: 6772, 6580, 6702
minwire 0: 39
minwire 1: 1
minwire 2: 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1214, 1713
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.122219, 
Output 1: 0.234109, 0.0966763, 0.211431, 0.457784, 
Output 2: 0.0481572, 0.077714, 0.862669, 0.0114601, 
Output 3: 0.973584, 0.0244272, 0.000760023, 0.00122825, 
Output 4: 0.54488, 0.413461, 0.0349564, 0.00670273, 
Output 5: 0.196277, 0.402289, 0.26772, 0.133714, 
Output 6: 0.163594, 0.284691, 0.142357, 0.409358, 

06-Dec-2025 07:57:23 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 07:57:23 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d2/50/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T222520Z_gen_000273_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1878.57       2242.67       2565.88       2219.33       234.002        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0019512     0.0119168     0.0421192    0.00744467     0.0113721       10     
reco:pandora:StandardPandora                            1876.12       2239.91       2564.06       2217.28       233.372        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00620898     0.0435625     0.175182      0.0362383     0.0456073       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00126809    0.00703882     0.0250074    0.00585619    0.00615138       10     
reco:pandoracalo:Calorimetry                          0.000389434   0.00475512     0.0363063    0.000714947    0.010582        10     
reco:pandorapid:Chi2ParticleID                        0.000112845   0.000403209   0.00153185    0.000174888   0.000493509      10     
reco:cvnmap:CVNMapper                                  0.0494137     0.0724714     0.129217      0.0641588     0.0238518       10     
reco:cvneva:CVNEvaluator                               0.953504        1.819        5.98863       1.47043       1.40505        10     
reco:energyrecnumu:EnergyReco                          0.0103421     0.0749877     0.192331      0.0227602     0.071434        10     
reco:energyrecnue:EnergyReco                          0.00120042    0.00441902     0.0158177    0.00209377    0.00503699       10     
reco:energyrecnc:EnergyReco                            0.0126918     0.0936831      0.19841      0.117655      0.0687145       10     
[art]:TriggerResults:TriggerResultInserter            1.8901e-05    3.34171e-05   0.000106611   2.6262e-05     2.464e-05       10     
end_path:out1:RootOutput                               8.714e-06    1.33625e-05   3.6941e-05    1.0773e-05    7.96275e-06      10     
end_path:out1:RootOutput(write)                        0.382307       0.62542      0.886952      0.629856      0.131992        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 14230.3 MB
  Peak resident set size usage (VmHWM): 3039.6 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 29.7241 | hit correction : 1.38482
hit initial : 392.346 | hit correction : 1.38426
hit initial : 64.002 | hit correction : 1.38403
 *** Total Charge : 3271.59
 Looking at view: 2 | Number of hits in view: 13
Begin processing the 10th record. run: 5027 subRun: 0 event: 2730 at 06-Dec-2025 07:58:47 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  61
Added hit list length: 61 | Max was set to: -3.40282e+38
True Neutron Energy: 939.569
True Electron Energy: 61.9756
Completed MCParticle Loop
True Neutrino Energy: 67.4769
 Size of all hits: 61
hit initial : 53.9038 | hit correction : 1.10581
hit initial : 24.4203 | hit correction : 1.10277
hit initial : 48.8287 | hit correction : 1.10754
hit initial : 111.825 | hit correction : 1.10921
hit initial : 42.0604 | hit correction : 1.10994
hit initial : 45.8385 | hit correction : 1.11037
hit initial : 109.609 | hit correction : 1.10679
hit initial : 235.969 | hit correction : 1.10679
hit initial : 241.242 | hit correction : 1.10685
hit initial : 243.129 | hit correction : 1.10696
hit initial : 111.975 | hit correction : 1.10708
hit initial : 104.261 | hit correction : 1.10848
hit initial : 224.388 | hit correction : 1.10849
hit initial : 963.487 | hit correction : 1.10848
hit initial : 1243.56 | hit correction : 1.10882
hit initial : 934.455 | hit correction : 1.10895
hit initial : 290.566 | hit correction : 1.10981
hit initial : 386.878 | hit correction : 1.11
hit initial : 355.508 | hit correction : 1.11015
hit initial : 296.35 | hit correction : 1.11061
hit initial : 256.381 | hit correction : 1.11088
hit initial : 159.467 | hit correction : 1.11103
 *** Total Charge : 7189.97
 Looking at view: 0 | Number of hits in view: 22
hit initial : 180.8 | hit correction : 1.10888
hit initial : 59.8585 | hit correction : 1.10836
hit initial : 26.969 | hit correction : 1.10892
hit initial : 124.29 | hit correction : 1.10679
hit initial : 302.407 | hit correction : 1.1068
hit initial : 259.291 | hit correction : 1.10688
hit initial : 211.348 | hit correction : 1.10699
hit initial : 250.426 | hit correction : 1.10724
hit initial : 246.234 | hit correction : 1.10768
hit initial : 273.139 | hit correction : 1.10809
hit initial : 613.515 | hit correction : 1.10858
hit initial : 777.105 | hit correction : 1.10852
hit initial : 600.901 | hit correction : 1.10907
hit initial : 1398.61 | hit correction : 1.10886
hit initial : 364.693 | hit correction : 1.10946
hit initial : 420.024 | hit correction : 1.10984
hit initial : 420.738 | hit correction : 1.11001
hit initial : 334.523 | hit correction : 1.1103
hit initial : 284.844 | hit correction : 1.11074
hit initial : 243.87 | hit correction : 1.11094
hit initial : 95.7922 | hit correction : 1.11106
 *** Total Charge : 8304.5
 Looking at view: 1 | Number of hits in view: 21
hit initial : 233.406 | hit correction : 1.10681
hit initial : 778.668 | hit correction : 1.10692
hit initial : 83.6265 | hit correction : 1.10689
hit initial : 206.719 | hit correction : 1.10755
hit initial : 311.007 | hit correction : 1.10828
hit initial : 196.589 | hit correction : 1.1079
hit initial : 85.3625 | hit correction : 1.10849
hit initial : 212.994 | hit correction : 1.10845
hit initial : 176.213 | hit correction : 1.10851
hit initial : 444.606 | hit correction : 1.1084
hit initial : 833.16 | hit correction : 1.10889
hit initial : 2018.9 | hit correction : 1.10902
hit initial : 188.557 | hit correction : 1.10917
hit initial : 78.4061 | hit correction : 1.10993
hit initial : 213.943 | hit correction : 1.10997
hit initial : 742.841 | hit correction : 1.11005
hit initial : 69.972 | hit correction : 1.11084
hit initial : 582.187 | hit correction : 1.11086
 *** Total Charge : 8268.67
 Looking at view: 2 | Number of hits in view: 18
06-Dec-2025 07:58:54 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0977265      1.02688       4.36112      0.301648       1.36216        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000366295   0.00199774     0.0152679    0.000553479    0.0044245       10     
end_path:ana:AnalyzeEvents         0.0971571      1.02471       4.36038      0.300888       1.36309        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11956.7 MB
  Peak resident set size usage (VmHWM): 1537.34 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:15 UTC       justIN version: 01.06.00