justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261263.2@dunegpschedd02.fnal.gov

Jobsub ID261263.2@dunegpschedd02.fnal.gov
Workflow ID11091
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:06:38
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 02:03:33
From worker nodeHostnamedunegli-7878615-0-fnpc19122.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:06:52
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T012954Z_gen_003316_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (14185s)
CPU time3h (14084s = 99%)
Max RSS bytes3013472256 (2873 MiB)
Outputting started2025-12-12 02:03:17
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11091/1/001/analysisLowE_20251211T220652Z.root
Finished2025-12-12 02:03:33
Saved logsjustin-logs:261263.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

: 0.0509404, 0.267915, 0.652262, 0.0288825, 
Output 3: 0.912475, 0.066304, 0.0104878, 0.0107336, 
Output 4: 0.390283, 0.534447, 0.0699467, 0.0053228, 
Output 5: 0.642241, 0.297858, 0.051211, 0.00869079, 
Output 6: 0.0132783, 0.0463391, 0.0639706, 0.876412, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 33160 at 12-Dec-2025 01:38:56 UTC
Boundary wire vector sizes: 6616, 6557, 6676
minwire 0: 53
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1664, 2163
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.100739, 
Output 1: 0.294922, 0.0882617, 0.272181, 0.344635, 
Output 2: 0.0232716, 0.0577379, 0.912096, 0.0068945, 
Output 3: 0.959888, 0.0333269, 0.0026463, 0.00413919, 
Output 4: 0.562593, 0.381059, 0.0451951, 0.011153, 
Output 5: 0.212527, 0.448699, 0.248644, 0.0901299, 
Output 6: 0.162131, 0.231001, 0.119575, 0.487293, 

12-Dec-2025 02:02:37 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:02:38 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/f7/50/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T012954Z_gen_003316_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1340.66       1405.98       1443.18       1402.32       28.141         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00113646    0.00443147     0.0143933    0.00349671    0.00342476       10     
reco:pandora:StandardPandora                            1337.96       1404.65        1442         1401.12       28.4899        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0015325     0.0220058     0.0608624     0.0226235     0.0158154       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00154743    0.00424473     0.0076359    0.00411221    0.00172528       10     
reco:pandoracalo:Calorimetry                          0.000222822   0.00255218     0.0209023    0.000320477   0.00613024       10     
reco:pandorapid:Chi2ParticleID                        7.5111e-05    0.000184037   0.000599434   8.8956e-05    0.000177681      10     
reco:cvnmap:CVNMapper                                  0.0229371     0.0305481     0.0548141     0.0260597    0.00947077       10     
reco:cvneva:CVNEvaluator                                0.76039      0.904467       2.12968      0.770225      0.408459        10     
reco:energyrecnumu:EnergyReco                         0.00537306     0.0418499     0.136959      0.0119069     0.0443468       10     
reco:energyrecnue:EnergyReco                          0.000790705   0.00211811    0.00661533    0.00086649    0.00224166       10     
reco:energyrecnc:EnergyReco                           0.00634035     0.0431176     0.072672      0.0623738     0.0301487       10     
[art]:TriggerResults:TriggerResultInserter             1.218e-05    2.01152e-05    6.91e-05      1.429e-05    1.65933e-05      10     
end_path:out1:RootOutput                               6.74e-06      9.724e-06     2.299e-05     7.345e-06    5.21928e-06      10     
end_path:out1:RootOutput(write)                        0.268175      0.279834      0.310791       0.27336      0.0131868       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21780.7 MB
  Peak resident set size usage (VmHWM): 3013.47 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 68.9524 | hit correction : 1.04457
hit initial : 32.9118 | hit correction : 1.04541
hit initial : 493.97 | hit correction : 1.04558
hit initial : 49.293 | hit correction : 1.04607
hit initial : 103.769 | hit correction : 1.04619
hit initial : 104.678 | hit correction : 1.04781
 *** Total Charge : 2497.58
 Looking at view: 1 | Number of hits in view: 15
hit initial : 156.477 | hit correction : 1.04296
hit initial : 199.091 | hit correction : 1.04292
hit initial : 217.895 | hit correction : 1.04266
hit initial : 344.369 | hit correction : 1.0425
hit initial : 1068.09 | hit correction : 1.04342
hit initial : 35.7907 | hit correction : 1.04382
hit initial : 453.952 | hit correction : 1.0447
hit initial : 347.899 | hit correction : 1.04546
hit initial : 338.65 | hit correction : 1.04606
hit initial : 275.86 | hit correction : 1.04658
hit initial : 253.152 | hit correction : 1.0471
hit initial : 453.641 | hit correction : 1.04776
 *** Total Charge : 4330.15
 Looking at view: 2 | Number of hits in view: 12
Begin processing the 10th record. run: 5026 subRun: 0 event: 33160 at 12-Dec-2025 02:03:14 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  44
Added hit list length: 44 | Max was set to: -3.40282e+38
True Neutron Energy: 939.575
True Electron Energy: 32.3914
Completed MCParticle Loop
True Neutrino Energy: 35.7128
 Size of all hits: 44
hit initial : 63.4589 | hit correction : 1.09257
hit initial : 303.55 | hit correction : 1.09304
hit initial : 417.384 | hit correction : 1.09262
hit initial : 122.81 | hit correction : 1.09259
hit initial : 138.573 | hit correction : 1.09193
hit initial : 40.1605 | hit correction : 1.09187
hit initial : 32.1439 | hit correction : 1.09582
hit initial : 75.6787 | hit correction : 1.09579
hit initial : 241.43 | hit correction : 1.09357
hit initial : 231.855 | hit correction : 1.09345
hit initial : 443.466 | hit correction : 1.09353
hit initial : 565.429 | hit correction : 1.09346
hit initial : 339.642 | hit correction : 1.09335
hit initial : 235.773 | hit correction : 1.09314
hit initial : 251.588 | hit correction : 1.09297
hit initial : 250.688 | hit correction : 1.09282
hit initial : 176.373 | hit correction : 1.09265
 *** Total Charge : 4296.15
 Looking at view: 0 | Number of hits in view: 17
hit initial : 226.535 | hit correction : 1.09275
hit initial : 24.0013 | hit correction : 1.09187
hit initial : 51.9408 | hit correction : 1.09352
hit initial : 75.089 | hit correction : 1.09266
hit initial : 39.1207 | hit correction : 1.0919
hit initial : 311.978 | hit correction : 1.09353
hit initial : 203.642 | hit correction : 1.0927
hit initial : 46.8351 | hit correction : 1.09188
hit initial : 373.881 | hit correction : 1.09351
hit initial : 538.373 | hit correction : 1.09347
hit initial : 388.719 | hit correction : 1.09335
hit initial : 247.246 | hit correction : 1.09275
hit initial : 137.402 | hit correction : 1.09262
hit initial : 30.0903 | hit correction : 1.09257
hit initial : 287.725 | hit correction : 1.09293
hit initial : 273.647 | hit correction : 1.09311
 *** Total Charge : 3559.44
 Looking at view: 1 | Number of hits in view: 16
hit initial : 27.041 | hit correction : 1.09252
hit initial : 728.969 | hit correction : 1.09347
hit initial : 970.603 | hit correction : 1.09289
hit initial : 1018.33 | hit correction : 1.09348
hit initial : 121.861 | hit correction : 1.09577
hit initial : 27.824 | hit correction : 1.0958
hit initial : 21.3098 | hit correction : 1.09382
hit initial : 466.018 | hit correction : 1.09248
hit initial : 152.048 | hit correction : 1.09192
hit initial : 272.517 | hit correction : 1.09285
hit initial : 209.207 | hit correction : 1.09322
 *** Total Charge : 4389.94
 Looking at view: 2 | Number of hits in view: 11
12-Dec-2025 02:03:17 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.072609      0.0862054     0.0966322     0.0881383     0.0076549       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000339462   0.000633468   0.00123789    0.000457348   0.000307526      10     
end_path:ana:AnalyzeEvents         0.0721192     0.0853868     0.0960035     0.087264     0.00763698       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.5 MB
  Peak resident set size usage (VmHWM): 1533.96 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:25:19 UTC       justIN version: 01.06.00