justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257918.32@dunegpschedd02.fnal.gov

Jobsub ID257918.32@dunegpschedd02.fnal.gov
Workflow ID11027
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 11:33:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 12:29:59
From worker nodeHostnamedunegli-7832230-0-fnpc18004.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:26:41
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T200948Z_gen_002552_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (39779s)
CPU time10h (37593s = 94%)
Max RSS bytes3142688768 (2997 MiB)
Outputting started2025-12-06 12:29:41
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11027/1/001/analysisLowE_20251206T012643Z.root
Finished2025-12-06 12:29:59
Saved logsjustin-logs:257918.32-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

s due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.104304, 
Output 1: 0.0600574, 0.0751952, 0.07536, 0.789387, 
Output 2: 0.0418513, 0.260823, 0.675198, 0.0221282, 
Output 3: 0.963741, 0.026379, 0.00302452, 0.0068555, 
Output 4: 0.699317, 0.259381, 0.0363319, 0.00496982, 
Output 5: 0.310907, 0.508886, 0.157944, 0.0222631, 
Output 6: 0.0144601, 0.0398819, 0.0614037, 0.884254, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 25520 at 06-Dec-2025 11:43:10 UTC
Boundary wire vector sizes: 6814, 6720, 6663
minwire 0: 36
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.136425, 
Output 1: 0.05602, 0.0733634, 0.16156, 0.709057, 
Output 2: 0.0349604, 0.235841, 0.702406, 0.0267921, 
Output 3: 0.939147, 0.0432798, 0.00877715, 0.00879571, 
Output 4: 0.262638, 0.612648, 0.116265, 0.00844861, 
Output 5: 0.476225, 0.381723, 0.121655, 0.0203972, 
Output 6: 0.017315, 0.061637, 0.082053, 0.838995, 

06-Dec-2025 12:28:20 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 12:28:21 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/1e/b1/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T200948Z_gen_002552_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2703.37       3944.03       4417.09       4093.42       545.043        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00382834     0.0138879     0.0512764    0.00929726     0.0128181       10     
reco:pandora:StandardPandora                            2699.71       3884.54       4346.63       4017.37       518.724        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00185073     0.0534037     0.282497      0.0255038     0.0792484       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000680065    0.0178299     0.0752449    0.00385506     0.0263528       10     
reco:pandoracalo:Calorimetry                          0.000492039   0.00379901     0.0162735    0.00108454    0.00561308       10     
reco:pandorapid:Chi2ParticleID                        0.000151476   0.000922857   0.00730466    0.000192643   0.00212847       10     
reco:cvnmap:CVNMapper                                  0.0428726     0.0824501     0.136926      0.0785502     0.0260952       10     
reco:cvneva:CVNEvaluator                                2.39556       4.10149       9.18067       3.37714       1.83938        10     
reco:energyrecnumu:EnergyReco                          0.0110783      41.0354       74.3172       64.3096       33.5682        10     
reco:energyrecnue:EnergyReco                          0.00213503    0.00483511     0.0156259     0.0035062    0.00375843       10     
reco:energyrecnc:EnergyReco                            0.0140296      13.5761       69.3195      0.0173444      27.1266        10     
[art]:TriggerResults:TriggerResultInserter            2.0789e-05    7.46581e-05   0.000336606   4.26505e-05   8.91272e-05      10     
end_path:out1:RootOutput                              1.1432e-05    2.92002e-05   0.000123844   1.90565e-05   3.18263e-05      10     
end_path:out1:RootOutput(write)                        0.432582      0.596663      0.776447      0.595598      0.0953686       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21810.2 MB
  Peak resident set size usage (VmHWM): 3142.69 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
Begin processing the 9th record. run: 5026 subRun: 0 event: 25519 at 06-Dec-2025 12:29:30 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  30
Added hit list length: 30 | Max was set to: -3.40282e+38
True Electron Energy: 12.8937
Completed MCParticle Loop
True Neutrino Energy: 18.2805
 Size of all hits: 30
hit initial : 56.6025 | hit correction : 1.03765
hit initial : 65.4502 | hit correction : 1.03773
hit initial : 160.018 | hit correction : 1.03774
hit initial : 125.344 | hit correction : 1.03779
hit initial : 45.083 | hit correction : 1.03765
hit initial : 200.906 | hit correction : 1.03838
hit initial : 375.622 | hit correction : 1.03876
hit initial : 49.2024 | hit correction : 1.03942
hit initial : 209.951 | hit correction : 1.03932
hit initial : 163.919 | hit correction : 1.03941
 *** Total Charge : 1508.09
 Looking at view: 0 | Number of hits in view: 10
hit initial : 45.5194 | hit correction : 1.03764
hit initial : 71.0756 | hit correction : 1.03765
hit initial : 60.0322 | hit correction : 1.03758
hit initial : 76.407 | hit correction : 1.038
hit initial : 272.091 | hit correction : 1.03794
hit initial : 95.1332 | hit correction : 1.03805
hit initial : 155.967 | hit correction : 1.03878
hit initial : 262.609 | hit correction : 1.03889
hit initial : 86.2343 | hit correction : 1.03893
hit initial : 27.9647 | hit correction : 1.03941
hit initial : 146.216 | hit correction : 1.03941
hit initial : 172.298 | hit correction : 1.03942
 *** Total Charge : 1528.31
 Looking at view: 1 | Number of hits in view: 12
hit initial : 28.9794 | hit correction : 1.03764
hit initial : 35.603 | hit correction : 1.03997
hit initial : 117.759 | hit correction : 1.03764
hit initial : 255.022 | hit correction : 1.03766
hit initial : 364.225 | hit correction : 1.03823
hit initial : 324.312 | hit correction : 1.03888
hit initial : 395.585 | hit correction : 1.0394
hit initial : 71.6616 | hit correction : 1.03941
 *** Total Charge : 1654.64
 Looking at view: 2 | Number of hits in view: 8
Begin processing the 10th record. run: 5026 subRun: 0 event: 25520 at 06-Dec-2025 12:29:35 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  21
Added hit list length: 21 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Electron Energy: 14.0915
Completed MCParticle Loop
True Neutrino Energy: 17.3834
 Size of all hits: 21
hit initial : 58.1607 | hit correction : 1.25903
hit initial : 135.26 | hit correction : 1.25909
hit initial : 63.4489 | hit correction : 1.25972
hit initial : 332.939 | hit correction : 1.25958
hit initial : 505.346 | hit correction : 1.25941
hit initial : 284.18 | hit correction : 1.2592
 *** Total Charge : 1737.1
 Looking at view: 0 | Number of hits in view: 6
hit initial : 240.718 | hit correction : 1.25973
hit initial : 149.633 | hit correction : 1.25908
hit initial : 61.2945 | hit correction : 1.25905
hit initial : 128.513 | hit correction : 1.25966
hit initial : 228.66 | hit correction : 1.25962
hit initial : 190.398 | hit correction : 1.25925
hit initial : 172.429 | hit correction : 1.25917
hit initial : 159.386 | hit correction : 1.25913
 *** Total Charge : 1676.28
 Looking at view: 1 | Number of hits in view: 8
hit initial : 156.98 | hit correction : 1.25986
hit initial : 158.327 | hit correction : 1.25969
hit initial : 196.117 | hit correction : 1.25964
hit initial : 58.1292 | hit correction : 1.25943
hit initial : 183.811 | hit correction : 1.2593
hit initial : 319.794 | hit correction : 1.25915
hit initial : 291.655 | hit correction : 1.2591
 *** Total Charge : 1718.83
 Looking at view: 2 | Number of hits in view: 7
06-Dec-2025 12:29:40 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.122932      0.155378      0.205241      0.154972      0.0206139       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000711345   0.000879918   0.00166343    0.000809675   0.000265003      10     
end_path:ana:AnalyzeEvents         0.121989      0.154186      0.202631      0.153923      0.0202211       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.2 MB
  Peak resident set size usage (VmHWM): 1534.64 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:46 UTC       justIN version: 01.06.00