justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258504.1@dunegpschedd02.fnal.gov

Jobsub ID258504.1@dunegpschedd02.fnal.gov
Workflow ID11023
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 11:33:57
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 17:27:42
From worker nodeHostnamedunegli-7989276-0-fnpc18006.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 11:34:45
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T131201Z_gen_000254_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (21155s)
CPU time5h (20847s = 98%)
Max RSS bytes3043176448 (2902 MiB)
Outputting started2025-12-06 17:27:20
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11023/1/001/analysisLowE_20251206T113446Z.root
Finished2025-12-06 17:27:42
Saved logsjustin-logs:258504.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Output 2: 0.046004, 0.13804, 0.799185, 0.0167711, 
Output 3: 0.978117, 0.0159528, 0.00145206, 0.004478, 
Output 4: 0.505031, 0.442421, 0.0457032, 0.00684529, 
Output 5: 0.281523, 0.48644, 0.180756, 0.0512813, 
Output 6: 0.0468491, 0.120619, 0.109264, 0.723268, 

Begin processing the 10th record. run: 4696 subRun: 0 event: 2540 at 06-Dec-2025 16:50:14 UTC
Boundary wire vector sizes: 6834, 6760, 6747
minwire 0: 96
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 933, 1432
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0844147, 
Output 1: 0.0382605, 0.0427934, 0.0873452, 0.831601, 
Output 2: 0.0914171, 0.28947, 0.588492, 0.0306204, 
Output 3: 0.949855, 0.0400387, 0.00388115, 0.00622485, 
Output 4: 0.212301, 0.690845, 0.0908149, 0.00603874, 
Output 5: 0.755744, 0.222229, 0.0185546, 0.00347276, 
Output 6: 0.0167375, 0.0668791, 0.0843063, 0.832077, 

06-Dec-2025 17:26:15 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 17:26:15 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/39/a9/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T131201Z_gen_000254_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1699.06       2091.36       2549.61       2123.08       299.224        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00191044    0.00907711     0.0229096    0.00630665    0.00629584       10     
reco:pandora:StandardPandora                            1696.43       2087.67       2542.65       2118.87       298.175        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000820268    0.026611      0.114771     0.00952668     0.0332935       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000393683   0.00852861     0.0390241    0.00418366     0.0109857       10     
reco:pandoracalo:Calorimetry                          0.000543215    0.0105772     0.0427566    0.00241333     0.016235        10     
reco:pandorapid:Chi2ParticleID                        9.2945e-05    0.000629895   0.00267687    0.00016983    0.000898808      10     
reco:cvnmap:CVNMapper                                  0.0337989     0.0463243     0.0725608     0.042996      0.0117975       10     
reco:cvneva:CVNEvaluator                                1.93632       2.96545       5.91244       2.86193       1.14159        10     
reco:energyrecnumu:EnergyReco                          0.0176276     0.0838414     0.196166      0.0948686     0.0565836       10     
reco:energyrecnue:EnergyReco                          0.00143637    0.00634835     0.0156997    0.00262161    0.00549294       10     
reco:energyrecnc:EnergyReco                           0.00973902     0.0524543     0.123953      0.0151597     0.0489578       10     
[art]:TriggerResults:TriggerResultInserter            2.0499e-05    4.77341e-05   0.000200157   3.08235e-05   5.17338e-05      10     
end_path:out1:RootOutput                               9.428e-06    1.77433e-05   6.0724e-05    1.19875e-05   1.47933e-05      10     
end_path:out1:RootOutput(write)                        0.374822      0.479025      0.604379      0.454486      0.0914124       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21756 MB
  Peak resident set size usage (VmHWM): 3043.18 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 Size of all hits: 0
Begin processing the 10th record. run: 4696 subRun: 0 event: 2540 at 06-Dec-2025 17:27:16 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  64
Added hit list length: 64 | Max was set to: -3.40282e+38
True Neutron Energy: 939.567
True Neutron Energy: 939.694
True Electron Energy: 44.094
Completed MCParticle Loop
True Neutrino Energy: 53.1573
 Size of all hits: 64
hit initial : 120.875 | hit correction : 1.42025
hit initial : 131.703 | hit correction : 1.42026
hit initial : 45.3538 | hit correction : 1.42026
hit initial : 25.841 | hit correction : 1.40218
hit initial : 15.8362 | hit correction : 1.40228
hit initial : 17.0394 | hit correction : 1.40687
hit initial : 51.0232 | hit correction : 1.40689
hit initial : 21.4025 | hit correction : 1.40687
hit initial : 218.798 | hit correction : 1.40793
hit initial : 207.492 | hit correction : 1.40799
hit initial : 40.6002 | hit correction : 1.40819
hit initial : 136.374 | hit correction : 1.40816
hit initial : 225.052 | hit correction : 1.40822
hit initial : 232.471 | hit correction : 1.40854
hit initial : 213.425 | hit correction : 1.40894
hit initial : 47.7843 | hit correction : 1.4092
hit initial : 190.214 | hit correction : 1.40998
hit initial : 216.37 | hit correction : 1.41038
hit initial : 44.3287 | hit correction : 1.4104
hit initial : 128.565 | hit correction : 1.41177
hit initial : 105.506 | hit correction : 1.41189
hit initial : 64.6672 | hit correction : 1.41243
hit initial : 30.3959 | hit correction : 1.41341
hit initial : 348.797 | hit correction : 1.41339
hit initial : 388.495 | hit correction : 1.41446
hit initial : 127.077 | hit correction : 1.41463
hit initial : 56.9131 | hit correction : 1.41555
hit initial : 237.157 | hit correction : 1.41578
hit initial : 153.528 | hit correction : 1.41599
 *** Total Charge : 5425.9
 Looking at view: 0 | Number of hits in view: 29
hit initial : 36.6587 | hit correction : 1.40688
hit initial : 50.4337 | hit correction : 1.40689
hit initial : 129.796 | hit correction : 1.40797
hit initial : 342.78 | hit correction : 1.408
hit initial : 267.581 | hit correction : 1.40808
hit initial : 214.43 | hit correction : 1.40834
hit initial : 214.53 | hit correction : 1.40863
hit initial : 106.205 | hit correction : 1.4109
hit initial : 452.099 | hit correction : 1.41182
hit initial : 709.727 | hit correction : 1.41199
hit initial : 409.254 | hit correction : 1.41495
hit initial : 280.266 | hit correction : 1.41572
hit initial : 62.4376 | hit correction : 1.41616
 *** Total Charge : 4623.4
 Looking at view: 1 | Number of hits in view: 13
hit initial : 38.8874 | hit correction : 1.41635
hit initial : 28.0987 | hit correction : 1.38496
hit initial : 184.449 | hit correction : 1.38487
hit initial : 117.155 | hit correction : 1.38484
hit initial : 65.6443 | hit correction : 1.40688
hit initial : 40.8106 | hit correction : 1.40687
hit initial : 104.781 | hit correction : 1.40785
hit initial : 348.569 | hit correction : 1.40799
hit initial : 91.2363 | hit correction : 1.4082
hit initial : 184.226 | hit correction : 1.40819
hit initial : 552.328 | hit correction : 1.40852
hit initial : 332.747 | hit correction : 1.40946
hit initial : 259.506 | hit correction : 1.41059
hit initial : 238.076 | hit correction : 1.4117
hit initial : 201.355 | hit correction : 1.41249
hit initial : 183.09 | hit correction : 1.41325
hit initial : 173.845 | hit correction : 1.41393
hit initial : 158.769 | hit correction : 1.41448
hit initial : 189.065 | hit correction : 1.41508
hit initial : 175.308 | hit correction : 1.4154
hit initial : 139.36 | hit correction : 1.41586
hit initial : 116.427 | hit correction : 1.41623
 *** Total Charge : 5528.17
 Looking at view: 2 | Number of hits in view: 22
06-Dec-2025 17:27:20 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0954442     0.126888      0.156793      0.122959      0.0183702       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000504432   0.00069991     0.0017311    0.000578115   0.000351342      10     
end_path:ana:AnalyzeEvents         0.0946944     0.125891      0.155832      0.122138      0.0181884       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.8 MB
  Peak resident set size usage (VmHWM): 1537.2 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:16 UTC       justIN version: 01.06.00