justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266857.1@dunegpschedd01.fnal.gov

Jobsub ID266857.1@dunegpschedd01.fnal.gov
Workflow ID11109
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 16:04:17
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 03:32:15
From worker nodeHostnamedunegli-8029107-0-fnpc19104.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 16:05:55
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T225609Z_gen_000921_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (41163s)
CPU time11h (40250s = 97%)
Max RSS bytes2922790912 (2787 MiB)
Outputting started2025-12-12 03:31:59
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11109/1/001/analysisLowE_20251211T160557Z.root
Finished2025-12-12 03:32:15
Saved logsjustin-logs:266857.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ut 0: 0.103779, 
Output 1: 0.0935473, 0.0966757, 0.0955331, 0.714244, 
Output 2: 0.0731712, 0.274565, 0.632482, 0.019782, 
Output 3: 0.969967, 0.0247102, 0.00152873, 0.00379364, 
Output 4: 0.415723, 0.521255, 0.0576115, 0.00540997, 
Output 5: 0.470398, 0.468121, 0.0532596, 0.00822113, 
Output 6: 0.0358352, 0.0965308, 0.103979, 0.763655, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 9210 at 12-Dec-2025 03:04:52 UTC
Boundary wire vector sizes: 6933, 6930, 6764
minwire 0: 76
minwire 1: 1
minwire 2: 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2285, 2784
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0923407, 
Output 1: 0.164722, 0.0670355, 0.215394, 0.552849, 
Output 2: 0.0341015, 0.115885, 0.836102, 0.0139119, 
Output 3: 0.949774, 0.041393, 0.00398731, 0.00484566, 
Output 4: 0.52673, 0.419418, 0.0470661, 0.00678568, 
Output 5: 0.423532, 0.400677, 0.138392, 0.0373995, 
Output 6: 0.0416884, 0.106933, 0.0922815, 0.759097, 

12-Dec-2025 03:31:14 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:31:14 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/0f/f6/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T225609Z_gen_000921_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1578.58       4082.68       5152.12       4460.25       1040.7         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00240287     0.0181193     0.0331784     0.0161578    0.00960052       10     
reco:pandora:StandardPandora                            1577.26       4032.44       5073.79       4388.4        1013.2         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000621986    0.0587051     0.400844     0.00845801     0.117385        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000458704    0.0112566     0.0717842    0.00458756     0.0204211       10     
reco:pandoracalo:Calorimetry                          0.000334193    0.0216549     0.118617      0.0089847     0.0342722       10     
reco:pandorapid:Chi2ParticleID                        8.6691e-05    0.000857298   0.00707312    0.000145366   0.00207363       10     
reco:cvnmap:CVNMapper                                  0.0319738      0.08427      0.142584      0.076009      0.0345086       10     
reco:cvneva:CVNEvaluator                               0.869402       2.31548       8.08598       1.51978       2.03459        10     
reco:energyrecnumu:EnergyReco                          0.0111531      27.6572       74.3139      0.103382       33.8852        10     
reco:energyrecnue:EnergyReco                          0.00122708    0.00893338     0.0197424    0.00802954    0.00574114       10     
reco:energyrecnc:EnergyReco                            0.0069098      19.6024       73.3483      0.0141517      30.0869        10     
[art]:TriggerResults:TriggerResultInserter             1.698e-05    7.33858e-05   0.000282073   5.9656e-05    7.35552e-05      10     
end_path:out1:RootOutput                                7.5e-06     3.27802e-05   0.000115511    2.594e-05     3.002e-05       10     
end_path:out1:RootOutput(write)                        0.284908      0.457801      0.561471       0.49425      0.101157        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21689.7 MB
  Peak resident set size usage (VmHWM): 2922.79 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
True Neutrino Energy: 13.491
 Size of all hits: 0
Begin processing the 6th record. run: 5027 subRun: 0 event: 9206 at 12-Dec-2025 03:31:43 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.574
True Electron Energy: 1.5336
Completed MCParticle Loop
True Neutrino Energy: 4.81737
 Size of all hits: 0
Begin processing the 7th record. run: 5027 subRun: 0 event: 9207 at 12-Dec-2025 03:31:46 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 1.00871
Completed MCParticle Loop
True Neutrino Energy: 4.29215
 Size of all hits: 0
Begin processing the 8th record. run: 5027 subRun: 0 event: 9208 at 12-Dec-2025 03:31:49 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 12.0214
Completed MCParticle Loop
True Neutrino Energy: 17.4026
 Size of all hits: 0
Begin processing the 9th record. run: 5027 subRun: 0 event: 9209 at 12-Dec-2025 03:31:52 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  4
This pfp has size:  36
Added hit list length: 36 | Max was set to: -3.40282e+38
This pfp has size:  14
True Electron Energy: 40.5458
Completed MCParticle Loop
True Neutrino Energy: 56.0638
 Size of all hits: 36
hit initial : 212.842 | hit correction : 1.47409
hit initial : 120.58 | hit correction : 1.4738
hit initial : 248.933 | hit correction : 1.47395
hit initial : 202.636 | hit correction : 1.47403
hit initial : 162.232 | hit correction : 1.47413
hit initial : 182.658 | hit correction : 1.47451
hit initial : 175.835 | hit correction : 1.47431
hit initial : 181.581 | hit correction : 1.47465
hit initial : 142.398 | hit correction : 1.47478
hit initial : 169.1 | hit correction : 1.47422
hit initial : 155.744 | hit correction : 1.47479
hit initial : 173.269 | hit correction : 1.47472
hit initial : 163.928 | hit correction : 1.4746
hit initial : 166.421 | hit correction : 1.47441
hit initial : 216.523 | hit correction : 1.4741
 *** Total Charge : 3943.33
 Looking at view: 0 | Number of hits in view: 15
hit initial : 191.07 | hit correction : 1.47375
hit initial : 146.323 | hit correction : 1.47397
hit initial : 105.439 | hit correction : 1.47411
hit initial : 119.479 | hit correction : 1.47417
hit initial : 118.621 | hit correction : 1.47411
hit initial : 161.711 | hit correction : 1.47407
hit initial : 169.396 | hit correction : 1.47407
hit initial : 105.056 | hit correction : 1.47428
hit initial : 115.396 | hit correction : 1.47454
hit initial : 129.551 | hit correction : 1.47466
hit initial : 126.799 | hit correction : 1.47475
hit initial : 109.883 | hit correction : 1.4744
hit initial : 125.568 | hit correction : 1.47482
hit initial : 181.885 | hit correction : 1.47433
hit initial : 149.937 | hit correction : 1.4748
hit initial : 156.103 | hit correction : 1.4747
hit initial : 188.331 | hit correction : 1.47451
hit initial : 155.809 | hit correction : 1.47412
hit initial : 162.707 | hit correction : 1.47393
hit initial : 256.549 | hit correction : 1.47391
hit initial : 128.446 | hit correction : 1.47411
 *** Total Charge : 4576.2
 Looking at view: 2 | Number of hits in view: 21
Begin processing the 10th record. run: 5027 subRun: 0 event: 9210 at 12-Dec-2025 03:31:55 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.573
True Electron Energy: 18.2607
Completed MCParticle Loop
True Neutrino Energy: 21.5475
 Size of all hits: 0
12-Dec-2025 03:31:58 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0651628     0.0819031     0.119592      0.0747098     0.018166        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000381133   0.00138386    0.00922486    0.000513954   0.00261656       10     
end_path:ana:AnalyzeEvents         0.0645382     0.0803383     0.109891      0.0741583     0.0163952       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19476.4 MB
  Peak resident set size usage (VmHWM): 1535.48 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:59:41 UTC       justIN version: 01.06.00