justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267114.0@dunegpschedd01.fnal.gov

Jobsub ID267114.0@dunegpschedd01.fnal.gov
Workflow ID11108
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 23:34:43
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 01:20:48
From worker nodeHostnamedunegli-8035317-0-fnpc22006.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 23:35:27
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T231109Z_gen_001345_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time1h (6302s)
CPU time1h (6233s = 98%)
Max RSS bytes2926039040 (2790 MiB)
Outputting started2025-12-12 01:20:30
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11108/1/001/analysisLowE_20251211T233527Z.root
Finished2025-12-12 01:20:48
Saved logsjustin-logs:267114.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.106934, 
Output 1: 0.0641295, 0.0585628, 0.112802, 0.764505, 
Output 2: 0.0663749, 0.209363, 0.692922, 0.0313401, 
Output 3: 0.971109, 0.0203863, 0.00243072, 0.0060744, 
Output 4: 0.42662, 0.511358, 0.0563083, 0.005713, 
Output 5: 0.597149, 0.306289, 0.0748932, 0.0216685, 
Output 6: 0.024991, 0.0697067, 0.0797303, 0.825572, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 13450 at 12-Dec-2025 01:09:23 UTC
Boundary wire vector sizes: 6843, 6836, 6768
minwire 0: 41
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.158971, 
Output 1: 0.065455, 0.0276868, 0.175378, 0.731481, 
Output 2: 0.121362, 0.178218, 0.660834, 0.0395866, 
Output 3: 0.979996, 0.0103261, 0.00141312, 0.00826527, 
Output 4: 0.139521, 0.823706, 0.0350881, 0.001685, 
Output 5: 0.500555, 0.436826, 0.0509221, 0.0116968, 
Output 6: 0.0124777, 0.0346568, 0.0493664, 0.903499, 

12-Dec-2025 01:20:01 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 01:20:01 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/bf/53/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T231109Z_gen_001345_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              613.149       620.131       636.128       616.919       6.86513        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00101561    0.00500662     0.0184744    0.00363765    0.00470417       10     
reco:pandora:StandardPandora                            612.16        619.005       635.092       615.927       6.93705        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00141629     0.0107347     0.0462612    0.00363729     0.0137594       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00163657    0.00380634    0.00733553    0.00285404    0.00206585       10     
reco:pandoracalo:Calorimetry                          0.000177966   0.00552572     0.0167889    0.00119074    0.00712326       10     
reco:pandorapid:Chi2ParticleID                        4.7109e-05    0.000195682   0.000812254   9.0451e-05    0.000220631      10     
reco:cvnmap:CVNMapper                                  0.014728      0.0212228     0.0390569     0.0193456    0.00675866       10     
reco:cvneva:CVNEvaluator                               0.674687      0.797465       1.7861       0.689376      0.329599        10     
reco:energyrecnumu:EnergyReco                         0.00510313     0.0608778     0.0970588     0.0613439     0.0219774       10     
reco:energyrecnue:EnergyReco                          0.00078368    0.00323823    0.00488162    0.00460449    0.00180401       10     
reco:energyrecnc:EnergyReco                            0.0044465     0.0103729     0.0621509    0.00462835     0.0172595       10     
[art]:TriggerResults:TriggerResultInserter             8.616e-06    1.48221e-05   4.9554e-05    1.1026e-05    1.16863e-05      10     
end_path:out1:RootOutput                               5.07e-06     7.3217e-06     2.16e-05     5.5805e-06    4.79255e-06      10     
end_path:out1:RootOutput(write)                        0.196804      0.206563      0.219397      0.205358     0.00617059       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21683.2 MB
  Peak resident set size usage (VmHWM): 2926.04 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
True Neutron Energy: 939.626
True Electron Energy: 48.0905
Completed MCParticle Loop
True Neutrino Energy: 60.8316
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 13450 at 12-Dec-2025 01:20:28 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  61
Added hit list length: 61 | Max was set to: -3.40282e+38
True Neutron Energy: 939.566
True Electron Energy: 48.7092
Completed MCParticle Loop
True Neutrino Energy: 64.181
 Size of all hits: 61
hit initial : 17.4886 | hit correction : 1.46683
hit initial : 36.4494 | hit correction : 1.46686
hit initial : 21.4745 | hit correction : 1.46654
hit initial : 43.4626 | hit correction : 1.46646
hit initial : 42.1553 | hit correction : 1.46
hit initial : 99.7673 | hit correction : 1.46574
hit initial : 190.425 | hit correction : 1.46551
hit initial : 176.913 | hit correction : 1.46529
hit initial : 160.602 | hit correction : 1.46497
hit initial : 181.567 | hit correction : 1.4646
hit initial : 242.898 | hit correction : 1.46428
hit initial : 241.541 | hit correction : 1.46407
hit initial : 182.153 | hit correction : 1.46372
hit initial : 167.785 | hit correction : 1.46328
hit initial : 174.741 | hit correction : 1.46294
hit initial : 216.571 | hit correction : 1.46255
hit initial : 261.404 | hit correction : 1.46211
hit initial : 286.033 | hit correction : 1.4616
hit initial : 287.816 | hit correction : 1.46104
hit initial : 102.982 | hit correction : 1.4599
hit initial : 273.632 | hit correction : 1.46028
hit initial : 73.8791 | hit correction : 1.46012
 *** Total Charge : 5094.02
 Looking at view: 0 | Number of hits in view: 22
hit initial : 54.1521 | hit correction : 1.45992
hit initial : 61.7287 | hit correction : 1.45993
hit initial : 29.2968 | hit correction : 1.46648
hit initial : 46.0304 | hit correction : 1.46651
hit initial : 23.4693 | hit correction : 1.46655
hit initial : 39.4986 | hit correction : 1.46689
hit initial : 40.765 | hit correction : 1.46579
hit initial : 143.72 | hit correction : 1.46565
hit initial : 220.857 | hit correction : 1.46542
hit initial : 221.67 | hit correction : 1.4651
hit initial : 220.94 | hit correction : 1.46462
hit initial : 279.693 | hit correction : 1.46425
hit initial : 243.371 | hit correction : 1.46402
hit initial : 213.099 | hit correction : 1.4636
hit initial : 197.845 | hit correction : 1.4632
hit initial : 194.245 | hit correction : 1.46289
hit initial : 183.794 | hit correction : 1.46254
hit initial : 189.5 | hit correction : 1.46218
hit initial : 197.38 | hit correction : 1.46181
hit initial : 208.774 | hit correction : 1.46144
hit initial : 188.387 | hit correction : 1.46107
hit initial : 158.787 | hit correction : 1.46071
hit initial : 172.476 | hit correction : 1.46
 *** Total Charge : 5164.32
 Looking at view: 1 | Number of hits in view: 23
hit initial : 57.0358 | hit correction : 1.45986
hit initial : 70.5252 | hit correction : 1.46652
hit initial : 172.389 | hit correction : 1.45992
hit initial : 30.5685 | hit correction : 1.46646
hit initial : 586.223 | hit correction : 1.46293
hit initial : 44.2386 | hit correction : 1.46413
hit initial : 94.2702 | hit correction : 1.46316
hit initial : 43.1143 | hit correction : 1.46688
hit initial : 40.9325 | hit correction : 1.46686
hit initial : 226.772 | hit correction : 1.46554
hit initial : 613.699 | hit correction : 1.46495
hit initial : 389.739 | hit correction : 1.4642
hit initial : 59.0549 | hit correction : 1.46339
hit initial : 456.916 | hit correction : 1.46193
hit initial : 329.478 | hit correction : 1.46115
hit initial : 225.307 | hit correction : 1.46047
 *** Total Charge : 5033.69
 Looking at view: 2 | Number of hits in view: 16
12-Dec-2025 01:20:30 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0477793     0.0585382     0.0867117     0.059382      0.0108327       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000390849   0.000594483   0.00102016    0.000516551   0.000196234      10     
end_path:ana:AnalyzeEvents         0.0470905     0.0577214     0.0849938      0.05879      0.0105843       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19473.7 MB
  Peak resident set size usage (VmHWM): 1530.76 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 15:00:10 UTC       justIN version: 01.06.00