justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257717.92@dunegpschedd02.fnal.gov

Jobsub ID257717.92@dunegpschedd02.fnal.gov
Workflow ID11006
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-04 23:14:05
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-05 06:47:50
From worker nodeHostnamedunegli-7985406-0-fnpc8005.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-05 01:17:45
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T130950Z_gen_000212_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (19781s)
CPU time5h (19664s = 99%)
Max RSS bytes3077226496 (2934 MiB)
Outputting started2025-12-05 06:47:27
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11006/1/001/analysisLowE_20251205T011750Z.root
Finished2025-12-05 06:47:50
Saved logsjustin-logs:257717.92-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

.652165, 0.0316581, 
Output 3: 0.963911, 0.0200219, 0.00507066, 0.0109967, 
Output 4: 0.445603, 0.468371, 0.0780365, 0.00798904, 
Output 5: 0.487034, 0.430034, 0.0735407, 0.00939159, 
Output 6: 0.0145472, 0.0438034, 0.0616675, 0.879982, 

Begin processing the 10th record. run: 4696 subRun: 0 event: 2120 at 05-Dec-2025 06:17:40 UTC
Boundary wire vector sizes: 6775, 6631, 6602
minwire 0: 67
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1541, 2040
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.109052, 
Output 1: 0.0483004, 0.13025, 0.141893, 0.679556, 
Output 2: 0.0821719, 0.222334, 0.669083, 0.0264112, 
Output 3: 0.966483, 0.0288538, 0.00176338, 0.00290019, 
Output 4: 0.395539, 0.543405, 0.0558672, 0.00518817, 
Output 5: 0.612788, 0.322163, 0.0517409, 0.0133072, 
Output 6: 0.024098, 0.079581, 0.0881431, 0.808178, 

05-Dec-2025 06:45:56 UTC  Closed output file "matt_reco2.root"
05-Dec-2025 06:45:56 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/a6/a3/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T130950Z_gen_000212_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1618.48       1952.84       2469.62       1836.64       289.741        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0015854    0.00607652     0.0158002    0.00517242    0.00366562       10     
reco:pandora:StandardPandora                            1616.44       1950.02       2467.23       1832.65       289.74         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00143406     0.0400001     0.160195      0.0203503     0.0484062       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00188798    0.00585421     0.0153818    0.00472816    0.00375329       10     
reco:pandoracalo:Calorimetry                          0.000241719   0.000931076   0.00338759    0.00063555    0.000884509      10     
reco:pandorapid:Chi2ParticleID                         8.629e-05    0.000296251   0.00116941    0.000145884   0.000334245      10     
reco:cvnmap:CVNMapper                                  0.0359768     0.0514781     0.0865485     0.0476921     0.0139088       10     
reco:cvneva:CVNEvaluator                                1.15145       1.96424       4.01533       1.89786       0.73523        10     
reco:energyrecnumu:EnergyReco                          0.0111486     0.0743794     0.188368      0.0593576     0.0637646       10     
reco:energyrecnue:EnergyReco                          0.00120752    0.00385083     0.0146548    0.00185795    0.00435979       10     
reco:energyrecnc:EnergyReco                           0.00995758     0.0590167     0.130677      0.0463335     0.0491422       10     
[art]:TriggerResults:TriggerResultInserter            1.6534e-05    2.83826e-05    7.081e-05    2.4172e-05    1.45905e-05      10     
end_path:out1:RootOutput                               5.672e-06    8.5762e-06    2.2051e-05    7.2055e-06    4.56981e-06      10     
end_path:out1:RootOutput(write)                        0.402491      0.612608      0.712241       0.67067      0.110356        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11043 MB
  Peak resident set size usage (VmHWM): 3077.23 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 225.629 | hit correction : 1.38911
hit initial : 138.39 | hit correction : 1.38873
hit initial : 124.136 | hit correction : 1.38826
hit initial : 152.947 | hit correction : 1.3879
hit initial : 166.901 | hit correction : 1.38744
hit initial : 177.325 | hit correction : 1.38689
hit initial : 169.961 | hit correction : 1.38647
hit initial : 91.4082 | hit correction : 1.38618
 *** Total Charge : 5224.81
 Looking at view: 2 | Number of hits in view: 25
Begin processing the 10th record. run: 4696 subRun: 0 event: 2120 at 05-Dec-2025 06:47:20 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  56
Added hit list length: 56 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Electron Energy: 35.0337
Completed MCParticle Loop
True Neutrino Energy: 42.8808
 Size of all hits: 56
hit initial : 17.8515 | hit correction : 1.2686
hit initial : 25.8505 | hit correction : 1.26856
hit initial : 28.4198 | hit correction : 1.25184
hit initial : 42.315 | hit correction : 1.25183
hit initial : 69.6467 | hit correction : 1.24433
hit initial : 49.7263 | hit correction : 1.24434
hit initial : 30.9894 | hit correction : 1.25819
hit initial : 135.153 | hit correction : 1.25819
hit initial : 68.1798 | hit correction : 1.25823
hit initial : 172.499 | hit correction : 1.25843
hit initial : 386.136 | hit correction : 1.25846
hit initial : 291.134 | hit correction : 1.25857
hit initial : 218.57 | hit correction : 1.25885
hit initial : 204.596 | hit correction : 1.25904
hit initial : 122.231 | hit correction : 1.25983
hit initial : 45.0277 | hit correction : 1.26021
hit initial : 92.6234 | hit correction : 1.2606
hit initial : 29.9702 | hit correction : 1.26134
hit initial : 126.44 | hit correction : 1.26174
hit initial : 227.008 | hit correction : 1.26179
hit initial : 943.036 | hit correction : 1.26178
hit initial : 148.917 | hit correction : 1.26219
hit initial : 380.997 | hit correction : 1.26392
hit initial : 58.8264 | hit correction : 1.26454
 *** Total Charge : 4934.6
 Looking at view: 0 | Number of hits in view: 24
hit initial : 53.974 | hit correction : 1.25816
hit initial : 122.099 | hit correction : 1.25819
hit initial : 68.6025 | hit correction : 1.25834
hit initial : 126.857 | hit correction : 1.25848
hit initial : 297.564 | hit correction : 1.2586
hit initial : 695.198 | hit correction : 1.25862
hit initial : 377.247 | hit correction : 1.25929
hit initial : 72.0726 | hit correction : 1.26018
hit initial : 627.344 | hit correction : 1.26187
hit initial : 524.834 | hit correction : 1.2619
hit initial : 184.27 | hit correction : 1.26212
hit initial : 147.15 | hit correction : 1.26325
hit initial : 108.175 | hit correction : 1.26344
hit initial : 147.154 | hit correction : 1.26438
hit initial : 107.353 | hit correction : 1.2645
 *** Total Charge : 4613.75
 Looking at view: 1 | Number of hits in view: 15
hit initial : 52.4551 | hit correction : 1.2617
hit initial : 69.8359 | hit correction : 1.25828
hit initial : 262.039 | hit correction : 1.25834
hit initial : 312.034 | hit correction : 1.25851
hit initial : 175.571 | hit correction : 1.25858
hit initial : 151.067 | hit correction : 1.25873
hit initial : 251.976 | hit correction : 1.25896
hit initial : 66.2298 | hit correction : 1.25909
hit initial : 401.469 | hit correction : 1.25968
hit initial : 89.5853 | hit correction : 1.25975
hit initial : 207.899 | hit correction : 1.26061
hit initial : 203.093 | hit correction : 1.26126
hit initial : 261.383 | hit correction : 1.26174
hit initial : 549.178 | hit correction : 1.2621
hit initial : 371.921 | hit correction : 1.26306
hit initial : 301.058 | hit correction : 1.26422
hit initial : 85.7337 | hit correction : 1.26471
 *** Total Charge : 4806.74
 Looking at view: 2 | Number of hits in view: 17
05-Dec-2025 06:47:26 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.138264      0.197069       0.27728      0.188803      0.0413863       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000462176   0.00624215     0.0239721    0.000615015    0.0089461       10     
end_path:ana:AnalyzeEvents         0.137668      0.190661      0.276591       0.18275      0.0392245       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8736.07 MB
  Peak resident set size usage (VmHWM): 1536.93 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 20:41:23 UTC       justIN version: 01.06.00