justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258258.3@dunegpschedd02.fnal.gov

Jobsub ID258258.3@dunegpschedd02.fnal.gov
Workflow ID11012
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 22:51:13
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 12:11:33
From worker nodeHostnamedunegli-7989276-0-fnpc18006.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:38:37
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T192628Z_gen_002288_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (37953s)
CPU time10h (36306s = 95%)
Max RSS bytes3031142400 (2890 MiB)
Outputting started2025-12-06 12:11:11
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11012/1/001/analysisLowE_20251206T013839Z.root
Finished2025-12-06 12:11:33
Saved logsjustin-logs:258258.3-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

10th record. run: 5026 subRun: 0 event: 22880 at 06-Dec-2025 11:21:28 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 12:09:42 UTC run: 5026 subRun: 0 event: 22880
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6885, 6863, 6793
minwire 0: 44
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2096, 2595
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.13018, 
Output 1: 0.0548685, 0.0986661, 0.152427, 0.694038, 
Output 2: 0.0609863, 0.279035, 0.628742, 0.0312369, 
Output 3: 0.959577, 0.0273166, 0.00514755, 0.00795841, 
Output 4: 0.438999, 0.478714, 0.0748491, 0.00743811, 
Output 5: 0.532736, 0.409778, 0.0509933, 0.00649261, 
Output 6: 0.0158139, 0.0517598, 0.0686089, 0.863817, 

06-Dec-2025 12:09:48 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 12:09:48 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/19/d5/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T192628Z_gen_002288_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2893.48       3762.78       4219.28       3981.11       422.756        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00250646     0.0124197     0.0310875     0.0095663    0.00789123       10     
reco:pandora:StandardPandora                            2889.23       3757.38       4214.44       3976.52       422.726        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000915707    0.0574815      0.32216      0.0205604     0.0925315       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00162841    0.00966396     0.0529102    0.00468968     0.0146145       10     
reco:pandoracalo:Calorimetry                           0.0006683    0.00440266     0.0194901    0.00145168    0.00616072       10     
reco:pandorapid:Chi2ParticleID                        0.000178316   0.000922731   0.00527658    0.000476744   0.00146614       10     
reco:cvnmap:CVNMapper                                  0.0659404     0.106269      0.225854      0.0990459     0.042126        10     
reco:cvneva:CVNEvaluator                                2.1533        4.20917       12.1973       3.46056       2.69527        10     
reco:energyrecnumu:EnergyReco                         0.00342947     0.100909       0.37801      0.0205984      0.12118        10     
reco:energyrecnue:EnergyReco                          0.00212672    0.00453683     0.0158788    0.00352214    0.00382413       10     
reco:energyrecnc:EnergyReco                            0.016759      0.126672      0.252792      0.150787      0.0800074       10     
[art]:TriggerResults:TriggerResultInserter            3.2811e-05    7.50333e-05   0.000255632   5.2514e-05    6.23874e-05      10     
end_path:out1:RootOutput                              1.1582e-05    2.34663e-05   6.8619e-05    1.6957e-05    1.62499e-05      10     
end_path:out1:RootOutput(write)                        0.422798       0.77081       1.0857       0.755441      0.165939        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21769 MB
  Peak resident set size usage (VmHWM): 3031.14 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 173.436 | hit correction : 1.45197
hit initial : 370.9 | hit correction : 1.45223
hit initial : 272.237 | hit correction : 1.45238
hit initial : 157.22 | hit correction : 1.45275
hit initial : 130.399 | hit correction : 1.45301
hit initial : 143.063 | hit correction : 1.45328
hit initial : 176.634 | hit correction : 1.45358
hit initial : 329.738 | hit correction : 1.45432
hit initial : 211.486 | hit correction : 1.45418
hit initial : 168.629 | hit correction : 1.45407
hit initial : 88.7516 | hit correction : 1.45486
hit initial : 212.649 | hit correction : 1.45489
hit initial : 142.312 | hit correction : 1.45489
hit initial : 147.728 | hit correction : 1.45418
hit initial : 131.562 | hit correction : 1.45467
hit initial : 89.5946 | hit correction : 1.45359
hit initial : 139.818 | hit correction : 1.45378
 *** Total Charge : 4535.43
 Looking at view: 2 | Number of hits in view: 18
Begin processing the 10th record. run: 5026 subRun: 0 event: 22880 at 06-Dec-2025 12:11:04 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  47
Added hit list length: 47 | Max was set to: -3.40282e+38
True Neutron Energy: 939.57
True Electron Energy: 24.3479
Completed MCParticle Loop
True Neutrino Energy: 30.5668
 Size of all hits: 47
hit initial : 65.1749 | hit correction : 1.0449
hit initial : 244.708 | hit correction : 1.04559
hit initial : 138.365 | hit correction : 1.04491
hit initial : 382.354 | hit correction : 1.04589
hit initial : 50.9871 | hit correction : 1.04493
hit initial : 187.734 | hit correction : 1.04636
hit initial : 96.8939 | hit correction : 1.04585
hit initial : 294.941 | hit correction : 1.04634
hit initial : 461.003 | hit correction : 1.04629
hit initial : 486.094 | hit correction : 1.04632
hit initial : 377.604 | hit correction : 1.04634
hit initial : 349.981 | hit correction : 1.04637
hit initial : 351.643 | hit correction : 1.04646
hit initial : 156.526 | hit correction : 1.04653
hit initial : 32.799 | hit correction : 1.04578
 *** Total Charge : 3846.46
 Looking at view: 0 | Number of hits in view: 15
hit initial : 87.8734 | hit correction : 1.04638
hit initial : 591.594 | hit correction : 1.04625
hit initial : 106.05 | hit correction : 1.04502
hit initial : 143.325 | hit correction : 1.04498
hit initial : 70.4144 | hit correction : 1.045
hit initial : 72.1203 | hit correction : 1.04638
hit initial : 78.0482 | hit correction : 1.04656
hit initial : 214.742 | hit correction : 1.04654
hit initial : 94.2306 | hit correction : 1.04655
hit initial : 404.669 | hit correction : 1.04632
hit initial : 389.799 | hit correction : 1.04631
hit initial : 487.805 | hit correction : 1.04635
hit initial : 335.871 | hit correction : 1.04636
 *** Total Charge : 3218.71
 Looking at view: 1 | Number of hits in view: 13
hit initial : 399.926 | hit correction : 1.0458
hit initial : 241.59 | hit correction : 1.04488
hit initial : 338.284 | hit correction : 1.04632
hit initial : 245.928 | hit correction : 1.04534
hit initial : 176.545 | hit correction : 1.04638
hit initial : 158.749 | hit correction : 1.04629
hit initial : 153.268 | hit correction : 1.04623
hit initial : 134.087 | hit correction : 1.04622
hit initial : 131.42 | hit correction : 1.04624
hit initial : 155.485 | hit correction : 1.04629
hit initial : 146.124 | hit correction : 1.04636
hit initial : 184.446 | hit correction : 1.04641
hit initial : 120.784 | hit correction : 1.04635
hit initial : 152.913 | hit correction : 1.04632
hit initial : 146.601 | hit correction : 1.04635
hit initial : 127.294 | hit correction : 1.04638
hit initial : 60.0139 | hit correction : 1.04643
hit initial : 141.298 | hit correction : 1.04646
hit initial : 192.944 | hit correction : 1.04633
 *** Total Charge : 3564.78
 Looking at view: 2 | Number of hits in view: 19
06-Dec-2025 12:11:10 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.113017      0.179903      0.331015      0.167655      0.070771        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000524139   0.000855438   0.00198239    0.000778869   0.00039293       10     
end_path:ana:AnalyzeEvents          0.11227      0.178698      0.330211      0.166668      0.070798        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19467.3 MB
  Peak resident set size usage (VmHWM): 1529.21 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-12-19 13:09:28 UTC       justIN version: 01.05.03