justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 259885.1@dunegpschedd02.fnal.gov

Jobsub ID259885.1@dunegpschedd02.fnal.gov
Workflow ID11085
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-09 21:36:11
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 06:48:01
From worker nodeHostnamedunegli-7867874-0-fnpc8002.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-10 13:59:33
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T165114Z_gen_000645_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time16h (60446s)
CPU time16h (58465s = 96%)
Max RSS bytes3052126208 (2910 MiB)
Outputting started2025-12-11 06:47:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11085/1/001/analysisLowE_20251210T135935Z.root
Finished2025-12-11 06:48:01
Saved logsjustin-logs:259885.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

0.0272705, 0.0508186, 0.0667662, 0.855145, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 6450 at 11-Dec-2025 04:52:16 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 06:42:43 UTC run: 5026 subRun: 0 event: 6450
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 7026, 6948, 6800
minwire 0: 9
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 140, 639
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.120052, 
Output 1: 0.094473, 0.092294, 0.128425, 0.684808, 
Output 2: 0.0463283, 0.194089, 0.733026, 0.0265565, 
Output 3: 0.966897, 0.0174915, 0.00371084, 0.0119004, 
Output 4: 0.646967, 0.297112, 0.0469722, 0.00894892, 
Output 5: 0.43785, 0.405351, 0.12627, 0.030529, 
Output 6: 0.0298187, 0.0658941, 0.0765357, 0.827751, 

11-Dec-2025 06:44:06 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 06:44:06 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/a1/b1/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T165114Z_gen_000645_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              4867.84       5992.24       7240.11       6016.02       907.049        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0171797     0.0324696     0.0845527     0.0261865     0.0204195       10     
reco:pandora:StandardPandora                            4789.26       5918.32       7163.52       5943.83       906.394        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00894447     0.132557      0.403177       0.14347      0.114608        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00575029     0.0247289     0.0967471     0.0164487     0.0258217       10     
reco:pandoracalo:Calorimetry                          0.00147222     0.0275233      0.14206     0.00324865     0.0423844       10     
reco:pandorapid:Chi2ParticleID                        0.000310124   0.00199823     0.0144464    0.000492045   0.00416025       10     
reco:cvnmap:CVNMapper                                   0.17239      0.192189      0.278826      0.184985      0.0294281       10     
reco:cvneva:CVNEvaluator                                2.70828       4.19827       10.4034       3.72111       2.14716        10     
reco:energyrecnumu:EnergyReco                          0.0147963      28.065        73.3709      0.0343618      34.3778        10     
reco:energyrecnue:EnergyReco                          0.00506145    0.00989058     0.0240113    0.00596605    0.00670942       10     
reco:energyrecnc:EnergyReco                            0.0203107      40.402        74.3295       61.3247       33.2153        10     
[art]:TriggerResults:TriggerResultInserter            4.7988e-05    8.95149e-05   0.000288808   7.52105e-05   6.74118e-05      10     
end_path:out1:RootOutput                              1.6189e-05    3.11168e-05   9.3939e-05    2.43395e-05   2.15935e-05      10     
end_path:out1:RootOutput(write)                        0.644022      0.823938      0.920228      0.835125      0.081237        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11046.9 MB
  Peak resident set size usage (VmHWM): 3052.13 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 250.3 | hit correction : 1.35442
hit initial : 450.702 | hit correction : 1.35473
hit initial : 194.704 | hit correction : 1.35521
hit initial : 305.188 | hit correction : 1.35628
hit initial : 217.491 | hit correction : 1.35752
hit initial : 85.866 | hit correction : 1.35819
hit initial : 43.5741 | hit correction : 1.3584
hit initial : 488.74 | hit correction : 1.35894
hit initial : 109.111 | hit correction : 1.35956
hit initial : 129.494 | hit correction : 1.3602
hit initial : 113.512 | hit correction : 1.3613
hit initial : 48.6853 | hit correction : 1.36164
hit initial : 38.5861 | hit correction : 1.36183
 *** Total Charge : 6076.66
 Looking at view: 1 | Number of hits in view: 25
hit initial : 116.757 | hit correction : 1.35438
hit initial : 141.915 | hit correction : 1.35433
hit initial : 596.06 | hit correction : 1.35469
hit initial : 345.023 | hit correction : 1.35387
hit initial : 276.929 | hit correction : 1.35349
hit initial : 35.5492 | hit correction : 1.35243
hit initial : 381.928 | hit correction : 1.35331
hit initial : 316.227 | hit correction : 1.35317
hit initial : 202.266 | hit correction : 1.3532
hit initial : 224.36 | hit correction : 1.35354
hit initial : 88.8692 | hit correction : 1.35366
hit initial : 374.692 | hit correction : 1.35546
hit initial : 344.387 | hit correction : 1.35659
hit initial : 368.36 | hit correction : 1.35773
hit initial : 287.74 | hit correction : 1.35874
hit initial : 270.892 | hit correction : 1.35973
hit initial : 249.866 | hit correction : 1.36061
hit initial : 216.433 | hit correction : 1.36141
hit initial : 66.0498 | hit correction : 1.3618
 *** Total Charge : 6649.36
 Looking at view: 2 | Number of hits in view: 19
Begin processing the 10th record. run: 5026 subRun: 0 event: 6450 at 11-Dec-2025 06:46:49 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  29
Added hit list length: 29 | Max was set to: -3.40282e+38
This pfp has size:  12
True Neutron Energy: 939.573
True Electron Energy: 39.1578
Completed MCParticle Loop
True Neutrino Energy: 44.6654
 Size of all hits: 29
hit initial : 58.0883 | hit correction : 1.29348
hit initial : 114.633 | hit correction : 1.29295
hit initial : 186.987 | hit correction : 1.29362
hit initial : 240.282 | hit correction : 1.29381
hit initial : 375.542 | hit correction : 1.29409
hit initial : 591.822 | hit correction : 1.29436
hit initial : 97.5198 | hit correction : 1.29434
 *** Total Charge : 2154.36
 Looking at view: 0 | Number of hits in view: 7
hit initial : 30.323 | hit correction : 1.29099
hit initial : 89.98 | hit correction : 1.29374
hit initial : 70.9955 | hit correction : 1.29182
hit initial : 93.4695 | hit correction : 1.29097
hit initial : 30.7865 | hit correction : 1.28854
hit initial : 567.745 | hit correction : 1.29383
hit initial : 176.174 | hit correction : 1.29233
hit initial : 168.034 | hit correction : 1.29124
hit initial : 27.1138 | hit correction : 1.28872
hit initial : 844.918 | hit correction : 1.29403
hit initial : 119.638 | hit correction : 1.29179
hit initial : 65.1744 | hit correction : 1.29493
hit initial : 274.908 | hit correction : 1.29415
 *** Total Charge : 3309.83
 Looking at view: 1 | Number of hits in view: 13
hit initial : 58.4225 | hit correction : 1.2934
hit initial : 125.365 | hit correction : 1.29351
hit initial : 244.723 | hit correction : 1.29488
hit initial : 142.884 | hit correction : 1.29368
hit initial : 116.664 | hit correction : 1.29379
hit initial : 140.633 | hit correction : 1.29391
hit initial : 132.029 | hit correction : 1.29409
hit initial : 133.852 | hit correction : 1.29419
hit initial : 443.895 | hit correction : 1.29436
 *** Total Charge : 1991.01
 Looking at view: 2 | Number of hits in view: 9
11-Dec-2025 06:46:58 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.199613      0.298117      0.407108      0.281551      0.0707096       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)             0.0012251    0.00919857     0.0263836    0.00180561     0.0096683       10     
end_path:ana:AnalyzeEvents         0.186378      0.288346      0.405498      0.270242      0.0710503       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8742.7 MB
  Peak resident set size usage (VmHWM): 1538.22 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:45 UTC       justIN version: 01.06.00