justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260445.0@dunegpschedd02.fnal.gov

Jobsub ID260445.0@dunegpschedd02.fnal.gov
Workflow ID11088
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 18:39:14
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-11 19:24:16
From worker nodeHostnamedunegli-8028931-0-fnpc17012.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 08:54:00
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T154530Z_gen_000002_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (37790s)
CPU time10h (37305s = 98%)
Max RSS bytes3063271424 (2921 MiB)
Outputting started2025-12-11 19:23:51
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11088/1/001/analysisLowE_20251211T085401Z.root
Finished2025-12-11 19:24:16
Saved logsjustin-logs:260445.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

termination failure: 0, 499
Classifier summary: 
Output 0: 0.120112, 
Output 1: 0.042356, 0.185952, 0.153286, 0.618405, 
Output 2: 0.0566365, 0.2807, 0.636454, 0.0262093, 
Output 3: 0.955488, 0.032373, 0.00480755, 0.00733129, 
Output 4: 0.469597, 0.43967, 0.0813532, 0.00937982, 
Output 5: 0.628051, 0.327459, 0.0386156, 0.00587393, 
Output 6: 0.0138787, 0.0439468, 0.0626714, 0.879503, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 20 at 11-Dec-2025 18:30:20 UTC
Boundary wire vector sizes: 6984, 6916, 6760
minwire 0: 49
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.15136, 
Output 1: 0.0637634, 0.0666363, 0.151077, 0.718524, 
Output 2: 0.0511419, 0.17125, 0.751094, 0.0265142, 
Output 3: 0.973568, 0.0141393, 0.00289339, 0.00939912, 
Output 4: 0.372635, 0.530551, 0.0853724, 0.0114423, 
Output 5: 0.403321, 0.438969, 0.128299, 0.0294113, 
Output 6: 0.0292059, 0.0670177, 0.0782271, 0.825549, 

11-Dec-2025 19:22:11 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 19:22:11 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/2f/ef/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T154530Z_gen_000002_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3103.49       3741.83       4132.54       3692.39       297.184        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00485106     0.0142824     0.0315934     0.0136125    0.00658821       10     
reco:pandora:StandardPandora                            3100.74       3738.04       4129.36       3689.2        296.63         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000750337    0.0658095     0.338133      0.0294597     0.0971165       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000687218    0.0128862     0.0436723    0.00753422     0.013728        10     
reco:pandoracalo:Calorimetry                          0.000440709   0.00241476     0.0096623    0.00109008    0.00286781       10     
reco:pandorapid:Chi2ParticleID                        0.000132456   0.000815058   0.00348891    0.000231228   0.00116688       10     
reco:cvnmap:CVNMapper                                  0.0825424     0.118347      0.163604      0.111578      0.0265844       10     
reco:cvneva:CVNEvaluator                                1.77756       2.77831       8.46287       2.20282       1.90858        10     
reco:energyrecnumu:EnergyReco                         0.00757063     0.0694675     0.191923      0.0225074     0.0664825       10     
reco:energyrecnue:EnergyReco                          0.00257589    0.00585915     0.0157022    0.00353681    0.00452143       10     
reco:energyrecnc:EnergyReco                            0.0132817     0.0842428     0.147454       0.11692      0.056552        10     
[art]:TriggerResults:TriggerResultInserter            2.7312e-05    5.69576e-05   0.000198839   4.24285e-05   4.78833e-05      10     
end_path:out1:RootOutput                               9.403e-06    2.00621e-05   6.3583e-05    1.44005e-05   1.4944e-05       10     
end_path:out1:RootOutput(write)                        0.497967      0.639116      0.973724      0.608133       0.13235        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12121 MB
  Peak resident set size usage (VmHWM): 3063.27 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 *** Total Charge : 3594.41
 Looking at view: 0 | Number of hits in view: 13
hit initial : 57.9708 | hit correction : 1.01627
hit initial : 62.7957 | hit correction : 1.01536
hit initial : 207.015 | hit correction : 1.01586
hit initial : 138.176 | hit correction : 1.01599
hit initial : 33.7881 | hit correction : 1.01604
hit initial : 21.6872 | hit correction : 1.01641
hit initial : 58.8536 | hit correction : 1.01639
hit initial : 227.033 | hit correction : 1.01539
hit initial : 404.357 | hit correction : 1.01545
hit initial : 561.634 | hit correction : 1.01548
hit initial : 546.856 | hit correction : 1.01548
hit initial : 300.319 | hit correction : 1.01542
hit initial : 215.299 | hit correction : 1.01545
hit initial : 220.923 | hit correction : 1.01553
hit initial : 213.555 | hit correction : 1.01559
hit initial : 213.84 | hit correction : 1.01569
 *** Total Charge : 3538.33
 Looking at view: 1 | Number of hits in view: 16
hit initial : 38.1545 | hit correction : 1.01541
hit initial : 12.8308 | hit correction : 1.01619
hit initial : 147.158 | hit correction : 1.01628
hit initial : 100.46 | hit correction : 1.01639
hit initial : 265.078 | hit correction : 1.01599
hit initial : 50.8718 | hit correction : 1.01679
hit initial : 86.5983 | hit correction : 1.01537
hit initial : 1107.13 | hit correction : 1.01541
hit initial : 735.113 | hit correction : 1.01543
hit initial : 599.077 | hit correction : 1.01558
hit initial : 544.495 | hit correction : 1.01567
 *** Total Charge : 3744.48
 Looking at view: 2 | Number of hits in view: 11
Begin processing the 9th record. run: 5026 subRun: 0 event: 19 at 11-Dec-2025 19:23:36 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Electron Energy: 25.446
Completed MCParticle Loop
True Neutrino Energy: 30.9889
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 20 at 11-Dec-2025 19:23:43 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  26
Added hit list length: 26 | Max was set to: -3.40282e+38
True Neutron Energy: 939.574
True Electron Energy: 19.1397
Completed MCParticle Loop
True Neutrino Energy: 24.5188
 Size of all hits: 26
hit initial : 197.004 | hit correction : 1.16158
hit initial : 305.888 | hit correction : 1.16162
hit initial : 160.069 | hit correction : 1.16308
hit initial : 57.4988 | hit correction : 1.16321
hit initial : 228.719 | hit correction : 1.16169
hit initial : 200.377 | hit correction : 1.16182
hit initial : 256.508 | hit correction : 1.16209
hit initial : 255.34 | hit correction : 1.16232
hit initial : 239.511 | hit correction : 1.16256
hit initial : 211.404 | hit correction : 1.16284
 *** Total Charge : 2454.87
 Looking at view: 0 | Number of hits in view: 10
hit initial : 331.161 | hit correction : 1.16167
hit initial : 570.322 | hit correction : 1.1617
hit initial : 445.76 | hit correction : 1.16207
hit initial : 319.344 | hit correction : 1.16249
hit initial : 285.374 | hit correction : 1.16287
hit initial : 118.883 | hit correction : 1.16307
 *** Total Charge : 2406.6
 Looking at view: 1 | Number of hits in view: 6
hit initial : 21.6183 | hit correction : 1.16144
hit initial : 33.9631 | hit correction : 1.16008
hit initial : 271.646 | hit correction : 1.1615
hit initial : 51.8188 | hit correction : 1.16009
hit initial : 193.919 | hit correction : 1.16313
hit initial : 213.829 | hit correction : 1.16168
hit initial : 160.636 | hit correction : 1.16168
hit initial : 192.562 | hit correction : 1.16172
hit initial : 614.463 | hit correction : 1.16215
hit initial : 447.578 | hit correction : 1.16265
 *** Total Charge : 2558.88
 Looking at view: 2 | Number of hits in view: 10
11-Dec-2025 19:23:50 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.124788      0.202589      0.350849      0.191012      0.0716466       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000704202   0.00715902     0.0258188    0.000956312   0.00976167       10     
end_path:ana:AnalyzeEvents         0.106837      0.195162      0.349929      0.177472      0.0729094       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9812.03 MB
  Peak resident set size usage (VmHWM): 1537.95 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:29:01 UTC       justIN version: 01.06.00