justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258504.2@dunegpschedd02.fnal.gov

Jobsub ID258504.2@dunegpschedd02.fnal.gov
Workflow ID11023
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 11:33:57
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 19:21:11
From worker nodeHostnamedunegli-7832320-0-fnpc18010.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 11:34:58
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T191133Z_gen_001960_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (27955s)
CPU time7h (27550s = 98%)
Max RSS bytes3079630848 (2936 MiB)
Outputting started2025-12-06 19:20:53
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11023/1/001/analysisLowE_20251206T113459Z.root
Finished2025-12-06 19:21:11
Saved logsjustin-logs:258504.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

mary: 
Output 0: 0.16718, 
Output 1: 0.0947886, 0.106964, 0.151958, 0.64629, 
Output 2: 0.0245747, 0.180236, 0.777363, 0.0178265, 
Output 3: 0.978263, 0.0106233, 0.00224872, 0.00886518, 
Output 4: 0.365967, 0.539195, 0.0863899, 0.00844808, 
Output 5: 0.324691, 0.432832, 0.200098, 0.0423791, 
Output 6: 0.0240711, 0.0511989, 0.0689713, 0.855759, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 19600 at 06-Dec-2025 18:37:40 UTC
Boundary wire vector sizes: 6685, 6622, 6665
minwire 0: 40
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.149192, 
Output 1: 0.118806, 0.22033, 0.0981875, 0.562676, 
Output 2: 0.0244762, 0.282426, 0.647081, 0.0460168, 
Output 3: 0.976841, 0.00986115, 0.00318816, 0.0101095, 
Output 4: 0.937956, 0.0548884, 0.00606488, 0.00109052, 
Output 5: 0.294104, 0.267493, 0.331136, 0.107267, 
Output 6: 0.0143939, 0.037969, 0.0566613, 0.890976, 

06-Dec-2025 19:19:37 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 19:19:37 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/98/ff/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T191133Z_gen_001960_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2510.24       2769.92       2915.71       2794.59       114.642        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00156163     0.0102394     0.0342256    0.00511983     0.0109536       10     
reco:pandora:StandardPandora                            2506.78       2765.33       2907.81       2790.99       114.307        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000462462    0.0268276     0.128091      0.0101442     0.0363839       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000456561    0.0083003     0.0360508    0.00416331     0.010332        10     
reco:pandoracalo:Calorimetry                          0.000245413   0.00642609     0.0448122    0.000704435    0.0131006       10     
reco:pandorapid:Chi2ParticleID                        8.4459e-05    0.000436959   0.00300081    0.00016154    0.000855701      10     
reco:cvnmap:CVNMapper                                  0.0429132     0.0495173     0.0694941     0.045942      0.0081925       10     
reco:cvneva:CVNEvaluator                                1.95286       3.7109        6.7508        3.33814       1.42616        10     
reco:energyrecnumu:EnergyReco                          0.0184259     0.124752       0.17617       0.1345       0.0382782       10     
reco:energyrecnue:EnergyReco                          0.00190917    0.00594714     0.0156625    0.00251717    0.00526575       10     
reco:energyrecnc:EnergyReco                            0.0107652     0.0283987     0.146324      0.015845      0.0393509       10     
[art]:TriggerResults:TriggerResultInserter             2.665e-05    4.53755e-05   0.000146817   3.1975e-05    3.47818e-05      10     
end_path:out1:RootOutput                               8.776e-06    1.43489e-05    4.273e-05    1.13365e-05   9.72076e-06      10     
end_path:out1:RootOutput(write)                        0.565346      0.608181       0.67936      0.597299      0.0359771       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21779 MB
  Peak resident set size usage (VmHWM): 3079.63 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 121.954 | hit correction : 1.02682
hit initial : 154.034 | hit correction : 1.02684
hit initial : 28.7219 | hit correction : 1.02617
hit initial : 167.535 | hit correction : 1.02398
hit initial : 409.444 | hit correction : 1.02378
hit initial : 376.878 | hit correction : 1.01758
hit initial : 419.433 | hit correction : 1.01695
hit initial : 64.6185 | hit correction : 1.01664
hit initial : 121.804 | hit correction : 1.01658
hit initial : 34.3352 | hit correction : 1.0163
hit initial : 187.288 | hit correction : 1.01522
hit initial : 40.5006 | hit correction : 1.01516
hit initial : 108.248 | hit correction : 1.0144
hit initial : 355.552 | hit correction : 1.01425
hit initial : 239.109 | hit correction : 1.01393
hit initial : 35.6619 | hit correction : 1.01336
hit initial : 575.162 | hit correction : 1.01339
hit initial : 348.796 | hit correction : 1.01326
hit initial : 253.488 | hit correction : 1.01307
hit initial : 302.27 | hit correction : 1.01273
hit initial : 486.457 | hit correction : 1.01237
hit initial : 151.901 | hit correction : 1.01224
hit initial : 565.93 | hit correction : 1.01229
hit initial : 156.135 | hit correction : 1.01218
hit initial : 264.479 | hit correction : 1.01224
hit initial : 363.762 | hit correction : 1.01207
hit initial : 206.084 | hit correction : 1.01189
hit initial : 201.731 | hit correction : 1.01174
hit initial : 396.118 | hit correction : 1.01155
hit initial : 316.558 | hit correction : 1.01131
hit initial : 188.785 | hit correction : 1.01113
 *** Total Charge : 7754.88
 Looking at view: 2 | Number of hits in view: 31
Begin processing the 10th record. run: 5026 subRun: 0 event: 19600 at 06-Dec-2025 19:20:48 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  32
Added hit list length: 32 | Max was set to: -3.40282e+38
True Neutron Energy: 939.573
True Neutron Energy: 939.736
True Electron Energy: 22.6648
Completed MCParticle Loop
True Neutrino Energy: 31.6423
 Size of all hits: 32
hit initial : 24.3522 | hit correction : 1.13778
hit initial : 128.535 | hit correction : 1.13777
hit initial : 330.043 | hit correction : 1.13758
hit initial : 502.888 | hit correction : 1.13732
hit initial : 434.254 | hit correction : 1.13716
hit initial : 393.477 | hit correction : 1.13688
hit initial : 401.149 | hit correction : 1.13656
hit initial : 316.583 | hit correction : 1.13606
hit initial : 132.194 | hit correction : 1.13592
 *** Total Charge : 3028.25
 Looking at view: 0 | Number of hits in view: 9
hit initial : 58.6059 | hit correction : 1.13598
hit initial : 114.644 | hit correction : 1.136
hit initial : 150.063 | hit correction : 1.13592
hit initial : 45.532 | hit correction : 1.13559
hit initial : 85.9179 | hit correction : 1.13754
hit initial : 524.277 | hit correction : 1.13738
hit initial : 725.626 | hit correction : 1.13722
hit initial : 569.471 | hit correction : 1.13685
hit initial : 149.004 | hit correction : 1.13662
 *** Total Charge : 2754.98
 Looking at view: 1 | Number of hits in view: 9
hit initial : 75.0949 | hit correction : 1.13787
hit initial : 35.9544 | hit correction : 1.13612
hit initial : 68.1065 | hit correction : 1.13561
hit initial : 51.9611 | hit correction : 1.13561
hit initial : 224.706 | hit correction : 1.13772
hit initial : 222.003 | hit correction : 1.13757
hit initial : 346.922 | hit correction : 1.13731
hit initial : 324.061 | hit correction : 1.13719
hit initial : 155.577 | hit correction : 1.13714
hit initial : 151.404 | hit correction : 1.137
hit initial : 135.57 | hit correction : 1.13687
hit initial : 135.017 | hit correction : 1.13682
hit initial : 170.63 | hit correction : 1.13676
hit initial : 561.336 | hit correction : 1.13618
 *** Total Charge : 3022.34
 Looking at view: 2 | Number of hits in view: 14
06-Dec-2025 19:20:53 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.133461      0.155686      0.190524      0.156604      0.0172903       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000528397   0.000789173   0.00168959    0.000714038   0.000318203      10     
end_path:ana:AnalyzeEvents         0.132609      0.154601      0.188025       0.15582      0.0169438       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19472.2 MB
  Peak resident set size usage (VmHWM): 1527.41 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:08:21 UTC       justIN version: 01.06.00