justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257717.93@dunegpschedd02.fnal.gov

Jobsub ID257717.93@dunegpschedd02.fnal.gov
Workflow ID11006
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-04 23:14:05
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-05 05:48:52
From worker nodeHostnamedunegli-7828846-0-fnpc18006.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-05 01:21:33
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T225316Z_gen_000834_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (16013s)
CPU time4h (15763s = 98%)
Max RSS bytes3074342912 (2931 MiB)
Outputting started2025-12-05 05:48:27
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11006/1/001/analysisLowE_20251205T012134Z.root
Finished2025-12-05 05:48:52
Saved logsjustin-logs:257717.93-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

put 2: 0.0927937, 0.420441, 0.42443, 0.0623352, 
Output 3: 0.942461, 0.043, 0.00664477, 0.00789382, 
Output 4: 0.340757, 0.572342, 0.0823548, 0.00454688, 
Output 5: 0.860735, 0.122846, 0.0137042, 0.00271457, 
Output 6: 0.00833669, 0.0362926, 0.0600759, 0.895295, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 8340 at 05-Dec-2025 05:20:25 UTC
Boundary wire vector sizes: 6761, 6710, 6631
minwire 0: 39
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.171804, 
Output 1: 0.104982, 0.128708, 0.123084, 0.643226, 
Output 2: 0.0798081, 0.242048, 0.629273, 0.0488714, 
Output 3: 0.981621, 0.00771812, 0.00146779, 0.00919274, 
Output 4: 0.671907, 0.301283, 0.0236008, 0.00320862, 
Output 5: 0.382838, 0.427234, 0.144933, 0.0449949, 
Output 6: 0.0352751, 0.0714765, 0.0821721, 0.811076, 

05-Dec-2025 05:47:31 UTC  Closed output file "matt_reco2.root"
05-Dec-2025 05:47:31 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/a6/ba/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T225316Z_gen_000834_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1528.91       1584.69       1675.12       1576.35       45.5578        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00392525     0.0213659     0.134046      0.0050949     0.0382628       10     
reco:pandora:StandardPandora                            1526.19       1581.61       1671.1        1572.84       45.2745        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00137154     0.0136895     0.0754173    0.00362128     0.0222503       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00178511    0.00646367     0.0187212    0.00590559    0.00449315       10     
reco:pandoracalo:Calorimetry                          0.000398522    0.0094775     0.0344759    0.000733175    0.0131051       10     
reco:pandorapid:Chi2ParticleID                        8.0542e-05    0.000291035   0.00128041    0.000134669   0.000347397      10     
reco:cvnmap:CVNMapper                                  0.0315547     0.0407704     0.0531894     0.0392063    0.00644384       10     
reco:cvneva:CVNEvaluator                                1.80205       2.41088       3.72532       2.00598      0.775082        10     
reco:energyrecnumu:EnergyReco                          0.0092978     0.0756786      0.16632      0.0906061     0.053951        10     
reco:energyrecnue:EnergyReco                          0.00134961    0.00500023    0.00940422    0.00342195    0.00365838       10     
reco:energyrecnc:EnergyReco                           0.00920696     0.0499319      0.13663     0.00957664      0.0507         10     
[art]:TriggerResults:TriggerResultInserter             1.597e-05    2.92191e-05   6.6345e-05    2.68055e-05   1.41811e-05      10     
end_path:out1:RootOutput                               6.322e-06    1.26777e-05   2.7342e-05    1.0249e-05    6.6352e-06       10     
end_path:out1:RootOutput(write)                        0.372251      0.446987      0.588725      0.389948      0.0887395       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21787 MB
  Peak resident set size usage (VmHWM): 3074.34 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 183.933 | hit correction : 1.39302
hit initial : 61.215 | hit correction : 1.39295
hit initial : 726.228 | hit correction : 1.39197
hit initial : 151.978 | hit correction : 1.39154
hit initial : 88.6395 | hit correction : 1.38982
hit initial : 144.11 | hit correction : 1.38855
hit initial : 50.1329 | hit correction : 1.38846
hit initial : 299.504 | hit correction : 1.38844
hit initial : 103.855 | hit correction : 1.3871
hit initial : 173.939 | hit correction : 1.38707
hit initial : 110.036 | hit correction : 1.38583
hit initial : 235.598 | hit correction : 1.38585
hit initial : 140.423 | hit correction : 1.3858
hit initial : 43.1004 | hit correction : 1.38506
hit initial : 137.601 | hit correction : 1.38415
hit initial : 361.676 | hit correction : 1.38391
hit initial : 98.7695 | hit correction : 1.38381
hit initial : 132.316 | hit correction : 1.38284
hit initial : 51.289 | hit correction : 1.38277
hit initial : 60.4098 | hit correction : 1.38199
hit initial : 138.482 | hit correction : 1.38197
hit initial : 89.4712 | hit correction : 1.3819
 *** Total Charge : 6237.61
 Looking at view: 0 | Number of hits in view: 31
hit initial : 32.5283 | hit correction : 1.37804
hit initial : 75.5446 | hit correction : 1.37806
hit initial : 39.4498 | hit correction : 1.3781
hit initial : 42.3389 | hit correction : 1.3819
hit initial : 46.3979 | hit correction : 1.38195
hit initial : 44.6407 | hit correction : 1.40239
hit initial : 76.2635 | hit correction : 1.40058
hit initial : 207.199 | hit correction : 1.40056
hit initial : 124.584 | hit correction : 1.40054
hit initial : 76.6191 | hit correction : 1.3952
hit initial : 217.693 | hit correction : 1.39502
hit initial : 119.046 | hit correction : 1.39489
hit initial : 205.401 | hit correction : 1.39365
hit initial : 275.777 | hit correction : 1.39316
hit initial : 202.13 | hit correction : 1.39252
hit initial : 171.237 | hit correction : 1.39196
hit initial : 76.7348 | hit correction : 1.39126
hit initial : 43.0466 | hit correction : 1.39054
hit initial : 97.1089 | hit correction : 1.38979
hit initial : 683.209 | hit correction : 1.38893
hit initial : 116.272 | hit correction : 1.38857
hit initial : 50.9687 | hit correction : 1.38851
hit initial : 9.2189 | hit correction : 1.38676
hit initial : 111.454 | hit correction : 1.38659
hit initial : 348.702 | hit correction : 1.38596
hit initial : 50.9541 | hit correction : 1.38588
hit initial : 22.7227 | hit correction : 1.38579
hit initial : 141.222 | hit correction : 1.38409
hit initial : 352.441 | hit correction : 1.38374
hit initial : 271.018 | hit correction : 1.38271
hit initial : 145.619 | hit correction : 1.38212
 *** Total Charge : 6221.55
 Looking at view: 1 | Number of hits in view: 31
hit initial : 56.4615 | hit correction : 1.38651
hit initial : 14.1908 | hit correction : 1.38652
hit initial : 43.5535 | hit correction : 1.38375
hit initial : 29.7737 | hit correction : 1.3819
hit initial : 59.8609 | hit correction : 1.3819
hit initial : 185.499 | hit correction : 1.39515
hit initial : 352.046 | hit correction : 1.39464
hit initial : 257.756 | hit correction : 1.3935
hit initial : 189.531 | hit correction : 1.39288
hit initial : 157.896 | hit correction : 1.39244
hit initial : 196.31 | hit correction : 1.39193
hit initial : 215.784 | hit correction : 1.39132
hit initial : 215.473 | hit correction : 1.39051
hit initial : 133.474 | hit correction : 1.38981
hit initial : 196.894 | hit correction : 1.38862
hit initial : 29.7519 | hit correction : 1.38854
hit initial : 379.28 | hit correction : 1.38848
hit initial : 270.804 | hit correction : 1.38616
hit initial : 28.8359 | hit correction : 1.38435
hit initial : 903.921 | hit correction : 1.38433
hit initial : 77.6137 | hit correction : 1.3836
hit initial : 244.073 | hit correction : 1.38217
hit initial : 24.379 | hit correction : 1.3819
 *** Total Charge : 5919.9
 Looking at view: 2 | Number of hits in view: 23
05-Dec-2025 05:48:27 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0900343     0.159398      0.393149      0.110114      0.109561        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000491117    0.0254185     0.246936     0.00060345     0.0738415       10     
end_path:ana:AnalyzeEvents         0.0893163     0.133741      0.359202       0.1094       0.0771352       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19473.6 MB
  Peak resident set size usage (VmHWM): 1534.14 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 20:42:10 UTC       justIN version: 01.06.00