justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47811.14@dunegpschedd01.fnal.gov

Jobsub ID47811.14@dunegpschedd01.fnal.gov
Workflow ID2501
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 22:25:43
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce03
Last heartbeat2025-09-17 22:52:59
From worker nodeHostnamecn511.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 22:26:23
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50572032_16_20231203T035411Z_gen_g4_detsim_hitreco__20240508T073005Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406500_0_20231202T122839Z_gen_g4_detsim_hitreco__20240507T220537Z_reco2.root
JobscriptExit code0
Real time23m (1439s)
CPU time18m (1130s = 78%)
Max RSS bytes2104094720 (2006 MiB)
Outputting started2025-09-17 22:50:23
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250917T222633Z.root
Finished2025-09-17 22:52:59
Saved logsjustin-logs:47811.14-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

7.96348        200    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00984054     0.0912084     0.546522      0.0784992     0.0616898       200    
reco:pandora:StandardPandora                           0.223893       3.88201       61.7875       2.40636       6.76571        200    
reco:pandoraTrack:LArPandoraTrackCreation             0.000206615    0.014271      0.336831     0.00282677     0.0397877       200    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000272673    0.0231378     0.483161     0.00509328     0.059573        200    
reco:pandoracalo:Calorimetry                          0.000171357    0.0419692      1.36216     0.00206113     0.156062        200    
reco:pandorapid:Chi2ParticleID                        5.9288e-05    0.00026574    0.00433359    0.000200355   0.00034765       200    
reco:cvnmap:CVNMapper                                 3.5158e-05     0.0181777     0.0694568     0.0240189     0.0130291       200    
reco:cvneva:CVNEvaluator                              2.7054e-05     0.313725       5.06905      0.419679      0.390744        200    
reco:energyrecnumu:EnergyReco                         0.000410353    0.125216       2.28564      0.0357216      0.23764        200    
reco:energyrecnue:EnergyReco                          0.000284596    0.0050229     0.105449     0.00110678     0.0135664       200    
reco:energyrecnc:EnergyReco                           0.00400898      0.15604       2.10543      0.167259      0.172028        200    
reco:energyrecnumurange:EnergyReco                    0.000426782    0.0599004      1.9382      0.00463637     0.198457        200    
reco:energyrecnumumcs:EnergyReco                      0.00103889     0.0618279      2.01028     0.00559308     0.199285        200    
reco:energyrecnumumcsllhd:EnergyReco                  0.000934882    0.0623741      2.01094     0.00563903     0.202736        200    
reco:opdec:Deconvolution                               0.140075      0.402002      0.816135       0.39078      0.136568        200    
reco:ophitspe:OpHitFinderDeco                          0.0673478      0.12312      0.392549      0.117834      0.0381941       200    
reco:opflash:OpFlashFinder                            0.000417587    0.0023176     0.0149387    0.00205951    0.00169781       200    
reco:opslicer:OpSlicer                                0.00174962     0.458094       1.75345       0.33278      0.395719        200    
reco:rns:RandomNumberSaver                            2.8848e-05    3.86004e-05   0.000545444    3.516e-05    3.61898e-05      200    
reco:anglereconue:NuAngularReco                       0.000233328   0.00313867     0.0813724    0.000546227   0.00919666       200    
reco:anglereconumu:NuAngularReco                      0.000126881    0.0029749     0.081437     0.000377305   0.00919743       200    
reco:anglereconuepfps:NuAngularReco                   0.000195845   0.00313474     0.0826179    0.000517051   0.00938158       200    
reco:anglereconumupfps:NuAngularReco                  0.000185347   0.00311695     0.0827896    0.00051357    0.00924441       200    
reco:anglerecohits:NuAngularReco                      0.000587963   0.00419727     0.0900887    0.00116181     0.0102373       200    
[art]:TriggerResults:TriggerResultInserter            1.4595e-05    2.02965e-05   8.7037e-05    1.94235e-05   5.84352e-06      200    
end_path:cafmaker:CAFMaker                            0.00210927     0.0363202     0.841092      0.0070537     0.105746        200    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3769.7 MB
  Peak resident set size usage (VmHWM): 2100.83 MB
====================================================================================================
lar exit code 0
=== Start last 100 lines of lar log file ===
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.71381, 0.00253233, 0.283658, 
Output 1: 0.838798, 0.154672, 0.00620488, 0.000324998, 
Output 2: 0.773743, 0.222384, 0.00376778, 0.000105292, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 717!
Begin processing the 194th record. run: 6406500 subRun: 1 event: 94 at 17-Sep-2025 23:49:47 BST
Boundary wire vector sizes: 1566, 875, 1183
minwire 0: 2347
minwire 1: 606
minwire 2: 2199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.0490546, 0.903581, 0.0473641, 
Output 1: 0.0455914, 0.118645, 0.188863, 0.646901, 
Output 2: 0.177183, 0.33864, 0.277613, 0.206564, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2346!
Begin processing the 195th record. run: 6406500 subRun: 1 event: 95 at 17-Sep-2025 23:49:55 BST
Boundary wire vector sizes: 398, 288, 407
minwire 0: 1086
minwire 1: 851
minwire 2: 1268
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.99607, 0.000682454, 0.00324722, 
Output 1: 0.93846, 0.0607421, 0.000642899, 0.000155076, 
Output 2: 0.99653, 0.00338258, 7.66792e-05, 1.03212e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1237!
Begin processing the 196th record. run: 6406500 subRun: 1 event: 96 at 17-Sep-2025 23:50:00 BST

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 833!
Begin processing the 197th record. run: 6406500 subRun: 1 event: 97 at 17-Sep-2025 23:50:04 BST

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 188!
Begin processing the 198th record. run: 6406500 subRun: 1 event: 98 at 17-Sep-2025 23:50:07 BST
Boundary wire vector sizes: 554, 596, 413
minwire 0: 177
minwire 1: 2261
minwire 2: 93
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00104344, 0.97989, 0.0190666, 
Output 1: 0.997018, 0.00267912, 0.000180312, 0.000122885, 
Output 2: 0.994575, 0.00523885, 0.000132452, 5.34301e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1386!
Begin processing the 199th record. run: 6406500 subRun: 1 event: 99 at 17-Sep-2025 23:50:12 BST
Boundary wire vector sizes: 199, 171, 158
minwire 0: 454
minwire 1: 2413
minwire 2: 11
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.000619991, 0.995063, 0.00431738, 
Output 1: 0.988062, 0.011622, 0.000168411, 0.000147447, 
Output 2: 0.998789, 0.00115913, 3.61016e-05, 1.5648e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1447!
Begin processing the 200th record. run: 6406500 subRun: 1 event: 100 at 17-Sep-2025 23:50:17 BST
Boundary wire vector sizes: 303, 371, 366
minwire 0: 87
minwire 1: 2128
minwire 2: 24
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.325816, 0.212699, 0.461485, 
Output 1: 0.166982, 0.633635, 0.182126, 0.0172574, 
Output 2: 0.471879, 0.398286, 0.116379, 0.0134564, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1118!
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
processed files
root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/fd/9d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50572032_16_20231203T035411Z_gen_g4_detsim_hitreco__20240508T073005Z_reco2.root
root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/53/cf/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6406500_0_20231202T122839Z_gen_g4_detsim_hitreco__20240507T220537Z_reco2.root
.:
total 8400
-rw-r--r-- 1 pildune32 pildune 3250966 Sep 17 23:50 flatcaf.root
-rw-r--r-- 1 pildune32 pildune 2566771 Sep 17 23:50 caf.root
-rw-r--r-- 1 pildune32 pildune 2566771 Sep 17 23:50 caf_fd_hd_atmo_2501_20250917T222633Z.root
-rw-r--r-- 1 pildune32 pildune  125759 Sep 17 23:50 caf_20250917T222633Z.log
-rw-r--r-- 1 pildune32 pildune   55595 Sep 17 23:50 jobscript.log
-rw-r--r-- 1 pildune32 pildune     394 Sep 17 23:50 caf_20250917T222633Z.file
-rw-r--r-- 1 pildune32 pildune     394 Sep 17 23:50 caf_20250917T222633Z.pfns
-rw-r--r-- 1 pildune32 pildune     394 Sep 17 23:26 file.list
-rw-r--r-- 1 pildune32 pildune     394 Sep 17 23:50 justin-processed-pfns.txt
-rw-r--r-- 1 pildune32 pildune     272 Sep 17 23:26 all-input-dids.txt
-rw-r--r-- 1 pildune32 pildune     272 Sep 17 23:50 caf_20250917T222633Z.did
-rw-r--r-- 1 pildune32 pildune     272 Sep 17 23:26 did.list
-rw-r--r-- 1 pildune32 pildune       0 Sep 17 23:26 debugprod.log
justIN time: 2025-09-18 16:06:11 UTC       justIN version: 01.05.00