justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 41762.0@dunegpschedd02.fnal.gov

Jobsub ID41762.0@dunegpschedd02.fnal.gov
Workflow ID2501
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-18 08:30:13
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2025-09-18 09:28:26
From worker nodeHostnamewn1908240.tier2.hep.manchester.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-18 08:32:35
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6452759_735_20231207T090121Z_gen_g4_detsim_hitreco__20240510T023938Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413290_1071_20231203T034618Z_gen_g4_detsim_hitreco__20240508T061612Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_251_20231201T170153Z_gen_g4_detsim_hitreco__20240507T190954Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419482_305_20231203T170242Z_gen_g4_detsim_hitreco__20240509T214656Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74521450_590_20231205T053704Z_gen_g4_detsim_hitreco__20240509T221832Z_reco2.root
JobscriptExit code0
Real time54m (3286s)
CPU time44m (2646s = 80%)
Max RSS bytes1964060672 (1873 MiB)
Outputting started2025-09-18 09:27:22
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250918T083248Z.root
Finished2025-09-18 09:28:26
Saved logsjustin-logs:41762.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.00293635     0.0284315       500    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000255435    0.0209568     0.609395      0.0053076     0.0537738       500    
reco:pandoracalo:Calorimetry                          0.000152623    0.0295026      1.61657     0.00214829     0.141533        500    
reco:pandorapid:Chi2ParticleID                        5.4489e-05    0.000269263   0.00193318    0.000219306   0.00020384       500    
reco:cvnmap:CVNMapper                                 3.2562e-05     0.0251276     0.212699      0.0222048     0.0252282       500    
reco:cvneva:CVNEvaluator                               2.578e-05     0.489129       6.45555      0.628043      0.389274        500    
reco:energyrecnumu:EnergyReco                         0.000412831    0.104548       6.38573      0.0269239     0.334863        500    
reco:energyrecnue:EnergyReco                          0.000244225   0.00354124     0.119755     0.00102449    0.00966066       500    
reco:energyrecnc:EnergyReco                           0.00222817     0.132791      0.552787       0.16181      0.0947122       500    
reco:energyrecnumurange:EnergyReco                    0.000399129    0.054227       5.18538     0.00403556     0.278613        500    
reco:energyrecnumumcs:EnergyReco                      0.000847968    0.0553649      5.21633     0.00508512     0.280052        500    
reco:energyrecnumumcsllhd:EnergyReco                  0.000723483    0.0564249      5.35088     0.00515905     0.291338        500    
reco:opdec:Deconvolution                               0.0879689     0.376717      0.749969      0.377479      0.127369        500    
reco:ophitspe:OpHitFinderDeco                          0.0928782     0.195386      0.550504      0.191587      0.0650696       500    
reco:opflash:OpFlashFinder                            0.000346446   0.00247437     0.0356806    0.00233851    0.00188622       500    
reco:opslicer:OpSlicer                                7.2439e-05     0.396877       1.58403      0.333962      0.312839        500    
reco:rns:RandomNumberSaver                            2.6874e-05    6.7331e-05    0.000751305   6.12395e-05   4.30977e-05      500    
reco:anglereconue:NuAngularReco                       0.000215898   0.00248539     0.0897318    0.00074367    0.00684689       500    
reco:anglereconumu:NuAngularReco                      0.000118239   0.00210417     0.0863944    0.00043195    0.00660886       500    
reco:anglereconuepfps:NuAngularReco                   0.000162012   0.00227109     0.086441     0.000570562   0.00666607       500    
reco:anglereconumupfps:NuAngularReco                  0.000134949   0.00221552     0.0845604    0.000531892   0.00666214       500    
reco:anglerecohits:NuAngularReco                      0.00013051     0.0031757     0.0934743    0.00121292    0.00751576       500    
[art]:TriggerResults:TriggerResultInserter            1.2349e-05    2.20333e-05   0.000100924   2.05915e-05   6.96304e-06      500    
end_path:cafmaker:CAFMaker                            0.00235324     0.0393065      1.06608      0.0172528     0.0872279       500    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3652.01 MB
  Peak resident set size usage (VmHWM): 1964.06 MB
====================================================================================================
lar exit code 0
=== Start last 100 lines of lar log file ===
minwire 0: 931
minwire 1: 1395
minwire 2: 769
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.992373, 0.000474086, 0.00715271, 
Output 1: 0.0484454, 0.746708, 0.20003, 0.00481582, 
Output 2: 0.981057, 0.0182657, 0.000662401, 1.45166e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2131!
Begin processing the 495th record. run: 74521450 subRun: 1 event: 59095 at 18-Sep-2025 10:26:50 BST

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1088!
Begin processing the 496th record. run: 74521450 subRun: 1 event: 59096 at 18-Sep-2025 10:26:54 BST
Boundary wire vector sizes: 88, 188, 153
minwire 0: 323
minwire 1: 2505
minwire 2: 0
Used alternate method to get min and max wires due to vertex determination failure: 445, 744
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.993502, 0.000395685, 0.00610196, 
Output 1: 0.985185, 0.0122372, 0.0014865, 0.00109149, 
Output 2: 0.986356, 0.0130002, 0.00051926, 0.000124706, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1645!
Begin processing the 497th record. run: 74521450 subRun: 1 event: 59097 at 18-Sep-2025 10:26:59 BST
Boundary wire vector sizes: 511, 491, 347
minwire 0: 1179
minwire 1: 1640
minwire 2: 572
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00110079, 0.983086, 0.0158128, 
Output 1: 0.0471306, 0.927849, 0.023914, 0.00110659, 
Output 2: 0.92131, 0.0765293, 0.00210331, 5.70443e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2567!
Begin processing the 498th record. run: 74521450 subRun: 1 event: 59098 at 18-Sep-2025 10:27:05 BST
Boundary wire vector sizes: 299, 356, 360
minwire 0: 951
minwire 1: 1347
minwire 2: 1003
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.997249, 0.000293698, 0.00245694, 
Output 1: 0.00378663, 0.0795758, 0.892518, 0.0241196, 
Output 2: 0.96433, 0.0341748, 0.00147593, 1.87412e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1775!
Begin processing the 499th record. run: 74521450 subRun: 1 event: 59099 at 18-Sep-2025 10:27:10 BST
Boundary wire vector sizes: 42, 33, 27
minwire 0: 852
minwire 1: 1660
minwire 2: 838
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.70333, 0.218372, 0.0782981, 
Output 1: 0.20798, 0.767311, 0.0239985, 0.000710049, 
Output 2: 0.943951, 0.0549087, 0.00111395, 2.64326e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1019!
Begin processing the 500th record. run: 74521450 subRun: 1 event: 59100 at 18-Sep-2025 10:27:15 BST
Boundary wire vector sizes: 114, 66, 102
minwire 0: 1567
minwire 1: 1042
minwire 2: 1642
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.971044, 0.00102455, 0.0279316, 
Output 1: 0.0136121, 0.983852, 0.00244835, 8.77964e-05, 
Output 2: 0.958161, 0.0409377, 0.00088514, 1.57815e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1203!
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
processed files
root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/46/31/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6452759_735_20231207T090121Z_gen_g4_detsim_hitreco__20240510T023938Z_reco2.root
root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/0d/fe/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413290_1071_20231203T034618Z_gen_g4_detsim_hitreco__20240508T061612Z_reco2.root
root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/57/86/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_251_20231201T170153Z_gen_g4_detsim_hitreco__20240507T190954Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/e5/8e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419482_305_20231203T170242Z_gen_g4_detsim_hitreco__20240509T214656Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/e3/3e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74521450_590_20231205T053704Z_gen_g4_detsim_hitreco__20240509T221832Z_reco2.root
.:
total 20224
-rw-r--r-- 1 dune01 dune01 7647272 Sep 18 10:27 flatcaf.root
-rw-r--r-- 1 dune01 dune01 6294819 Sep 18 10:27 caf.root
-rw-r--r-- 1 dune01 dune01 6294819 Sep 18 10:27 caf_fd_hd_atmo_2501_20250918T083248Z.root
-rw-r--r-- 1 dune01 dune01  310785 Sep 18 10:27 caf_20250918T083248Z.log
-rw-r--r-- 1 dune01 dune01  112599 Sep 18 10:27 jobscript.log
-rw-r--r-- 1 dune01 dune01     959 Sep 18 10:27 caf_20250918T083248Z.file
-rw-r--r-- 1 dune01 dune01     959 Sep 18 10:27 caf_20250918T083248Z.pfns
-rw-r--r-- 1 dune01 dune01     959 Sep 18 09:32 file.list
-rw-r--r-- 1 dune01 dune01     959 Sep 18 10:27 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01     688 Sep 18 09:32 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01     688 Sep 18 10:27 caf_20250918T083248Z.did
-rw-r--r-- 1 dune01 dune01     688 Sep 18 09:32 did.list
-rw-r--r-- 1 dune01 dune01       0 Sep 18 09:33 debugprod.log
justIN time: 2025-09-19 02:18:48 UTC       justIN version: 01.05.00