Jobsub ID 30138.34@dunegpschedd01.fnal.gov

Jobsub ID	30138.34@dunegpschedd01.fnal.gov
Workflow ID	1744
Stage ID	1
User name	ichong@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-08-21 15:36:42
Site	UK_QMUL
Entry	DUNE_UK_London_QMUL_arcce02
Last heartbeat	2025-08-21 17:51:27
From worker node	Hostname	cn021.htc.esc.qmul
	cpuinfo	Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-08-21 15:38:31
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2.root
Jobscript	Exit code	0
	Real time	2h (7824s)
	CPU time	21m (1277s = 16%)
	Max RSS bytes	2148356096 (2048 MiB)
Outputting started	2025-08-21 17:48:56
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/fnal/01744/1/001/caf_truthvtx_2025-08-21T_165918Z_caf.root
Finished	2025-08-21 17:51:27
Saved logs	justin-logs:30138.34-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.000307968    0.195713       7.34538      0.0219205     0.807947        100    
reco:energyrecnue:EnergyReco                          0.000129471   0.00886326     0.454783     0.000852986    0.046027        100    
reco:energyrecnc:EnergyReco                           0.00192033     0.0527952     0.475366      0.0325899     0.0714399       100    
reco:energyrecnumurange:EnergyReco                    0.000292138    0.149447       5.48443     0.00425999     0.621995        100    
reco:energyrecnumumcs:EnergyReco                      0.000900423    0.147185       5.63288     0.00513252     0.626663        100    
reco:energyrecnumumcsllhd:EnergyReco                  0.000826764    0.145232       5.52689     0.00491103     0.614498        100    
reco:opdec:Deconvolution                               0.0515695     0.231041      0.888606      0.208017      0.115375        100    
reco:ophitspe:OpHitFinderDeco                         0.00901404     0.0374149     0.469655      0.020439      0.0530863       100    
reco:opflash:OpFlashFinder                            0.000380218   0.00182283    0.00504429    0.00156996    0.000965166      100    
reco:opslicer:OpSlicer                                 0.0033616     0.281961       1.44605      0.215476      0.241539        100    
reco:rns:RandomNumberSaver                            2.0252e-05    3.10428e-05   0.000354121   2.62705e-05   3.30175e-05      100    
reco:anglereconue:NuAngularReco                       0.00017576    0.00499799     0.235952     0.000453374    0.0243736       100    
reco:anglereconumu:NuAngularReco                      6.7679e-05    0.00456565     0.226066     0.000264844    0.0230575       100    
reco:anglereconuepfps:NuAngularReco                   0.000106061    0.0045366      0.20907     0.000336533    0.0214788       100    
reco:anglereconumupfps:NuAngularReco                  8.9999e-05    0.00424954     0.156128     0.000342489    0.0172451       100    
reco:anglerecohits:NuAngularReco                      0.000294842   0.00511714     0.202663     0.000718999    0.021037        100    
[art]:TriggerResults:TriggerResultInserter             8.402e-06    1.32467e-05   5.2725e-05    1.2041e-05    4.99189e-06      100    
end_path:out1:RootOutput                               2.453e-06    3.38807e-06   1.4768e-05     3.155e-06    1.24067e-06      100    
end_path:out1:RootOutput(write)                        0.0188346      6.06475       37.254        3.67945       7.03529        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 16575.1 MB
  Peak resident set size usage (VmHWM): 2148.36 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDVertexDistanceFeatureTool_VertexDistance' for PFP with ID 4
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArPfoHierarchyFeatureTool_DaughterParentHitRatio' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArPfoHierarchyFeatureTool_NDaughterHits3D' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDChargeFeatureTool_EndFraction' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDChargeFeatureTool_FractionalSpread' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDLinearFitFeatureTool_DiffStraightLineMean' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDLinearFitFeatureTool_Length' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDLinearFitFeatureTool_MaxFitGapLength' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDLinearFitFeatureTool_SlidingLinearFitRMS' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDOpeningAngleFeatureTool_AngleDiff' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDPCAFeatureTool_SecondaryPCARatio' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDPCAFeatureTool_TertiaryPCARatio' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDVertexDistanceFeatureTool_VertexDistance' for PFP with ID 5
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArPfoHierarchyFeatureTool_DaughterParentHitRatio' for PFP with ID 6
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArPfoHierarchyFeatureTool_NDaughterHits3D' for PFP with ID 6
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDChargeFeatureTool_EndFraction' for PFP with ID 6
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDChargeFeatureTool_FractionalSpread' for PFP with ID 6
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDLinearFitFeatureTool_DiffStraightLineMean' for PFP with ID 6
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDLinearFitFeatureTool_Length' for PFP with ID 6
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDLinearFitFeatureTool_MaxFitGapLength' for PFP with ID 6
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDLinearFitFeatureTool_SlidingLinearFitRMS' for PFP with ID 6
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDOpeningAngleFeatureTool_AngleDiff' for PFP with ID 6
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDPCAFeatureTool_SecondaryPCARatio' for PFP with ID 6
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDPCAFeatureTool_TertiaryPCARatio' for PFP with ID 6
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 21-Aug-2025 18:39:46 BST  run: 6404651 subRun: 1 event: 80100
Unknown property 'LArThreeDVertexDistanceFeatureTool_VertexDistance' for PFP with ID 6
%MSG
21-Aug-2025 18:48:53 BST  Closed output file "caf_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2_truthvtx_2025-08-21T_165918Z.root"
21-Aug-2025 18:48:53 BST  Closed input file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2_truthvtx_2025-08-21T_153837Z.root"
%MSG-i NuRandomService:  RootOutput:out@EndJob 21-Aug-2025 18:48:54 BST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        100        100          0 cafmaker
TrigReport        100        100          0 out

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 89.261989 Real = 2955.016896

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 15142.5 VmHWM = 1191.26

Art has completed and will exit with status 0.
=== End last  100 lines of lar log file ===
=== Generated output files ===
30138.34_dunegpschedd01.fnal.gov.logs.tgz
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2_truthvtx_2025-08-21T_153837Z.root
caf_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2_truthvtx_2025-08-21T_165918Z.log
caf_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2_truthvtx_2025-08-21T_165918Z.root
caf_truthvtx_2025-08-21T_165918Z_caf.root
debugprod.log
flatcaf.root
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
truthvtx_2025-08-21T_153837Z_vtx.log