justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 232456.23@dunegpschedd01.fnal.gov

Jobsub ID232456.23@dunegpschedd01.fnal.gov
Workflow ID8822
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-10-10 09:03:49
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce2
Last heartbeat2025-10-10 09:42:16
From worker nodeHostnamewn097.hep
cpuinfoIntel(R) Xeon(R) CPU E5-2698 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-10 09:04:30
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74553259_39_20231207T130457Z_gen_g4_detsim_hitreco__20240510T063233Z_reco2.root
JobscriptExit code0
Real time37m (2240s)
CPU time32m (1926s = 85%)
Max RSS bytes1412767744 (1347 MiB)
Outputting started2025-10-10 09:41:51
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/atm_hierarchy_val/fnal/08822/1/001/DLHierarchyValidationFile_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74553259_39_20231207T130457Z_gen_g4_detsim_hitreco__20240510T063233Z_reco2.root
Finished2025-10-10 09:42:16
Saved logsjustin-logs:232456.23-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

10T063233Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 74553259 subRun: 1 event: 3923 at 10-Oct-2025 10:10:00 BST
Begin processing the 24th record. run: 74553259 subRun: 1 event: 3924 at 10-Oct-2025 10:10:03 BST
Begin processing the 25th record. run: 74553259 subRun: 1 event: 3925 at 10-Oct-2025 10:10:07 BST
Begin processing the 26th record. run: 74553259 subRun: 1 event: 3926 at 10-Oct-2025 10:10:10 BST
Begin processing the 27th record. run: 74553259 subRun: 1 event: 3927 at 10-Oct-2025 10:10:26 BST
Begin processing the 28th record. run: 74553259 subRun: 1 event: 3928 at 10-Oct-2025 10:10:29 BST
Begin processing the 29th record. run: 74553259 subRun: 1 event: 3929 at 10-Oct-2025 10:10:33 BST
Begin processing the 30th record. run: 74553259 subRun: 1 event: 3930 at 10-Oct-2025 10:10:36 BST
Begin processing the 31st record. run: 74553259 subRun: 1 event: 3931 at 10-Oct-2025 10:10:39 BST
Begin processing the 32nd record. run: 74553259 subRun: 1 event: 3932 at 10-Oct-2025 10:10:43 BST
Begin processing the 33rd record. run: 74553259 subRun: 1 event: 3933 at 10-Oct-2025 10:11:20 BST
Begin processing the 34th record. run: 74553259 subRun: 1 event: 3934 at 10-Oct-2025 10:11:25 BST
Begin processing the 35th record. run: 74553259 subRun: 1 event: 3935 at 10-Oct-2025 10:11:29 BST
Begin processing the 36th record. run: 74553259 subRun: 1 event: 3936 at 10-Oct-2025 10:11:33 BST
Begin processing the 37th record. run: 74553259 subRun: 1 event: 3937 at 10-Oct-2025 10:11:37 BST
Begin processing the 38th record. run: 74553259 subRun: 1 event: 3938 at 10-Oct-2025 10:11:41 BST
Begin processing the 39th record. run: 74553259 subRun: 1 event: 3939 at 10-Oct-2025 10:11:44 BST
Begin processing the 40th record. run: 74553259 subRun: 1 event: 3940 at 10-Oct-2025 10:11:48 BST
Begin processing the 41st record. run: 74553259 subRun: 1 event: 3941 at 10-Oct-2025 10:11:52 BST
Begin processing the 42nd record. run: 74553259 subRun: 1 event: 3942 at 10-Oct-2025 10:11:56 BST
Begin processing the 43rd record. run: 74553259 subRun: 1 event: 3943 at 10-Oct-2025 10:11:59 BST
Begin processing the 44th record. run: 74553259 subRun: 1 event: 3944 at 10-Oct-2025 10:12:03 BST
Begin processing the 45th record. run: 74553259 subRun: 1 event: 3945 at 10-Oct-2025 10:12:07 BST
Begin processing the 46th record. run: 74553259 subRun: 1 event: 3946 at 10-Oct-2025 10:12:11 BST
Begin processing the 47th record. run: 74553259 subRun: 1 event: 3947 at 10-Oct-2025 10:12:16 BST
Begin processing the 48th record. run: 74553259 subRun: 1 event: 3948 at 10-Oct-2025 10:12:20 BST
Begin processing the 49th record. run: 74553259 subRun: 1 event: 3949 at 10-Oct-2025 10:12:24 BST
Begin processing the 50th record. run: 74553259 subRun: 1 event: 3950 at 10-Oct-2025 10:12:57 BST
Begin processing the 51st record. run: 74553259 subRun: 1 event: 3951 at 10-Oct-2025 10:13:00 BST
Begin processing the 52nd record. run: 74553259 subRun: 1 event: 3952 at 10-Oct-2025 10:13:04 BST
Begin processing the 53rd record. run: 74553259 subRun: 1 event: 3953 at 10-Oct-2025 10:13:08 BST
Begin processing the 54th record. run: 74553259 subRun: 1 event: 3954 at 10-Oct-2025 10:13:11 BST
Begin processing the 55th record. run: 74553259 subRun: 1 event: 3955 at 10-Oct-2025 10:13:15 BST
Begin processing the 56th record. run: 74553259 subRun: 1 event: 3956 at 10-Oct-2025 10:13:19 BST
Begin processing the 57th record. run: 74553259 subRun: 1 event: 3957 at 10-Oct-2025 10:13:23 BST
Begin processing the 58th record. run: 74553259 subRun: 1 event: 3958 at 10-Oct-2025 10:13:27 BST
Begin processing the 59th record. run: 74553259 subRun: 1 event: 3959 at 10-Oct-2025 10:13:31 BST
Begin processing the 60th record. run: 74553259 subRun: 1 event: 3960 at 10-Oct-2025 10:13:34 BST
Begin processing the 61st record. run: 74553259 subRun: 1 event: 3961 at 10-Oct-2025 10:13:38 BST
Begin processing the 62nd record. run: 74553259 subRun: 1 event: 3962 at 10-Oct-2025 10:13:42 BST
Begin processing the 63rd record. run: 74553259 subRun: 1 event: 3963 at 10-Oct-2025 10:13:46 BST
Begin processing the 64th record. run: 74553259 subRun: 1 event: 3964 at 10-Oct-2025 10:13:50 BST
Begin processing the 65th record. run: 74553259 subRun: 1 event: 3965 at 10-Oct-2025 10:13:54 BST
Begin processing the 66th record. run: 74553259 subRun: 1 event: 3966 at 10-Oct-2025 10:13:58 BST
Begin processing the 67th record. run: 74553259 subRun: 1 event: 3967 at 10-Oct-2025 10:14:02 BST
Begin processing the 68th record. run: 74553259 subRun: 1 event: 3968 at 10-Oct-2025 10:14:05 BST
Begin processing the 69th record. run: 74553259 subRun: 1 event: 3969 at 10-Oct-2025 10:14:09 BST
Begin processing the 70th record. run: 74553259 subRun: 1 event: 3970 at 10-Oct-2025 10:14:13 BST
Begin processing the 71st record. run: 74553259 subRun: 1 event: 3971 at 10-Oct-2025 10:15:35 BST
Begin processing the 72nd record. run: 74553259 subRun: 1 event: 3972 at 10-Oct-2025 10:15:39 BST
Begin processing the 73rd record. run: 74553259 subRun: 1 event: 3973 at 10-Oct-2025 10:15:43 BST
Begin processing the 74th record. run: 74553259 subRun: 1 event: 3974 at 10-Oct-2025 10:15:46 BST
Begin processing the 75th record. run: 74553259 subRun: 1 event: 3975 at 10-Oct-2025 10:15:50 BST
Begin processing the 76th record. run: 74553259 subRun: 1 event: 3976 at 10-Oct-2025 10:15:53 BST
Begin processing the 77th record. run: 74553259 subRun: 1 event: 3977 at 10-Oct-2025 10:15:57 BST
Begin processing the 78th record. run: 74553259 subRun: 1 event: 3978 at 10-Oct-2025 10:16:00 BST
Begin processing the 79th record. run: 74553259 subRun: 1 event: 3979 at 10-Oct-2025 10:16:04 BST
Begin processing the 80th record. run: 74553259 subRun: 1 event: 3980 at 10-Oct-2025 10:16:09 BST
Begin processing the 81st record. run: 74553259 subRun: 1 event: 3981 at 10-Oct-2025 10:16:12 BST
Begin processing the 82nd record. run: 74553259 subRun: 1 event: 3982 at 10-Oct-2025 10:16:16 BST
Begin processing the 83rd record. run: 74553259 subRun: 1 event: 3983 at 10-Oct-2025 10:16:19 BST
Begin processing the 84th record. run: 74553259 subRun: 1 event: 3984 at 10-Oct-2025 10:16:22 BST
Begin processing the 85th record. run: 74553259 subRun: 1 event: 3985 at 10-Oct-2025 10:39:46 BST
Begin processing the 86th record. run: 74553259 subRun: 1 event: 3986 at 10-Oct-2025 10:39:51 BST
Begin processing the 87th record. run: 74553259 subRun: 1 event: 3987 at 10-Oct-2025 10:39:55 BST
Begin processing the 88th record. run: 74553259 subRun: 1 event: 3988 at 10-Oct-2025 10:40:00 BST
Begin processing the 89th record. run: 74553259 subRun: 1 event: 3989 at 10-Oct-2025 10:40:04 BST
Begin processing the 90th record. run: 74553259 subRun: 1 event: 3990 at 10-Oct-2025 10:40:08 BST
Begin processing the 91st record. run: 74553259 subRun: 1 event: 3991 at 10-Oct-2025 10:40:12 BST
Begin processing the 92nd record. run: 74553259 subRun: 1 event: 3992 at 10-Oct-2025 10:40:16 BST
Begin processing the 93rd record. run: 74553259 subRun: 1 event: 3993 at 10-Oct-2025 10:40:20 BST
Begin processing the 94th record. run: 74553259 subRun: 1 event: 3994 at 10-Oct-2025 10:40:25 BST
Begin processing the 95th record. run: 74553259 subRun: 1 event: 3995 at 10-Oct-2025 10:40:29 BST
Begin processing the 96th record. run: 74553259 subRun: 1 event: 3996 at 10-Oct-2025 10:41:20 BST
Begin processing the 97th record. run: 74553259 subRun: 1 event: 3997 at 10-Oct-2025 10:41:24 BST
Begin processing the 98th record. run: 74553259 subRun: 1 event: 3998 at 10-Oct-2025 10:41:29 BST
Begin processing the 99th record. run: 74553259 subRun: 1 event: 3999 at 10-Oct-2025 10:41:33 BST
Begin processing the 100th record. run: 74553259 subRun: 1 event: 4000 at 10-Oct-2025 10:41:45 BST
10-Oct-2025 10:41:50 BST  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74553259_39_20231207T130457Z_gen_g4_detsim_hitreco__20240510T063233Z_reco2_reco2.root"
10-Oct-2025 10:41:50 BST  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/d6/7c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74553259_39_20231207T130457Z_gen_g4_detsim_hitreco__20240510T063233Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      0.32209         19          1398.37       2.82583       138.971        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0134182     0.197509       7.28741      0.106216      0.716427        100    
reco:pandora:StandardPandora                   0.244269       18.7864       1397.98       2.66768       138.951        100    
[art]:TriggerResults:TriggerResultInserter    1.4843e-05    3.21337e-05   9.5915e-05    2.77055e-05   1.26533e-05      100    
end_path:out1:RootOutput                       3.035e-06    7.19597e-06   2.7602e-05     7.617e-06    3.07118e-06      100    
end_path:out1:RootOutput(write)               0.00164975     0.0157638     0.278689     0.00497529     0.0370959       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2401.49 MB
  Peak resident set size usage (VmHWM): 1412.77 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2025-11-05 05:23:17 UTC       justIN version: 01.05.01