justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 241418.8@dunegpschedd01.fnal.gov

Jobsub ID241418.8@dunegpschedd01.fnal.gov
Workflow ID9495
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-10-31 14:25:04
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-10-31 14:31:07
From worker nodeHostnamedunegli-7433130-0-fnpc22007.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-31 14:25:20
Input filesfardet-hd:nu_dune10kt_1x2x6_1098_639_20230826T013307Z_gen_g4_detsim_hitreco__20240229T184624Z_reco2.root
JobscriptExit code0
Real time5m (338s)
CPU time5m (327s = 96%)
Max RSS bytes1586892800 (1513 MiB)
Outputting started2025-10-31 14:30:59
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/kalmanAlg_nu_0/fnal/09495/1/001/ClusterValidation_WithAlg_nu_dune10kt_1x2x6_1098_639_20230826T013307Z_gen_g4_detsim_hitreco__20240229T184624Z_reco2.root
Finished2025-10-31 14:31:07
Saved logsjustin-logs:241418.8-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

--------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/2f/c6/nu_dune10kt_1x2x6_1098_639_20230826T013307Z_gen_g4_detsim_hitreco__20240229T184624Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1098 subRun: 1 event: 63923 at 31-Oct-2025 14:28:13 UTC
Begin processing the 24th record. run: 1098 subRun: 1 event: 63924 at 31-Oct-2025 14:28:15 UTC
Begin processing the 25th record. run: 1098 subRun: 1 event: 63925 at 31-Oct-2025 14:28:17 UTC
Begin processing the 26th record. run: 1098 subRun: 1 event: 63926 at 31-Oct-2025 14:28:18 UTC
Begin processing the 27th record. run: 1098 subRun: 1 event: 63927 at 31-Oct-2025 14:28:19 UTC
Begin processing the 28th record. run: 1098 subRun: 1 event: 63928 at 31-Oct-2025 14:28:25 UTC
Begin processing the 29th record. run: 1098 subRun: 1 event: 63929 at 31-Oct-2025 14:28:27 UTC
Begin processing the 30th record. run: 1098 subRun: 1 event: 63930 at 31-Oct-2025 14:28:31 UTC
Begin processing the 31st record. run: 1098 subRun: 1 event: 63931 at 31-Oct-2025 14:28:33 UTC
Begin processing the 32nd record. run: 1098 subRun: 1 event: 63932 at 31-Oct-2025 14:28:34 UTC
Begin processing the 33rd record. run: 1098 subRun: 1 event: 63933 at 31-Oct-2025 14:28:36 UTC
Begin processing the 34th record. run: 1098 subRun: 1 event: 63934 at 31-Oct-2025 14:28:37 UTC
Begin processing the 35th record. run: 1098 subRun: 1 event: 63935 at 31-Oct-2025 14:28:38 UTC
Begin processing the 36th record. run: 1098 subRun: 1 event: 63936 at 31-Oct-2025 14:28:39 UTC
Begin processing the 37th record. run: 1098 subRun: 1 event: 63937 at 31-Oct-2025 14:28:41 UTC
Begin processing the 38th record. run: 1098 subRun: 1 event: 63938 at 31-Oct-2025 14:28:43 UTC
Begin processing the 39th record. run: 1098 subRun: 1 event: 63939 at 31-Oct-2025 14:28:46 UTC
Begin processing the 40th record. run: 1098 subRun: 1 event: 63940 at 31-Oct-2025 14:28:47 UTC
Begin processing the 41st record. run: 1098 subRun: 1 event: 63941 at 31-Oct-2025 14:28:49 UTC
Begin processing the 42nd record. run: 1098 subRun: 1 event: 63942 at 31-Oct-2025 14:28:50 UTC
Begin processing the 43rd record. run: 1098 subRun: 1 event: 63943 at 31-Oct-2025 14:29:13 UTC
Begin processing the 44th record. run: 1098 subRun: 1 event: 63944 at 31-Oct-2025 14:29:15 UTC
Begin processing the 45th record. run: 1098 subRun: 1 event: 63945 at 31-Oct-2025 14:29:16 UTC
Begin processing the 46th record. run: 1098 subRun: 1 event: 63946 at 31-Oct-2025 14:29:18 UTC
Begin processing the 47th record. run: 1098 subRun: 1 event: 63947 at 31-Oct-2025 14:29:19 UTC
Begin processing the 48th record. run: 1098 subRun: 1 event: 63948 at 31-Oct-2025 14:29:21 UTC
Begin processing the 49th record. run: 1098 subRun: 1 event: 63949 at 31-Oct-2025 14:29:30 UTC
Begin processing the 50th record. run: 1098 subRun: 1 event: 63950 at 31-Oct-2025 14:29:32 UTC
Begin processing the 51st record. run: 1098 subRun: 1 event: 63951 at 31-Oct-2025 14:29:34 UTC
Begin processing the 52nd record. run: 1098 subRun: 1 event: 63952 at 31-Oct-2025 14:29:35 UTC
Begin processing the 53rd record. run: 1098 subRun: 1 event: 63953 at 31-Oct-2025 14:29:36 UTC
Begin processing the 54th record. run: 1098 subRun: 1 event: 63954 at 31-Oct-2025 14:29:37 UTC
Begin processing the 55th record. run: 1098 subRun: 1 event: 63955 at 31-Oct-2025 14:29:39 UTC
Begin processing the 56th record. run: 1098 subRun: 1 event: 63956 at 31-Oct-2025 14:29:40 UTC
Begin processing the 57th record. run: 1098 subRun: 1 event: 63957 at 31-Oct-2025 14:29:42 UTC
Begin processing the 58th record. run: 1098 subRun: 1 event: 63958 at 31-Oct-2025 14:29:43 UTC
Begin processing the 59th record. run: 1098 subRun: 1 event: 63959 at 31-Oct-2025 14:29:44 UTC
Begin processing the 60th record. run: 1098 subRun: 1 event: 63960 at 31-Oct-2025 14:29:46 UTC
Begin processing the 61st record. run: 1098 subRun: 1 event: 63961 at 31-Oct-2025 14:29:49 UTC
Begin processing the 62nd record. run: 1098 subRun: 1 event: 63962 at 31-Oct-2025 14:29:51 UTC
Begin processing the 63rd record. run: 1098 subRun: 1 event: 63963 at 31-Oct-2025 14:29:52 UTC
Begin processing the 64th record. run: 1098 subRun: 1 event: 63964 at 31-Oct-2025 14:29:54 UTC
Begin processing the 65th record. run: 1098 subRun: 1 event: 63965 at 31-Oct-2025 14:29:55 UTC
Begin processing the 66th record. run: 1098 subRun: 1 event: 63966 at 31-Oct-2025 14:29:57 UTC
Begin processing the 67th record. run: 1098 subRun: 1 event: 63967 at 31-Oct-2025 14:29:59 UTC
Begin processing the 68th record. run: 1098 subRun: 1 event: 63968 at 31-Oct-2025 14:30:00 UTC
Begin processing the 69th record. run: 1098 subRun: 1 event: 63969 at 31-Oct-2025 14:30:02 UTC
Begin processing the 70th record. run: 1098 subRun: 1 event: 63970 at 31-Oct-2025 14:30:03 UTC
Begin processing the 71st record. run: 1098 subRun: 1 event: 63971 at 31-Oct-2025 14:30:05 UTC
Begin processing the 72nd record. run: 1098 subRun: 1 event: 63972 at 31-Oct-2025 14:30:07 UTC
Begin processing the 73rd record. run: 1098 subRun: 1 event: 63973 at 31-Oct-2025 14:30:10 UTC
Begin processing the 74th record. run: 1098 subRun: 1 event: 63974 at 31-Oct-2025 14:30:11 UTC
Begin processing the 75th record. run: 1098 subRun: 1 event: 63975 at 31-Oct-2025 14:30:13 UTC
Begin processing the 76th record. run: 1098 subRun: 1 event: 63976 at 31-Oct-2025 14:30:14 UTC
Begin processing the 77th record. run: 1098 subRun: 1 event: 63977 at 31-Oct-2025 14:30:16 UTC
Begin processing the 78th record. run: 1098 subRun: 1 event: 63978 at 31-Oct-2025 14:30:19 UTC
Begin processing the 79th record. run: 1098 subRun: 1 event: 63979 at 31-Oct-2025 14:30:20 UTC
Begin processing the 80th record. run: 1098 subRun: 1 event: 63980 at 31-Oct-2025 14:30:22 UTC
Begin processing the 81st record. run: 1098 subRun: 1 event: 63981 at 31-Oct-2025 14:30:23 UTC
Begin processing the 82nd record. run: 1098 subRun: 1 event: 63982 at 31-Oct-2025 14:30:25 UTC
Begin processing the 83rd record. run: 1098 subRun: 1 event: 63983 at 31-Oct-2025 14:30:26 UTC
Begin processing the 84th record. run: 1098 subRun: 1 event: 63984 at 31-Oct-2025 14:30:27 UTC
Begin processing the 85th record. run: 1098 subRun: 1 event: 63985 at 31-Oct-2025 14:30:29 UTC
Begin processing the 86th record. run: 1098 subRun: 1 event: 63986 at 31-Oct-2025 14:30:30 UTC
Begin processing the 87th record. run: 1098 subRun: 1 event: 63987 at 31-Oct-2025 14:30:32 UTC
Begin processing the 88th record. run: 1098 subRun: 1 event: 63988 at 31-Oct-2025 14:30:33 UTC
Begin processing the 89th record. run: 1098 subRun: 1 event: 63989 at 31-Oct-2025 14:30:35 UTC
Begin processing the 90th record. run: 1098 subRun: 1 event: 63990 at 31-Oct-2025 14:30:37 UTC
Begin processing the 91st record. run: 1098 subRun: 1 event: 63991 at 31-Oct-2025 14:30:38 UTC
Begin processing the 92nd record. run: 1098 subRun: 1 event: 63992 at 31-Oct-2025 14:30:40 UTC
Begin processing the 93rd record. run: 1098 subRun: 1 event: 63993 at 31-Oct-2025 14:30:41 UTC
Begin processing the 94th record. run: 1098 subRun: 1 event: 63994 at 31-Oct-2025 14:30:43 UTC
Begin processing the 95th record. run: 1098 subRun: 1 event: 63995 at 31-Oct-2025 14:30:50 UTC
Begin processing the 96th record. run: 1098 subRun: 1 event: 63996 at 31-Oct-2025 14:30:51 UTC
Begin processing the 97th record. run: 1098 subRun: 1 event: 63997 at 31-Oct-2025 14:30:53 UTC
Begin processing the 98th record. run: 1098 subRun: 1 event: 63998 at 31-Oct-2025 14:30:54 UTC
Begin processing the 99th record. run: 1098 subRun: 1 event: 63999 at 31-Oct-2025 14:30:55 UTC
Begin processing the 100th record. run: 1098 subRun: 1 event: 64000 at 31-Oct-2025 14:30:57 UTC
31-Oct-2025 14:30:58 UTC  Closed output file "nu_dune10kt_1x2x6_1098_639_20230826T013307Z_gen_g4_detsim_hitreco__20240229T184624Z_reco2_reco2.root"
31-Oct-2025 14:30:58 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/2f/c6/nu_dune10kt_1x2x6_1098_639_20230826T013307Z_gen_g4_detsim_hitreco__20240229T184624Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.16811       2.98555       91.347        1.40666       9.20277        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00076701    0.00918044     0.0510317    0.00822012    0.00913405       100    
reco:pandora:StandardPandora                    1.15276       2.96997       91.2768       1.39103       9.19596        100    
[art]:TriggerResults:TriggerResultInserter     9.939e-06    1.56317e-05    4.765e-05    1.3451e-05    6.7397e-06       100    
end_path:out1:RootOutput                       2.765e-06    4.27114e-06   1.6722e-05     4.233e-06    1.64464e-06      100    
end_path:out1:RootOutput(write)               0.000770617   0.00620738     0.0674861    0.00381601     0.0081724       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2572.55 MB
  Peak resident set size usage (VmHWM): 1586.89 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
mv: cannot stat 'ClusterValidation_WithoutAlg.root': No such file or directory
justIN time: 2025-11-03 18:40:36 UTC       justIN version: 01.05.01