justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 241413.107@dunegpschedd01.fnal.gov

Jobsub ID241413.107@dunegpschedd01.fnal.gov
Workflow ID9495
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-10-31 14:05:04
SiteUS_Michigan
EntryHCC_US_Michigan_gate02
Last heartbeat2025-10-31 14:27:28
From worker nodeHostnamec-211-27.aglt2.org
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit36000 (10 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-31 14:10:11
Input filesfardet-hd:nu_dune10kt_1x2x6_1098_21_20230826T012218Z_gen_g4_detsim_hitreco__20240229T174435Z_reco2.root
JobscriptExit code0
Real time16m (1004s)
CPU time14m (883s = 87%)
Max RSS bytes1318109184 (1257 MiB)
Outputting started2025-10-31 14:26:56
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/kalmanAlg_nu_0/fnal/09495/1/001/ClusterValidation_WithAlg_nu_dune10kt_1x2x6_1098_21_20230826T012218Z_gen_g4_detsim_hitreco__20240229T174435Z_reco2.root
Finished2025-10-31 14:27:28
Saved logsjustin-logs:241413.107-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

--- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/bc/3e/nu_dune10kt_1x2x6_1098_21_20230826T012218Z_gen_g4_detsim_hitreco__20240229T174435Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1098 subRun: 1 event: 2123 at 31-Oct-2025 10:15:33 EDT
Begin processing the 24th record. run: 1098 subRun: 1 event: 2124 at 31-Oct-2025 10:15:39 EDT
Begin processing the 25th record. run: 1098 subRun: 1 event: 2125 at 31-Oct-2025 10:15:44 EDT
Begin processing the 26th record. run: 1098 subRun: 1 event: 2126 at 31-Oct-2025 10:15:50 EDT
Begin processing the 27th record. run: 1098 subRun: 1 event: 2127 at 31-Oct-2025 10:15:56 EDT
Begin processing the 28th record. run: 1098 subRun: 1 event: 2128 at 31-Oct-2025 10:16:03 EDT
Begin processing the 29th record. run: 1098 subRun: 1 event: 2129 at 31-Oct-2025 10:16:19 EDT
Begin processing the 30th record. run: 1098 subRun: 1 event: 2130 at 31-Oct-2025 10:16:25 EDT
Begin processing the 31st record. run: 1098 subRun: 1 event: 2131 at 31-Oct-2025 10:16:32 EDT
Begin processing the 32nd record. run: 1098 subRun: 1 event: 2132 at 31-Oct-2025 10:16:41 EDT
Begin processing the 33rd record. run: 1098 subRun: 1 event: 2133 at 31-Oct-2025 10:16:50 EDT
Begin processing the 34th record. run: 1098 subRun: 1 event: 2134 at 31-Oct-2025 10:16:58 EDT
Begin processing the 35th record. run: 1098 subRun: 1 event: 2135 at 31-Oct-2025 10:17:05 EDT
Begin processing the 36th record. run: 1098 subRun: 1 event: 2136 at 31-Oct-2025 10:17:11 EDT
Begin processing the 37th record. run: 1098 subRun: 1 event: 2137 at 31-Oct-2025 10:17:18 EDT
Begin processing the 38th record. run: 1098 subRun: 1 event: 2138 at 31-Oct-2025 10:17:27 EDT
Begin processing the 39th record. run: 1098 subRun: 1 event: 2139 at 31-Oct-2025 10:17:34 EDT
Begin processing the 40th record. run: 1098 subRun: 1 event: 2140 at 31-Oct-2025 10:17:43 EDT
Begin processing the 41st record. run: 1098 subRun: 1 event: 2141 at 31-Oct-2025 10:17:50 EDT
Begin processing the 42nd record. run: 1098 subRun: 1 event: 2142 at 31-Oct-2025 10:17:57 EDT
Begin processing the 43rd record. run: 1098 subRun: 1 event: 2143 at 31-Oct-2025 10:18:06 EDT
Begin processing the 44th record. run: 1098 subRun: 1 event: 2144 at 31-Oct-2025 10:18:18 EDT
Begin processing the 45th record. run: 1098 subRun: 1 event: 2145 at 31-Oct-2025 10:18:25 EDT
Begin processing the 46th record. run: 1098 subRun: 1 event: 2146 at 31-Oct-2025 10:18:33 EDT
Begin processing the 47th record. run: 1098 subRun: 1 event: 2147 at 31-Oct-2025 10:18:39 EDT
Begin processing the 48th record. run: 1098 subRun: 1 event: 2148 at 31-Oct-2025 10:18:53 EDT
Begin processing the 49th record. run: 1098 subRun: 1 event: 2149 at 31-Oct-2025 10:19:05 EDT
Begin processing the 50th record. run: 1098 subRun: 1 event: 2150 at 31-Oct-2025 10:19:12 EDT
Begin processing the 51st record. run: 1098 subRun: 1 event: 2151 at 31-Oct-2025 10:19:22 EDT
Begin processing the 52nd record. run: 1098 subRun: 1 event: 2152 at 31-Oct-2025 10:19:37 EDT
Begin processing the 53rd record. run: 1098 subRun: 1 event: 2153 at 31-Oct-2025 10:19:46 EDT
Begin processing the 54th record. run: 1098 subRun: 1 event: 2154 at 31-Oct-2025 10:19:54 EDT
Begin processing the 55th record. run: 1098 subRun: 1 event: 2155 at 31-Oct-2025 10:20:03 EDT
Begin processing the 56th record. run: 1098 subRun: 1 event: 2156 at 31-Oct-2025 10:20:13 EDT
Begin processing the 57th record. run: 1098 subRun: 1 event: 2157 at 31-Oct-2025 10:20:20 EDT
Begin processing the 58th record. run: 1098 subRun: 1 event: 2158 at 31-Oct-2025 10:20:30 EDT
Begin processing the 59th record. run: 1098 subRun: 1 event: 2159 at 31-Oct-2025 10:20:43 EDT
Begin processing the 60th record. run: 1098 subRun: 1 event: 2160 at 31-Oct-2025 10:20:50 EDT
Begin processing the 61st record. run: 1098 subRun: 1 event: 2161 at 31-Oct-2025 10:21:03 EDT
Begin processing the 62nd record. run: 1098 subRun: 1 event: 2162 at 31-Oct-2025 10:21:11 EDT
Begin processing the 63rd record. run: 1098 subRun: 1 event: 2163 at 31-Oct-2025 10:21:17 EDT
Begin processing the 64th record. run: 1098 subRun: 1 event: 2164 at 31-Oct-2025 10:21:25 EDT
Begin processing the 65th record. run: 1098 subRun: 1 event: 2165 at 31-Oct-2025 10:21:32 EDT
Begin processing the 66th record. run: 1098 subRun: 1 event: 2166 at 31-Oct-2025 10:21:38 EDT
Begin processing the 67th record. run: 1098 subRun: 1 event: 2167 at 31-Oct-2025 10:21:45 EDT
Begin processing the 68th record. run: 1098 subRun: 1 event: 2168 at 31-Oct-2025 10:21:51 EDT
Begin processing the 69th record. run: 1098 subRun: 1 event: 2169 at 31-Oct-2025 10:22:00 EDT
Begin processing the 70th record. run: 1098 subRun: 1 event: 2170 at 31-Oct-2025 10:22:06 EDT
Begin processing the 71st record. run: 1098 subRun: 1 event: 2171 at 31-Oct-2025 10:22:12 EDT
Begin processing the 72nd record. run: 1098 subRun: 1 event: 2172 at 31-Oct-2025 10:22:22 EDT
Begin processing the 73rd record. run: 1098 subRun: 1 event: 2173 at 31-Oct-2025 10:22:28 EDT
Begin processing the 74th record. run: 1098 subRun: 1 event: 2174 at 31-Oct-2025 10:22:47 EDT
Begin processing the 75th record. run: 1098 subRun: 1 event: 2175 at 31-Oct-2025 10:22:53 EDT
Begin processing the 76th record. run: 1098 subRun: 1 event: 2176 at 31-Oct-2025 10:23:05 EDT
Begin processing the 77th record. run: 1098 subRun: 1 event: 2177 at 31-Oct-2025 10:23:13 EDT
Begin processing the 78th record. run: 1098 subRun: 1 event: 2178 at 31-Oct-2025 10:23:28 EDT
Begin processing the 79th record. run: 1098 subRun: 1 event: 2179 at 31-Oct-2025 10:23:43 EDT
Begin processing the 80th record. run: 1098 subRun: 1 event: 2180 at 31-Oct-2025 10:23:51 EDT
Begin processing the 81st record. run: 1098 subRun: 1 event: 2181 at 31-Oct-2025 10:23:58 EDT
Begin processing the 82nd record. run: 1098 subRun: 1 event: 2182 at 31-Oct-2025 10:24:06 EDT
Begin processing the 83rd record. run: 1098 subRun: 1 event: 2183 at 31-Oct-2025 10:24:27 EDT
Begin processing the 84th record. run: 1098 subRun: 1 event: 2184 at 31-Oct-2025 10:24:38 EDT
Begin processing the 85th record. run: 1098 subRun: 1 event: 2185 at 31-Oct-2025 10:24:45 EDT
Begin processing the 86th record. run: 1098 subRun: 1 event: 2186 at 31-Oct-2025 10:24:53 EDT
Begin processing the 87th record. run: 1098 subRun: 1 event: 2187 at 31-Oct-2025 10:25:02 EDT
Begin processing the 88th record. run: 1098 subRun: 1 event: 2188 at 31-Oct-2025 10:25:09 EDT
Begin processing the 89th record. run: 1098 subRun: 1 event: 2189 at 31-Oct-2025 10:25:17 EDT
Begin processing the 90th record. run: 1098 subRun: 1 event: 2190 at 31-Oct-2025 10:25:25 EDT
Begin processing the 91st record. run: 1098 subRun: 1 event: 2191 at 31-Oct-2025 10:25:36 EDT
Begin processing the 92nd record. run: 1098 subRun: 1 event: 2192 at 31-Oct-2025 10:25:43 EDT
Begin processing the 93rd record. run: 1098 subRun: 1 event: 2193 at 31-Oct-2025 10:25:50 EDT
Begin processing the 94th record. run: 1098 subRun: 1 event: 2194 at 31-Oct-2025 10:25:57 EDT
Begin processing the 95th record. run: 1098 subRun: 1 event: 2195 at 31-Oct-2025 10:26:05 EDT
Begin processing the 96th record. run: 1098 subRun: 1 event: 2196 at 31-Oct-2025 10:26:13 EDT
Begin processing the 97th record. run: 1098 subRun: 1 event: 2197 at 31-Oct-2025 10:26:21 EDT
Begin processing the 98th record. run: 1098 subRun: 1 event: 2198 at 31-Oct-2025 10:26:29 EDT
Begin processing the 99th record. run: 1098 subRun: 1 event: 2199 at 31-Oct-2025 10:26:36 EDT
Begin processing the 100th record. run: 1098 subRun: 1 event: 2200 at 31-Oct-2025 10:26:46 EDT
31-Oct-2025 10:26:54 EDT  Closed output file "nu_dune10kt_1x2x6_1098_21_20230826T012218Z_gen_g4_detsim_hitreco__20240229T174435Z_reco2_reco2.root"
31-Oct-2025 10:26:54 EDT  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/bc/3e/nu_dune10kt_1x2x6_1098_21_20230826T012218Z_gen_g4_detsim_hitreco__20240229T174435Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      5.25239       8.25389       19.6649       6.96735       2.92694        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0197938     0.0582237     0.811428      0.0420877     0.101102        100    
reco:pandora:StandardPandora                    5.17387       8.17194       19.556        6.91386       2.91798        100    
[art]:TriggerResults:TriggerResultInserter     2.289e-05    4.58455e-05   0.000153807    4.178e-05    1.59739e-05      100    
end_path:out1:RootOutput                       3.377e-06    1.07803e-05   0.000210089   8.7455e-06    2.05733e-05      100    
end_path:out1:RootOutput(write)                0.0025683     0.0232833     0.0615752     0.0183924     0.0164887       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2298.89 MB
  Peak resident set size usage (VmHWM): 1318.11 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
mv: cannot stat 'ClusterValidation_WithoutAlg.root': No such file or directory
justIN time: 2025-11-03 18:48:34 UTC       justIN version: 01.05.01