justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 248915.0@dunegpschedd01.fnal.gov

Jobsub ID248915.0@dunegpschedd01.fnal.gov
Workflow ID9976
Stage ID1
User nameemvilla@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-11-13 17:37:36
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw7
Last heartbeat2025-11-13 22:20:03
From worker nodeHostnamemh-7662-9.t2.ucsd.edu
cpuinfoAMD EPYC 7662 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-13 17:38:14
Input filesfardet-hd:prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T060953Z_gen_000044_supernova_g4_detsim.root
JobscriptExit code0
Real time4h (16489s)
CPU time5m (317s = 1%)
Max RSS bytes770506752 (734 MiB)
Outputting started2025-11-13 22:13:04
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/emvilla/production/fnal/09976/1/001/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T060953Z_gen_000044_supernova_g4_detsim_ana_2025-11-13T_173822Z_tpstream.root
Finished2025-11-13 22:20:03
Saved logsjustin-logs:248915.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0x3ae24430
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0x3ae36720
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
13-Nov-2025 09:38:49 PST  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/b9/b2/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T060953Z_gen_000044_supernova_g4_detsim.root"
13-Nov-2025 09:38:52 PST  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/b9/b2/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T060953Z_gen_000044_supernova_g4_detsim.root"
Begin processing the 1st record. run: 8145 subRun: 0 event: 2151 at 13-Nov-2025 09:38:55 PST
Creating new TTree for tpmakerTPC::TriggerAnaTree1x2x2
13-Nov-2025 09:41:45 PST  Opened output file with pattern "triggerAnaTree.root"
Begin processing the 2nd record. run: 8145 subRun: 0 event: 2152 at 13-Nov-2025 11:57:30 PST
Begin processing the 3rd record. run: 8145 subRun: 0 event: 2153 at 13-Nov-2025 12:00:19 PST
Begin processing the 4th record. run: 8145 subRun: 0 event: 2154 at 13-Nov-2025 12:03:01 PST
Begin processing the 5th record. run: 8145 subRun: 0 event: 2155 at 13-Nov-2025 12:05:47 PST
Begin processing the 6th record. run: 8145 subRun: 0 event: 2156 at 13-Nov-2025 12:08:39 PST
Begin processing the 7th record. run: 8145 subRun: 0 event: 2157 at 13-Nov-2025 12:11:28 PST
Begin processing the 8th record. run: 8145 subRun: 0 event: 2158 at 13-Nov-2025 12:14:26 PST
Begin processing the 9th record. run: 8145 subRun: 0 event: 2159 at 13-Nov-2025 12:17:11 PST
Begin processing the 10th record. run: 8145 subRun: 0 event: 2160 at 13-Nov-2025 12:19:56 PST
Begin processing the 11th record. run: 8145 subRun: 0 event: 2161 at 13-Nov-2025 12:22:33 PST
Begin processing the 12th record. run: 8145 subRun: 0 event: 2162 at 13-Nov-2025 12:25:10 PST
Begin processing the 13th record. run: 8145 subRun: 0 event: 2163 at 13-Nov-2025 12:27:57 PST
Begin processing the 14th record. run: 8145 subRun: 0 event: 2164 at 13-Nov-2025 12:30:43 PST
Begin processing the 15th record. run: 8145 subRun: 0 event: 2165 at 13-Nov-2025 12:33:36 PST
Begin processing the 16th record. run: 8145 subRun: 0 event: 2166 at 13-Nov-2025 12:36:17 PST
Begin processing the 17th record. run: 8145 subRun: 0 event: 2167 at 13-Nov-2025 12:38:59 PST
Begin processing the 18th record. run: 8145 subRun: 0 event: 2168 at 13-Nov-2025 12:41:46 PST
Begin processing the 19th record. run: 8145 subRun: 0 event: 2169 at 13-Nov-2025 12:44:26 PST
Begin processing the 20th record. run: 8145 subRun: 0 event: 2170 at 13-Nov-2025 12:47:17 PST
Begin processing the 21st record. run: 8145 subRun: 0 event: 2171 at 13-Nov-2025 12:50:10 PST
Begin processing the 22nd record. run: 8145 subRun: 0 event: 2172 at 13-Nov-2025 12:52:47 PST
Begin processing the 23rd record. run: 8145 subRun: 0 event: 2173 at 13-Nov-2025 12:55:34 PST
Begin processing the 24th record. run: 8145 subRun: 0 event: 2174 at 13-Nov-2025 12:58:15 PST
Begin processing the 25th record. run: 8145 subRun: 0 event: 2175 at 13-Nov-2025 13:01:00 PST
Begin processing the 26th record. run: 8145 subRun: 0 event: 2176 at 13-Nov-2025 13:03:50 PST
Begin processing the 27th record. run: 8145 subRun: 0 event: 2177 at 13-Nov-2025 13:06:37 PST
Begin processing the 28th record. run: 8145 subRun: 0 event: 2178 at 13-Nov-2025 13:09:27 PST
Begin processing the 29th record. run: 8145 subRun: 0 event: 2179 at 13-Nov-2025 13:12:11 PST
Begin processing the 30th record. run: 8145 subRun: 0 event: 2180 at 13-Nov-2025 13:14:54 PST
Begin processing the 31st record. run: 8145 subRun: 0 event: 2181 at 13-Nov-2025 13:17:45 PST
Begin processing the 32nd record. run: 8145 subRun: 0 event: 2182 at 13-Nov-2025 13:20:30 PST
Begin processing the 33rd record. run: 8145 subRun: 0 event: 2183 at 13-Nov-2025 13:23:15 PST
Begin processing the 34th record. run: 8145 subRun: 0 event: 2184 at 13-Nov-2025 13:25:59 PST
Begin processing the 35th record. run: 8145 subRun: 0 event: 2185 at 13-Nov-2025 13:28:52 PST
Begin processing the 36th record. run: 8145 subRun: 0 event: 2186 at 13-Nov-2025 13:31:39 PST
Begin processing the 37th record. run: 8145 subRun: 0 event: 2187 at 13-Nov-2025 13:34:23 PST
Begin processing the 38th record. run: 8145 subRun: 0 event: 2188 at 13-Nov-2025 13:37:08 PST
Begin processing the 39th record. run: 8145 subRun: 0 event: 2189 at 13-Nov-2025 13:39:56 PST
Begin processing the 40th record. run: 8145 subRun: 0 event: 2190 at 13-Nov-2025 13:42:40 PST
Begin processing the 41st record. run: 8145 subRun: 0 event: 2191 at 13-Nov-2025 13:45:18 PST
Begin processing the 42nd record. run: 8145 subRun: 0 event: 2192 at 13-Nov-2025 13:48:17 PST
Begin processing the 43rd record. run: 8145 subRun: 0 event: 2193 at 13-Nov-2025 13:51:06 PST
Begin processing the 44th record. run: 8145 subRun: 0 event: 2194 at 13-Nov-2025 13:53:52 PST
Begin processing the 45th record. run: 8145 subRun: 0 event: 2195 at 13-Nov-2025 13:56:38 PST
Begin processing the 46th record. run: 8145 subRun: 0 event: 2196 at 13-Nov-2025 13:59:18 PST
Begin processing the 47th record. run: 8145 subRun: 0 event: 2197 at 13-Nov-2025 14:02:03 PST
Begin processing the 48th record. run: 8145 subRun: 0 event: 2198 at 13-Nov-2025 14:04:50 PST
Begin processing the 49th record. run: 8145 subRun: 0 event: 2199 at 13-Nov-2025 14:07:38 PST
Begin processing the 50th record. run: 8145 subRun: 0 event: 2200 at 13-Nov-2025 14:10:19 PST
13-Nov-2025 14:13:03 PST  Closed output file "triggerAnaTree.root"
13-Nov-2025 14:13:03 PST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/b9/b2/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T060953Z_gen_000044_supernova_g4_detsim.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      155.641       165.288       177.647       164.669       4.79786        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000307738   0.00696616     0.0775055    0.000744168    0.0181716       50     
makers:tpmakerTPC:TriggerPrimitiveMakerTPC      155.488       165.121       177.485       164.477       4.79928        50     
[art]:TriggerResults:TriggerResultInserter     1.454e-05    2.2307e-05    7.6742e-05    2.13405e-05   8.39754e-06      50     
end_path:out1:RootOutput                       3.191e-06    4.6165e-06    2.4891e-05     4.12e-06     3.06619e-06      50     
end_path:triggerAnaDumpTPs:TriggerAnaTree       0.14796      0.157142      0.224805      0.151479      0.0162396       50     
end_path:out1:RootOutput(write)               0.00139228    0.00181465    0.00611123    0.00160526    0.000850412      50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1540.63 MB
  Peak resident set size usage (VmHWM): 770.507 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
.:
total 2957576
-rw-r--r--. 1 cuser cuser 3026974242 Nov 13 14:13 triggerAnaTree.root
-rw-r--r--. 1 cuser cuser    1367724 Nov 13 14:13 prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T060953Z_gen_000044_supernova_g4_detsim_ana_2025-11-13T_173822Z_tpstream.root
-rw-r--r--. 1 cuser cuser     139264 Nov 13 14:13 mem.db
-rw-r--r--. 1 cuser cuser      32768 Nov 13 14:13 time.db
-rw-r--r--. 1 cuser cuser      12473 Nov 13 14:13 prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T060953Z_gen_000044_supernova_g4_detsim_reco_2025-11-13T_173822Z.log
-rw-r--r--. 1 cuser cuser       9565 Nov 13 14:13 jobscript.log
-rw-r--r--. 1 cuser cuser        180 Nov 13 14:13 justin-processed-pfns.txt
-rw-r--r--. 1 cuser cuser        101 Nov 13 09:38 all-input-dids.txt
-rw-r--r--. 1 cuser cuser          0 Nov 13 09:38 debugprod.log
justIN time: 2026-02-10 04:38:53 UTC       justIN version: 01.06.00