justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264448.0@dunegpschedd01.fnal.gov

Jobsub ID264448.0@dunegpschedd01.fnal.gov
Workflow ID10995
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-12-06 16:40:12
SiteUS_PuertoRico
EntryCMS_T3_US_PuertoRico_UPRM
Last heartbeat2025-12-06 17:10:22
From worker nodeHostnamecompute-2-5.local
cpuinfoIntel(R) Xeon(R) CPU W3550 @ 3.07GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 16:41:25
Input filesfardet-hd:nu_dune10kt_1x2x6_1427_127_20230827T213331Z_gen_g4_detsim_hitreco__20240222T220118Z_reco2.root
JobscriptExit code0
Real time28m (1715s)
CPU time17m (1046s = 60%)
Max RSS bytes974987264 (929 MiB)
Outputting started2025-12-06 17:10:02
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/metrics_nu_0/fnal/10995/1/001/Validation_nu_dune10kt_1x2x6_1427_127_20230827T213331Z_gen_g4_detsim_hitreco__20240222T220118Z_reco2.root
Finished2025-12-06 17:10:22
Saved logsjustin-logs:264448.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

-- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/95/19/nu_dune10kt_1x2x6_1427_127_20230827T213331Z_gen_g4_detsim_hitreco__20240222T220118Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1427 subRun: 1 event: 12723 at 06-Dec-2025 12:54:04 AST
Begin processing the 24th record. run: 1427 subRun: 1 event: 12724 at 06-Dec-2025 12:54:12 AST
Begin processing the 25th record. run: 1427 subRun: 1 event: 12725 at 06-Dec-2025 12:54:19 AST
Begin processing the 26th record. run: 1427 subRun: 1 event: 12726 at 06-Dec-2025 12:54:27 AST
Begin processing the 27th record. run: 1427 subRun: 1 event: 12727 at 06-Dec-2025 12:54:37 AST
Begin processing the 28th record. run: 1427 subRun: 1 event: 12728 at 06-Dec-2025 12:54:45 AST
Begin processing the 29th record. run: 1427 subRun: 1 event: 12729 at 06-Dec-2025 12:54:51 AST
Begin processing the 30th record. run: 1427 subRun: 1 event: 12730 at 06-Dec-2025 12:55:00 AST
Begin processing the 31st record. run: 1427 subRun: 1 event: 12731 at 06-Dec-2025 12:55:06 AST
Begin processing the 32nd record. run: 1427 subRun: 1 event: 12732 at 06-Dec-2025 12:55:14 AST
Begin processing the 33rd record. run: 1427 subRun: 1 event: 12733 at 06-Dec-2025 12:55:23 AST
Begin processing the 34th record. run: 1427 subRun: 1 event: 12734 at 06-Dec-2025 12:55:31 AST
Begin processing the 35th record. run: 1427 subRun: 1 event: 12735 at 06-Dec-2025 12:55:37 AST
Begin processing the 36th record. run: 1427 subRun: 1 event: 12736 at 06-Dec-2025 12:55:45 AST
Begin processing the 37th record. run: 1427 subRun: 1 event: 12737 at 06-Dec-2025 12:55:51 AST
Begin processing the 38th record. run: 1427 subRun: 1 event: 12738 at 06-Dec-2025 12:59:00 AST
Begin processing the 39th record. run: 1427 subRun: 1 event: 12739 at 06-Dec-2025 12:59:08 AST
Begin processing the 40th record. run: 1427 subRun: 1 event: 12740 at 06-Dec-2025 12:59:16 AST
Begin processing the 41st record. run: 1427 subRun: 1 event: 12741 at 06-Dec-2025 12:59:24 AST
Begin processing the 42nd record. run: 1427 subRun: 1 event: 12742 at 06-Dec-2025 12:59:31 AST
Begin processing the 43rd record. run: 1427 subRun: 1 event: 12743 at 06-Dec-2025 12:59:37 AST
Begin processing the 44th record. run: 1427 subRun: 1 event: 12744 at 06-Dec-2025 12:59:44 AST
Begin processing the 45th record. run: 1427 subRun: 1 event: 12745 at 06-Dec-2025 12:59:51 AST
Begin processing the 46th record. run: 1427 subRun: 1 event: 12746 at 06-Dec-2025 12:59:59 AST
Begin processing the 47th record. run: 1427 subRun: 1 event: 12747 at 06-Dec-2025 13:00:07 AST
Begin processing the 48th record. run: 1427 subRun: 1 event: 12748 at 06-Dec-2025 13:00:16 AST
Begin processing the 49th record. run: 1427 subRun: 1 event: 12749 at 06-Dec-2025 13:00:24 AST
Begin processing the 50th record. run: 1427 subRun: 1 event: 12750 at 06-Dec-2025 13:00:32 AST
Begin processing the 51st record. run: 1427 subRun: 1 event: 12751 at 06-Dec-2025 13:00:43 AST
Begin processing the 52nd record. run: 1427 subRun: 1 event: 12752 at 06-Dec-2025 13:00:50 AST
Begin processing the 53rd record. run: 1427 subRun: 1 event: 12753 at 06-Dec-2025 13:00:57 AST
Begin processing the 54th record. run: 1427 subRun: 1 event: 12754 at 06-Dec-2025 13:01:04 AST
Begin processing the 55th record. run: 1427 subRun: 1 event: 12755 at 06-Dec-2025 13:01:11 AST
Begin processing the 56th record. run: 1427 subRun: 1 event: 12756 at 06-Dec-2025 13:01:18 AST
Begin processing the 57th record. run: 1427 subRun: 1 event: 12757 at 06-Dec-2025 13:01:25 AST
Begin processing the 58th record. run: 1427 subRun: 1 event: 12758 at 06-Dec-2025 13:01:33 AST
Begin processing the 59th record. run: 1427 subRun: 1 event: 12759 at 06-Dec-2025 13:01:41 AST
Begin processing the 60th record. run: 1427 subRun: 1 event: 12760 at 06-Dec-2025 13:01:48 AST
Begin processing the 61st record. run: 1427 subRun: 1 event: 12761 at 06-Dec-2025 13:01:56 AST
Begin processing the 62nd record. run: 1427 subRun: 1 event: 12762 at 06-Dec-2025 13:02:03 AST
Begin processing the 63rd record. run: 1427 subRun: 1 event: 12763 at 06-Dec-2025 13:02:10 AST
Begin processing the 64th record. run: 1427 subRun: 1 event: 12764 at 06-Dec-2025 13:02:17 AST
Begin processing the 65th record. run: 1427 subRun: 1 event: 12765 at 06-Dec-2025 13:02:24 AST
Begin processing the 66th record. run: 1427 subRun: 1 event: 12766 at 06-Dec-2025 13:02:33 AST
Begin processing the 67th record. run: 1427 subRun: 1 event: 12767 at 06-Dec-2025 13:02:41 AST
Begin processing the 68th record. run: 1427 subRun: 1 event: 12768 at 06-Dec-2025 13:02:49 AST
Begin processing the 69th record. run: 1427 subRun: 1 event: 12769 at 06-Dec-2025 13:02:58 AST
Begin processing the 70th record. run: 1427 subRun: 1 event: 12770 at 06-Dec-2025 13:03:59 AST
Begin processing the 71st record. run: 1427 subRun: 1 event: 12771 at 06-Dec-2025 13:04:06 AST
Begin processing the 72nd record. run: 1427 subRun: 1 event: 12772 at 06-Dec-2025 13:04:13 AST
Begin processing the 73rd record. run: 1427 subRun: 1 event: 12773 at 06-Dec-2025 13:04:20 AST
Begin processing the 74th record. run: 1427 subRun: 1 event: 12774 at 06-Dec-2025 13:04:28 AST
Begin processing the 75th record. run: 1427 subRun: 1 event: 12775 at 06-Dec-2025 13:04:36 AST
Begin processing the 76th record. run: 1427 subRun: 1 event: 12776 at 06-Dec-2025 13:04:43 AST
Begin processing the 77th record. run: 1427 subRun: 1 event: 12777 at 06-Dec-2025 13:04:49 AST
Begin processing the 78th record. run: 1427 subRun: 1 event: 12778 at 06-Dec-2025 13:05:06 AST
Begin processing the 79th record. run: 1427 subRun: 1 event: 12779 at 06-Dec-2025 13:05:15 AST
Begin processing the 80th record. run: 1427 subRun: 1 event: 12780 at 06-Dec-2025 13:06:01 AST
Begin processing the 81st record. run: 1427 subRun: 1 event: 12781 at 06-Dec-2025 13:06:08 AST
Begin processing the 82nd record. run: 1427 subRun: 1 event: 12782 at 06-Dec-2025 13:06:18 AST
Begin processing the 83rd record. run: 1427 subRun: 1 event: 12783 at 06-Dec-2025 13:06:25 AST
Begin processing the 84th record. run: 1427 subRun: 1 event: 12784 at 06-Dec-2025 13:06:32 AST
Begin processing the 85th record. run: 1427 subRun: 1 event: 12785 at 06-Dec-2025 13:06:39 AST
Begin processing the 86th record. run: 1427 subRun: 1 event: 12786 at 06-Dec-2025 13:06:46 AST
Begin processing the 87th record. run: 1427 subRun: 1 event: 12787 at 06-Dec-2025 13:06:53 AST
Begin processing the 88th record. run: 1427 subRun: 1 event: 12788 at 06-Dec-2025 13:07:01 AST
Begin processing the 89th record. run: 1427 subRun: 1 event: 12789 at 06-Dec-2025 13:07:08 AST
Begin processing the 90th record. run: 1427 subRun: 1 event: 12790 at 06-Dec-2025 13:08:26 AST
Begin processing the 91st record. run: 1427 subRun: 1 event: 12791 at 06-Dec-2025 13:08:38 AST
Begin processing the 92nd record. run: 1427 subRun: 1 event: 12792 at 06-Dec-2025 13:08:46 AST
Begin processing the 93rd record. run: 1427 subRun: 1 event: 12793 at 06-Dec-2025 13:08:53 AST
Begin processing the 94th record. run: 1427 subRun: 1 event: 12794 at 06-Dec-2025 13:09:00 AST
Begin processing the 95th record. run: 1427 subRun: 1 event: 12795 at 06-Dec-2025 13:09:07 AST
Begin processing the 96th record. run: 1427 subRun: 1 event: 12796 at 06-Dec-2025 13:09:14 AST
Begin processing the 97th record. run: 1427 subRun: 1 event: 12797 at 06-Dec-2025 13:09:21 AST
Begin processing the 98th record. run: 1427 subRun: 1 event: 12798 at 06-Dec-2025 13:09:28 AST
Begin processing the 99th record. run: 1427 subRun: 1 event: 12799 at 06-Dec-2025 13:09:35 AST
Begin processing the 100th record. run: 1427 subRun: 1 event: 12800 at 06-Dec-2025 13:09:51 AST
06-Dec-2025 13:10:00 AST  Closed output file "nu_dune10kt_1x2x6_1427_127_20230827T213331Z_gen_g4_detsim_hitreco__20240222T220118Z_reco2_reco2.root"
06-Dec-2025 13:10:00 AST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/95/19/nu_dune10kt_1x2x6_1427_127_20230827T213331Z_gen_g4_detsim_hitreco__20240222T220118Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      5.36628       10.0477       184.522       5.93406       20.035         100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0925854     0.154166       0.19207      0.153738      0.0100489       100    
reco:pandora:StandardPandora                    5.20456       9.86454       184.25        5.76248       20.0154        100    
[art]:TriggerResults:TriggerResultInserter    2.2762e-05    3.84363e-05   0.000108936   2.99745e-05   1.76465e-05      100    
end_path:out1:RootOutput                       3.339e-06    4.26515e-06   2.1707e-05    3.9025e-06    1.85463e-06      100    
end_path:out1:RootOutput(write)               0.00218654     0.0287414     0.163425      0.0164443     0.0330306       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2191.9 MB
  Peak resident set size usage (VmHWM): 974.987 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2025-12-19 08:50:46 UTC       justIN version: 01.05.03