justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 292717.37@dunegpschedd02.fnal.gov

Jobsub ID292717.37@dunegpschedd02.fnal.gov
Workflow ID12158
Stage ID1
User nameimawby@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-01-21 10:00:38
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2026-01-21 11:25:18
From worker nodeHostnamemh-7763-15.t2.ucsd.edu
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-21 10:05:44
Input filesfardet-hd:nue_dune10kt_1x2x6_1063_806_20230823T132427Z_gen_g4_detsim_hitreco__20240221T055602Z_reco2.root
JobscriptExit code0
Real time1h (4752s)
CPU time9m (554s = 11%)
Max RSS bytes1380392960 (1316 MiB)
Outputting started2026-01-21 11:24:57
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/metrics_nue_2/fnal/12158/1/001/Validation_nue_dune10kt_1x2x6_1063_806_20230823T132427Z_gen_g4_detsim_hitreco__20240221T055602Z_reco2.root
Finished2026-01-21 11:25:18
Saved logsjustin-logs:292717.37-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

his block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/93/26/nue_dune10kt_1x2x6_1063_806_20230823T132427Z_gen_g4_detsim_hitreco__20240221T055602Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1063 subRun: 1 event: 80623 at 21-Jan-2026 02:56:32 PST
Begin processing the 24th record. run: 1063 subRun: 1 event: 80624 at 21-Jan-2026 02:56:38 PST
Begin processing the 25th record. run: 1063 subRun: 1 event: 80625 at 21-Jan-2026 02:57:05 PST
Begin processing the 26th record. run: 1063 subRun: 1 event: 80626 at 21-Jan-2026 02:57:09 PST
Begin processing the 27th record. run: 1063 subRun: 1 event: 80627 at 21-Jan-2026 02:57:13 PST
Begin processing the 28th record. run: 1063 subRun: 1 event: 80628 at 21-Jan-2026 02:58:20 PST
Begin processing the 29th record. run: 1063 subRun: 1 event: 80629 at 21-Jan-2026 02:58:25 PST
Begin processing the 30th record. run: 1063 subRun: 1 event: 80630 at 21-Jan-2026 02:58:36 PST
Begin processing the 31st record. run: 1063 subRun: 1 event: 80631 at 21-Jan-2026 02:58:42 PST
Begin processing the 32nd record. run: 1063 subRun: 1 event: 80632 at 21-Jan-2026 02:59:01 PST
Begin processing the 33rd record. run: 1063 subRun: 1 event: 80633 at 21-Jan-2026 02:59:04 PST
Begin processing the 34th record. run: 1063 subRun: 1 event: 80634 at 21-Jan-2026 02:59:31 PST
Begin processing the 35th record. run: 1063 subRun: 1 event: 80635 at 21-Jan-2026 03:00:44 PST
Begin processing the 36th record. run: 1063 subRun: 1 event: 80636 at 21-Jan-2026 03:01:02 PST
Begin processing the 37th record. run: 1063 subRun: 1 event: 80637 at 21-Jan-2026 03:01:17 PST
Begin processing the 38th record. run: 1063 subRun: 1 event: 80638 at 21-Jan-2026 03:01:32 PST
Begin processing the 39th record. run: 1063 subRun: 1 event: 80639 at 21-Jan-2026 03:03:31 PST
Begin processing the 40th record. run: 1063 subRun: 1 event: 80640 at 21-Jan-2026 03:03:35 PST
Begin processing the 41st record. run: 1063 subRun: 1 event: 80641 at 21-Jan-2026 03:03:39 PST
Begin processing the 42nd record. run: 1063 subRun: 1 event: 80642 at 21-Jan-2026 03:03:53 PST
Begin processing the 43rd record. run: 1063 subRun: 1 event: 80643 at 21-Jan-2026 03:04:11 PST
Begin processing the 44th record. run: 1063 subRun: 1 event: 80644 at 21-Jan-2026 03:04:19 PST
Begin processing the 45th record. run: 1063 subRun: 1 event: 80645 at 21-Jan-2026 03:04:49 PST
Begin processing the 46th record. run: 1063 subRun: 1 event: 80646 at 21-Jan-2026 03:04:58 PST
Begin processing the 47th record. run: 1063 subRun: 1 event: 80647 at 21-Jan-2026 03:06:10 PST
Begin processing the 48th record. run: 1063 subRun: 1 event: 80648 at 21-Jan-2026 03:06:15 PST
Begin processing the 49th record. run: 1063 subRun: 1 event: 80649 at 21-Jan-2026 03:06:47 PST
Begin processing the 50th record. run: 1063 subRun: 1 event: 80650 at 21-Jan-2026 03:06:57 PST
Begin processing the 51st record. run: 1063 subRun: 1 event: 80651 at 21-Jan-2026 03:07:04 PST
Begin processing the 52nd record. run: 1063 subRun: 1 event: 80652 at 21-Jan-2026 03:07:12 PST
Begin processing the 53rd record. run: 1063 subRun: 1 event: 80653 at 21-Jan-2026 03:07:18 PST
Begin processing the 54th record. run: 1063 subRun: 1 event: 80654 at 21-Jan-2026 03:07:32 PST
Begin processing the 55th record. run: 1063 subRun: 1 event: 80655 at 21-Jan-2026 03:07:51 PST
Begin processing the 56th record. run: 1063 subRun: 1 event: 80656 at 21-Jan-2026 03:08:01 PST
Begin processing the 57th record. run: 1063 subRun: 1 event: 80657 at 21-Jan-2026 03:08:07 PST
Begin processing the 58th record. run: 1063 subRun: 1 event: 80658 at 21-Jan-2026 03:08:14 PST
Begin processing the 59th record. run: 1063 subRun: 1 event: 80659 at 21-Jan-2026 03:08:22 PST
Begin processing the 60th record. run: 1063 subRun: 1 event: 80660 at 21-Jan-2026 03:08:33 PST
Begin processing the 61st record. run: 1063 subRun: 1 event: 80661 at 21-Jan-2026 03:08:38 PST
Begin processing the 62nd record. run: 1063 subRun: 1 event: 80662 at 21-Jan-2026 03:08:45 PST
Begin processing the 63rd record. run: 1063 subRun: 1 event: 80663 at 21-Jan-2026 03:08:56 PST
Begin processing the 64th record. run: 1063 subRun: 1 event: 80664 at 21-Jan-2026 03:09:32 PST
Begin processing the 65th record. run: 1063 subRun: 1 event: 80665 at 21-Jan-2026 03:09:52 PST
Begin processing the 66th record. run: 1063 subRun: 1 event: 80666 at 21-Jan-2026 03:10:04 PST
Begin processing the 67th record. run: 1063 subRun: 1 event: 80667 at 21-Jan-2026 03:12:36 PST
Begin processing the 68th record. run: 1063 subRun: 1 event: 80668 at 21-Jan-2026 03:12:52 PST
Begin processing the 69th record. run: 1063 subRun: 1 event: 80669 at 21-Jan-2026 03:13:02 PST
Begin processing the 70th record. run: 1063 subRun: 1 event: 80670 at 21-Jan-2026 03:13:10 PST
Begin processing the 71st record. run: 1063 subRun: 1 event: 80671 at 21-Jan-2026 03:13:14 PST
Begin processing the 72nd record. run: 1063 subRun: 1 event: 80672 at 21-Jan-2026 03:13:18 PST
Begin processing the 73rd record. run: 1063 subRun: 1 event: 80673 at 21-Jan-2026 03:13:30 PST
Begin processing the 74th record. run: 1063 subRun: 1 event: 80674 at 21-Jan-2026 03:14:04 PST
Begin processing the 75th record. run: 1063 subRun: 1 event: 80675 at 21-Jan-2026 03:14:12 PST
Begin processing the 76th record. run: 1063 subRun: 1 event: 80676 at 21-Jan-2026 03:14:27 PST
Begin processing the 77th record. run: 1063 subRun: 1 event: 80677 at 21-Jan-2026 03:14:38 PST
Begin processing the 78th record. run: 1063 subRun: 1 event: 80678 at 21-Jan-2026 03:16:13 PST
Begin processing the 79th record. run: 1063 subRun: 1 event: 80679 at 21-Jan-2026 03:16:34 PST
Begin processing the 80th record. run: 1063 subRun: 1 event: 80680 at 21-Jan-2026 03:17:06 PST
Begin processing the 81st record. run: 1063 subRun: 1 event: 80681 at 21-Jan-2026 03:17:11 PST
Begin processing the 82nd record. run: 1063 subRun: 1 event: 80682 at 21-Jan-2026 03:17:18 PST
Begin processing the 83rd record. run: 1063 subRun: 1 event: 80683 at 21-Jan-2026 03:17:26 PST
Begin processing the 84th record. run: 1063 subRun: 1 event: 80684 at 21-Jan-2026 03:18:20 PST
Begin processing the 85th record. run: 1063 subRun: 1 event: 80685 at 21-Jan-2026 03:19:20 PST
Begin processing the 86th record. run: 1063 subRun: 1 event: 80686 at 21-Jan-2026 03:22:00 PST
Begin processing the 87th record. run: 1063 subRun: 1 event: 80687 at 21-Jan-2026 03:22:14 PST
Begin processing the 88th record. run: 1063 subRun: 1 event: 80688 at 21-Jan-2026 03:22:28 PST
Begin processing the 89th record. run: 1063 subRun: 1 event: 80689 at 21-Jan-2026 03:22:33 PST
Begin processing the 90th record. run: 1063 subRun: 1 event: 80690 at 21-Jan-2026 03:22:45 PST
Begin processing the 91st record. run: 1063 subRun: 1 event: 80691 at 21-Jan-2026 03:23:07 PST
Begin processing the 92nd record. run: 1063 subRun: 1 event: 80692 at 21-Jan-2026 03:23:11 PST
Begin processing the 93rd record. run: 1063 subRun: 1 event: 80693 at 21-Jan-2026 03:23:29 PST
Begin processing the 94th record. run: 1063 subRun: 1 event: 80694 at 21-Jan-2026 03:23:42 PST
Begin processing the 95th record. run: 1063 subRun: 1 event: 80695 at 21-Jan-2026 03:23:47 PST
Begin processing the 96th record. run: 1063 subRun: 1 event: 80696 at 21-Jan-2026 03:24:10 PST
Begin processing the 97th record. run: 1063 subRun: 1 event: 80697 at 21-Jan-2026 03:24:13 PST
Begin processing the 98th record. run: 1063 subRun: 1 event: 80698 at 21-Jan-2026 03:24:19 PST
Begin processing the 99th record. run: 1063 subRun: 1 event: 80699 at 21-Jan-2026 03:24:32 PST
Begin processing the 100th record. run: 1063 subRun: 1 event: 80700 at 21-Jan-2026 03:24:44 PST
21-Jan-2026 03:24:56 PST  Closed output file "nue_dune10kt_1x2x6_1063_806_20230823T132427Z_gen_g4_detsim_hitreco__20240221T055602Z_reco2_reco2.root"
21-Jan-2026 03:24:56 PST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/93/26/nue_dune10kt_1x2x6_1063_806_20230823T132427Z_gen_g4_detsim_hitreco__20240221T055602Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      2.46357       10.1067       80.582        5.21294       14.0602        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0630454     0.114631      0.349028      0.109828      0.0319809       100    
reco:pandora:StandardPandora                    2.36424       9.97756       80.4251       5.09044       14.044         100    
[art]:TriggerResults:TriggerResultInserter     1.146e-05    2.82525e-05   0.000104969   2.4695e-05    1.31886e-05      100    
end_path:out1:RootOutput                       2.59e-06     4.69516e-06    2.201e-05    3.6945e-06    2.50615e-06      100    
end_path:out1:RootOutput(write)               0.00124066     0.0142501     0.103402     0.00875575     0.0173071       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2341.63 MB
  Peak resident set size usage (VmHWM): 1380.39 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-05 13:50:17 UTC       justIN version: 01.06.00