justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 233867.1@dunegpschedd02.fnal.gov

Jobsub ID233867.1@dunegpschedd02.fnal.gov
Workflow ID9327
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-10-28 18:07:27
SiteUS_UChicago
EntryEngage_US_MWT2_iut2_condce_mcore
Last heartbeat2025-10-28 18:36:42
From worker nodeHostnameiut2-c416.iu.edu
cpuinfoAMD EPYC 7443 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-28 18:08:36
Input filesfardet-hd:nu_dune10kt_1x2x6_1413_256_20230826T183316Z_gen_g4_detsim_hitreco__20240222T230510Z_reco2.root
JobscriptExit code0
Real time27m (1672s)
CPU time14m (859s = 51%)
Max RSS bytes1522188288 (1451 MiB)
Outputting started2025-10-28 18:36:28
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/kalmanAlg_nu_0/fnal/09327/1/002/ClusterValidation_WithAlg_nu_dune10kt_1x2x6_1413_256_20230826T183316Z_gen_g4_detsim_hitreco__20240222T230510Z_reco2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/kalmanAlg_nu_0/fnal/09327/1/002/ClusterValidation_WithoutAlg_nu_dune10kt_1x2x6_1413_256_20230826T183316Z_gen_g4_detsim_hitreco__20240222T230510Z_reco2.root
Finished2025-10-28 18:36:42
Saved logsjustin-logs:233867.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/9b/fe/nu_dune10kt_1x2x6_1413_256_20230826T183316Z_gen_g4_detsim_hitreco__20240222T230510Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1413 subRun: 1 event: 25623 at 28-Oct-2025 14:21:00 EDT
Begin processing the 24th record. run: 1413 subRun: 1 event: 25624 at 28-Oct-2025 14:21:04 EDT
Begin processing the 25th record. run: 1413 subRun: 1 event: 25625 at 28-Oct-2025 14:21:06 EDT
Begin processing the 26th record. run: 1413 subRun: 1 event: 25626 at 28-Oct-2025 14:21:55 EDT
Begin processing the 27th record. run: 1413 subRun: 1 event: 25627 at 28-Oct-2025 14:21:58 EDT
Begin processing the 28th record. run: 1413 subRun: 1 event: 25628 at 28-Oct-2025 14:22:02 EDT
Begin processing the 29th record. run: 1413 subRun: 1 event: 25629 at 28-Oct-2025 14:22:15 EDT
Begin processing the 30th record. run: 1413 subRun: 1 event: 25630 at 28-Oct-2025 14:22:20 EDT
Begin processing the 31st record. run: 1413 subRun: 1 event: 25631 at 28-Oct-2025 14:22:22 EDT
Begin processing the 32nd record. run: 1413 subRun: 1 event: 25632 at 28-Oct-2025 14:22:25 EDT
Begin processing the 33rd record. run: 1413 subRun: 1 event: 25633 at 28-Oct-2025 14:22:30 EDT
Begin processing the 34th record. run: 1413 subRun: 1 event: 25634 at 28-Oct-2025 14:22:36 EDT
Begin processing the 35th record. run: 1413 subRun: 1 event: 25635 at 28-Oct-2025 14:22:42 EDT
Begin processing the 36th record. run: 1413 subRun: 1 event: 25636 at 28-Oct-2025 14:22:44 EDT
Begin processing the 37th record. run: 1413 subRun: 1 event: 25637 at 28-Oct-2025 14:22:48 EDT
Begin processing the 38th record. run: 1413 subRun: 1 event: 25638 at 28-Oct-2025 14:22:50 EDT
Begin processing the 39th record. run: 1413 subRun: 1 event: 25639 at 28-Oct-2025 14:22:54 EDT
Begin processing the 40th record. run: 1413 subRun: 1 event: 25640 at 28-Oct-2025 14:22:58 EDT
Begin processing the 41st record. run: 1413 subRun: 1 event: 25641 at 28-Oct-2025 14:23:02 EDT
Begin processing the 42nd record. run: 1413 subRun: 1 event: 25642 at 28-Oct-2025 14:23:08 EDT
Begin processing the 43rd record. run: 1413 subRun: 1 event: 25643 at 28-Oct-2025 14:26:36 EDT
Begin processing the 44th record. run: 1413 subRun: 1 event: 25644 at 28-Oct-2025 14:26:43 EDT
Begin processing the 45th record. run: 1413 subRun: 1 event: 25645 at 28-Oct-2025 14:26:46 EDT
Begin processing the 46th record. run: 1413 subRun: 1 event: 25646 at 28-Oct-2025 14:26:52 EDT
Begin processing the 47th record. run: 1413 subRun: 1 event: 25647 at 28-Oct-2025 14:26:55 EDT
Begin processing the 48th record. run: 1413 subRun: 1 event: 25648 at 28-Oct-2025 14:28:31 EDT
Begin processing the 49th record. run: 1413 subRun: 1 event: 25649 at 28-Oct-2025 14:28:33 EDT
Begin processing the 50th record. run: 1413 subRun: 1 event: 25650 at 28-Oct-2025 14:28:41 EDT
Begin processing the 51st record. run: 1413 subRun: 1 event: 25651 at 28-Oct-2025 14:28:48 EDT
Begin processing the 52nd record. run: 1413 subRun: 1 event: 25652 at 28-Oct-2025 14:28:52 EDT
Begin processing the 53rd record. run: 1413 subRun: 1 event: 25653 at 28-Oct-2025 14:29:11 EDT
Begin processing the 54th record. run: 1413 subRun: 1 event: 25654 at 28-Oct-2025 14:29:56 EDT
Begin processing the 55th record. run: 1413 subRun: 1 event: 25655 at 28-Oct-2025 14:29:58 EDT
Begin processing the 56th record. run: 1413 subRun: 1 event: 25656 at 28-Oct-2025 14:31:44 EDT
Begin processing the 57th record. run: 1413 subRun: 1 event: 25657 at 28-Oct-2025 14:31:48 EDT
Begin processing the 58th record. run: 1413 subRun: 1 event: 25658 at 28-Oct-2025 14:31:54 EDT
Begin processing the 59th record. run: 1413 subRun: 1 event: 25659 at 28-Oct-2025 14:31:58 EDT
Begin processing the 60th record. run: 1413 subRun: 1 event: 25660 at 28-Oct-2025 14:32:17 EDT
Begin processing the 61st record. run: 1413 subRun: 1 event: 25661 at 28-Oct-2025 14:32:21 EDT
Begin processing the 62nd record. run: 1413 subRun: 1 event: 25662 at 28-Oct-2025 14:32:24 EDT
Begin processing the 63rd record. run: 1413 subRun: 1 event: 25663 at 28-Oct-2025 14:32:29 EDT
Begin processing the 64th record. run: 1413 subRun: 1 event: 25664 at 28-Oct-2025 14:33:28 EDT
Begin processing the 65th record. run: 1413 subRun: 1 event: 25665 at 28-Oct-2025 14:33:32 EDT
Begin processing the 66th record. run: 1413 subRun: 1 event: 25666 at 28-Oct-2025 14:33:47 EDT
Begin processing the 67th record. run: 1413 subRun: 1 event: 25667 at 28-Oct-2025 14:33:50 EDT
Begin processing the 68th record. run: 1413 subRun: 1 event: 25668 at 28-Oct-2025 14:33:54 EDT
Begin processing the 69th record. run: 1413 subRun: 1 event: 25669 at 28-Oct-2025 14:33:57 EDT
Begin processing the 70th record. run: 1413 subRun: 1 event: 25670 at 28-Oct-2025 14:34:00 EDT
Begin processing the 71st record. run: 1413 subRun: 1 event: 25671 at 28-Oct-2025 14:34:02 EDT
Begin processing the 72nd record. run: 1413 subRun: 1 event: 25672 at 28-Oct-2025 14:34:05 EDT
Begin processing the 73rd record. run: 1413 subRun: 1 event: 25673 at 28-Oct-2025 14:34:10 EDT
Begin processing the 74th record. run: 1413 subRun: 1 event: 25674 at 28-Oct-2025 14:34:13 EDT
Begin processing the 75th record. run: 1413 subRun: 1 event: 25675 at 28-Oct-2025 14:34:18 EDT
Begin processing the 76th record. run: 1413 subRun: 1 event: 25676 at 28-Oct-2025 14:34:28 EDT
Begin processing the 77th record. run: 1413 subRun: 1 event: 25677 at 28-Oct-2025 14:34:30 EDT
Begin processing the 78th record. run: 1413 subRun: 1 event: 25678 at 28-Oct-2025 14:34:33 EDT
Begin processing the 79th record. run: 1413 subRun: 1 event: 25679 at 28-Oct-2025 14:34:40 EDT
Begin processing the 80th record. run: 1413 subRun: 1 event: 25680 at 28-Oct-2025 14:34:45 EDT
Begin processing the 81st record. run: 1413 subRun: 1 event: 25681 at 28-Oct-2025 14:34:50 EDT
Begin processing the 82nd record. run: 1413 subRun: 1 event: 25682 at 28-Oct-2025 14:35:03 EDT
Begin processing the 83rd record. run: 1413 subRun: 1 event: 25683 at 28-Oct-2025 14:35:05 EDT
Begin processing the 84th record. run: 1413 subRun: 1 event: 25684 at 28-Oct-2025 14:35:13 EDT
Begin processing the 85th record. run: 1413 subRun: 1 event: 25685 at 28-Oct-2025 14:35:16 EDT
Begin processing the 86th record. run: 1413 subRun: 1 event: 25686 at 28-Oct-2025 14:35:20 EDT
Begin processing the 87th record. run: 1413 subRun: 1 event: 25687 at 28-Oct-2025 14:35:23 EDT
Begin processing the 88th record. run: 1413 subRun: 1 event: 25688 at 28-Oct-2025 14:35:28 EDT
Begin processing the 89th record. run: 1413 subRun: 1 event: 25689 at 28-Oct-2025 14:35:36 EDT
Begin processing the 90th record. run: 1413 subRun: 1 event: 25690 at 28-Oct-2025 14:35:39 EDT
Begin processing the 91st record. run: 1413 subRun: 1 event: 25691 at 28-Oct-2025 14:35:41 EDT
Begin processing the 92nd record. run: 1413 subRun: 1 event: 25692 at 28-Oct-2025 14:35:56 EDT
Begin processing the 93rd record. run: 1413 subRun: 1 event: 25693 at 28-Oct-2025 14:35:59 EDT
Begin processing the 94th record. run: 1413 subRun: 1 event: 25694 at 28-Oct-2025 14:36:01 EDT
Begin processing the 95th record. run: 1413 subRun: 1 event: 25695 at 28-Oct-2025 14:36:04 EDT
Begin processing the 96th record. run: 1413 subRun: 1 event: 25696 at 28-Oct-2025 14:36:07 EDT
Begin processing the 97th record. run: 1413 subRun: 1 event: 25697 at 28-Oct-2025 14:36:11 EDT
Begin processing the 98th record. run: 1413 subRun: 1 event: 25698 at 28-Oct-2025 14:36:14 EDT
Begin processing the 99th record. run: 1413 subRun: 1 event: 25699 at 28-Oct-2025 14:36:17 EDT
Begin processing the 100th record. run: 1413 subRun: 1 event: 25700 at 28-Oct-2025 14:36:21 EDT
28-Oct-2025 14:36:28 EDT  Closed output file "nu_dune10kt_1x2x6_1413_256_20230826T183316Z_gen_g4_detsim_hitreco__20240222T230510Z_reco2_reco2.root"
28-Oct-2025 14:36:28 EDT  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/9b/fe/nu_dune10kt_1x2x6_1413_256_20230826T183316Z_gen_g4_detsim_hitreco__20240222T230510Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.81916       8.13918       194.252       2.70346       22.8986        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0115032     0.0415754     0.259915      0.0343779     0.0273623       100    
reco:pandora:StandardPandora                    1.78129       8.08023       194.069       2.66414       22.8797        100    
[art]:TriggerResults:TriggerResultInserter    1.1691e-05    2.93927e-05   0.000184175    2.726e-05    1.87766e-05      100    
end_path:out1:RootOutput                       2.555e-06    6.94785e-06   9.2679e-05     6.081e-06    9.01784e-06      100    
end_path:out1:RootOutput(write)               0.00106244     0.0170786     0.108753      0.0111376     0.0201863       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2500.96 MB
  Peak resident set size usage (VmHWM): 1522.19 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2025-11-04 18:20:19 UTC       justIN version: 01.05.01