justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 30100.0@dunegpschedd01.fnal.gov

Jobsub ID30100.0@dunegpschedd01.fnal.gov
Workflow ID1657
Stage ID1
User namehsouza@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes3145728000 (3000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-08-21 12:34:31
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce01
Last heartbeat2025-08-21 12:43:09
From worker nodeHostnamedune001-8688108.0-lcg2597.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes3145728000 (3000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-08-21 12:35:30
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207207_337_20231120T134510Z_gen_g4_detsim_hitreco__20240507T182307Z_reco2.root
JobscriptExit code0
Real time7m (438s)
CPU time1m (63s = 14%)
Max RSS bytes1358016512 (1295 MiB)
Outputting started2025-08-21 12:42:49
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/hsouza/fnal/01657/1/001/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207207_337_20231120T134510Z_gen_g4_detsim_hitreco__20240507T182307Z_reco2_pida_2025-08-21T_123535Z.root
Finished2025-08-21 12:43:09
Saved logsjustin-logs:30100.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Run: 1 event: 67530 at 21-Aug-2025 12:40:22 UTC
Begin processing the 131st record. run: 6207207 subRun: 1 event: 67531 at 21-Aug-2025 12:40:24 UTC
Begin processing the 132nd record. run: 6207207 subRun: 1 event: 67532 at 21-Aug-2025 12:40:26 UTC
Begin processing the 133rd record. run: 6207207 subRun: 1 event: 67533 at 21-Aug-2025 12:40:28 UTC
Begin processing the 134th record. run: 6207207 subRun: 1 event: 67534 at 21-Aug-2025 12:40:30 UTC
Begin processing the 135th record. run: 6207207 subRun: 1 event: 67535 at 21-Aug-2025 12:40:32 UTC
Begin processing the 136th record. run: 6207207 subRun: 1 event: 67536 at 21-Aug-2025 12:40:33 UTC
Begin processing the 137th record. run: 6207207 subRun: 1 event: 67537 at 21-Aug-2025 12:40:35 UTC
Begin processing the 138th record. run: 6207207 subRun: 1 event: 67538 at 21-Aug-2025 12:40:37 UTC
Begin processing the 139th record. run: 6207207 subRun: 1 event: 67539 at 21-Aug-2025 12:40:39 UTC
Begin processing the 140th record. run: 6207207 subRun: 1 event: 67540 at 21-Aug-2025 12:40:41 UTC
Begin processing the 141st record. run: 6207207 subRun: 1 event: 67541 at 21-Aug-2025 12:40:43 UTC
Begin processing the 142nd record. run: 6207207 subRun: 1 event: 67542 at 21-Aug-2025 12:40:45 UTC
Begin processing the 143rd record. run: 6207207 subRun: 1 event: 67543 at 21-Aug-2025 12:40:47 UTC
Begin processing the 144th record. run: 6207207 subRun: 1 event: 67544 at 21-Aug-2025 12:40:49 UTC
Begin processing the 145th record. run: 6207207 subRun: 1 event: 67545 at 21-Aug-2025 12:40:50 UTC
Begin processing the 146th record. run: 6207207 subRun: 1 event: 67546 at 21-Aug-2025 12:40:52 UTC
Begin processing the 147th record. run: 6207207 subRun: 1 event: 67547 at 21-Aug-2025 12:40:54 UTC
Begin processing the 148th record. run: 6207207 subRun: 1 event: 67548 at 21-Aug-2025 12:40:56 UTC
Begin processing the 149th record. run: 6207207 subRun: 1 event: 67549 at 21-Aug-2025 12:40:58 UTC
Begin processing the 150th record. run: 6207207 subRun: 1 event: 67550 at 21-Aug-2025 12:41:00 UTC
Begin processing the 151st record. run: 6207207 subRun: 1 event: 67551 at 21-Aug-2025 12:41:02 UTC
Begin processing the 152nd record. run: 6207207 subRun: 1 event: 67552 at 21-Aug-2025 12:41:05 UTC
Begin processing the 153rd record. run: 6207207 subRun: 1 event: 67553 at 21-Aug-2025 12:41:07 UTC
Begin processing the 154th record. run: 6207207 subRun: 1 event: 67554 at 21-Aug-2025 12:41:09 UTC
Begin processing the 155th record. run: 6207207 subRun: 1 event: 67555 at 21-Aug-2025 12:41:10 UTC
Begin processing the 156th record. run: 6207207 subRun: 1 event: 67556 at 21-Aug-2025 12:41:12 UTC
Begin processing the 157th record. run: 6207207 subRun: 1 event: 67557 at 21-Aug-2025 12:41:16 UTC
Begin processing the 158th record. run: 6207207 subRun: 1 event: 67558 at 21-Aug-2025 12:41:18 UTC
Begin processing the 159th record. run: 6207207 subRun: 1 event: 67559 at 21-Aug-2025 12:41:20 UTC
Begin processing the 160th record. run: 6207207 subRun: 1 event: 67560 at 21-Aug-2025 12:41:21 UTC
Begin processing the 161st record. run: 6207207 subRun: 1 event: 67561 at 21-Aug-2025 12:41:23 UTC
Begin processing the 162nd record. run: 6207207 subRun: 1 event: 67562 at 21-Aug-2025 12:41:25 UTC
Begin processing the 163rd record. run: 6207207 subRun: 1 event: 67563 at 21-Aug-2025 12:41:30 UTC
Begin processing the 164th record. run: 6207207 subRun: 1 event: 67564 at 21-Aug-2025 12:41:32 UTC
Begin processing the 165th record. run: 6207207 subRun: 1 event: 67565 at 21-Aug-2025 12:41:33 UTC
Begin processing the 166th record. run: 6207207 subRun: 1 event: 67566 at 21-Aug-2025 12:41:36 UTC
Begin processing the 167th record. run: 6207207 subRun: 1 event: 67567 at 21-Aug-2025 12:41:38 UTC
Begin processing the 168th record. run: 6207207 subRun: 1 event: 67568 at 21-Aug-2025 12:41:38 UTC
Begin processing the 169th record. run: 6207207 subRun: 1 event: 67569 at 21-Aug-2025 12:41:40 UTC
Begin processing the 170th record. run: 6207207 subRun: 1 event: 67570 at 21-Aug-2025 12:41:42 UTC
Begin processing the 171st record. run: 6207207 subRun: 1 event: 67571 at 21-Aug-2025 12:41:44 UTC
Begin processing the 172nd record. run: 6207207 subRun: 1 event: 67572 at 21-Aug-2025 12:41:47 UTC
Begin processing the 173rd record. run: 6207207 subRun: 1 event: 67573 at 21-Aug-2025 12:41:48 UTC
Begin processing the 174th record. run: 6207207 subRun: 1 event: 67574 at 21-Aug-2025 12:41:50 UTC
Begin processing the 175th record. run: 6207207 subRun: 1 event: 67575 at 21-Aug-2025 12:41:53 UTC
Begin processing the 176th record. run: 6207207 subRun: 1 event: 67576 at 21-Aug-2025 12:41:55 UTC
Begin processing the 177th record. run: 6207207 subRun: 1 event: 67577 at 21-Aug-2025 12:41:57 UTC
Begin processing the 178th record. run: 6207207 subRun: 1 event: 67578 at 21-Aug-2025 12:41:59 UTC
Begin processing the 179th record. run: 6207207 subRun: 1 event: 67579 at 21-Aug-2025 12:42:01 UTC
Begin processing the 180th record. run: 6207207 subRun: 1 event: 67580 at 21-Aug-2025 12:42:03 UTC
Begin processing the 181st record. run: 6207207 subRun: 1 event: 67581 at 21-Aug-2025 12:42:08 UTC
Begin processing the 182nd record. run: 6207207 subRun: 1 event: 67582 at 21-Aug-2025 12:42:10 UTC
Begin processing the 183rd record. run: 6207207 subRun: 1 event: 67583 at 21-Aug-2025 12:42:12 UTC
Begin processing the 184th record. run: 6207207 subRun: 1 event: 67584 at 21-Aug-2025 12:42:13 UTC
Begin processing the 185th record. run: 6207207 subRun: 1 event: 67585 at 21-Aug-2025 12:42:15 UTC
Begin processing the 186th record. run: 6207207 subRun: 1 event: 67586 at 21-Aug-2025 12:42:18 UTC
Begin processing the 187th record. run: 6207207 subRun: 1 event: 67587 at 21-Aug-2025 12:42:20 UTC
Begin processing the 188th record. run: 6207207 subRun: 1 event: 67588 at 21-Aug-2025 12:42:22 UTC
Begin processing the 189th record. run: 6207207 subRun: 1 event: 67589 at 21-Aug-2025 12:42:24 UTC
Begin processing the 190th record. run: 6207207 subRun: 1 event: 67590 at 21-Aug-2025 12:42:27 UTC
Begin processing the 191st record. run: 6207207 subRun: 1 event: 67591 at 21-Aug-2025 12:42:29 UTC
Begin processing the 192nd record. run: 6207207 subRun: 1 event: 67592 at 21-Aug-2025 12:42:31 UTC
Begin processing the 193rd record. run: 6207207 subRun: 1 event: 67593 at 21-Aug-2025 12:42:32 UTC
Begin processing the 194th record. run: 6207207 subRun: 1 event: 67594 at 21-Aug-2025 12:42:34 UTC
Begin processing the 195th record. run: 6207207 subRun: 1 event: 67595 at 21-Aug-2025 12:42:36 UTC
Begin processing the 196th record. run: 6207207 subRun: 1 event: 67596 at 21-Aug-2025 12:42:39 UTC
Begin processing the 197th record. run: 6207207 subRun: 1 event: 67597 at 21-Aug-2025 12:42:40 UTC
Begin processing the 198th record. run: 6207207 subRun: 1 event: 67598 at 21-Aug-2025 12:42:41 UTC
Begin processing the 199th record. run: 6207207 subRun: 1 event: 67599 at 21-Aug-2025 12:42:44 UTC
Begin processing the 200th record. run: 6207207 subRun: 1 event: 67600 at 21-Aug-2025 12:42:46 UTC
21-Aug-2025 12:42:48 UTC  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/e0/2b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207207_337_20231120T134510Z_gen_g4_detsim_hitreco__20240507T182307Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      0.49398       1.72017       6.20226       1.71344      0.517566        200    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0265789     0.0515319     0.0880081     0.052883      0.0158003       200    
prod:pandorapid:Chi2ParticleID                  0.15806      0.251701      0.339541      0.264313      0.0434619       200    
prod:energyreconue:EnergyReco                   0.27408      0.599102       1.05536      0.566129      0.131092        200    
prod:energyreconumu:EnergyReco                0.00166713     0.124722       2.68842      0.0834331     0.215387        200    
prod:energyreconc:EnergyReco                  0.00265985     0.0432023     0.395871      0.0455662     0.0381665       200    
[art]:TriggerResults:TriggerResultInserter      9.4e-06     1.68946e-05   7.2452e-05    1.64505e-05   5.40867e-06      200    
end_path:ana:PIDASelectionAna                 0.00230001     0.649365       1.71205      0.648208      0.218881        200    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 36980.2 MB
  Peak resident set size usage (VmHWM): 1358.02 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
.:
total 72
-rw-r--r-- 1 dune001 dune 28477 Aug 21 12:42 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207207_337_20231120T134510Z_gen_g4_detsim_hitreco__20240507T182307Z_reco2_pida_2025-08-21T_123535Z.root
-rw-r--r-- 1 dune001 dune 24105 Aug 21 12:42 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207207_337_20231120T134510Z_gen_g4_detsim_hitreco__20240507T182307Z_reco2_reco_2025-08-21T_123535Z.log
-rw-r--r-- 1 dune001 dune 12030 Aug 21 12:42 jobscript.log
-rw-r--r-- 1 dune001 dune   216 Aug 21 12:42 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune   137 Aug 21 12:35 all-input-dids.txt
-rw-r--r-- 1 dune001 dune     0 Aug 21 12:35 debugprod.log
justIN time: 2025-09-19 10:52:08 UTC       justIN version: 01.05.00