justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 240406.10@dunegpschedd01.fnal.gov

Jobsub ID240406.10@dunegpschedd01.fnal.gov
Workflow ID9439
Stage ID1
User namemdias@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-29 15:45:36
SiteUS_UChicago
EntryEngage_US_MWT2_uiuc_gk02_condce_mcore
Last heartbeat2025-10-29 17:28:46
From worker nodeHostnamemwt2-c107.campuscluster.illinois.edu
cpuinfoAMD EPYC 7443 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-29 15:46:21
Input filesusertests:pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root
JobscriptExit code0
Real time1h (6003s)
CPU time1h (5715s = 95%)
Max RSS bytes6756372480 (6443 MiB)
Outputting started2025-10-29 17:26:25
Output filesusertests:pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root
Finished2025-10-29 17:28:46
Saved logsjustin-logs:240406.10-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

27.9105       34.962        45.3136       34.1171       5.65222        10     
reco:crttag:SingleCRTMatchingProducer               0.00605563    0.00961354     0.0150962    0.00922106    0.00244914       10     
reco:crtreco:TwoCRTMatchingProducer                 0.00441023    0.00799966     0.0140722    0.00863043    0.00271236       10     
reco:pandora2Track:LArPandoraTrackCreation            3.69424       7.27021       11.8446       7.04992       2.9107         10     
reco:pandora2calo:ShowerCalorimetry                   1.15774       2.42389       5.17043       2.04105       1.27351        10     
reco:pandora2calonosce:ShowerCalorimetry              1.23688       2.34515       5.04146       1.90211       1.15176        10     
reco:pandora2GnocchiCalo:GnocchiCalorimetry          0.0645062     0.0825335     0.109337      0.0782014     0.0131268       10     
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry     0.0532715     0.0781654     0.102678      0.0772607     0.0140607       10     
reco:pandora2Shower:LArPandoraShowerCreation          1.31096       2.86765       5.60993       2.36654       1.42703        10     
reco:pandora2Showercalo:ShowerCalorimetry             1.64589       3.0149        5.60029       2.28895       1.51856        10     
reco:pandora2Showercalonosce:ShowerCalorimetry        1.36981       2.84044       5.05857       2.27893       1.3559         10     
[art]:TriggerResults:TriggerResultInserter          3.9955e-05    6.01734e-05   0.000120958   5.4262e-05    2.20731e-05      10     
end_path:out1:RootOutput                             8.355e-06    1.76273e-05    5.832e-05     1.314e-05    1.38093e-05      10     
end_path:out1:RootOutput(write)                       2.12769       2.68341       3.61038       2.56507      0.444075        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6238.93 MB
  Peak resident set size usage (VmHWM): 3998.52 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Reco returns 0
Extracted metadata
==== Start pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root.ext.json ====
{
  "DUNE.requestid": "ritm254286",
  "application": {
    "family": "art",
    "name": "reco",
    "version": "10_10_04d00"
  },
  "art.file_format_era": "ART_2011a",
  "art.file_format_version": 15,
  "art.first_event": 10,
  "art.last_event": 19,
  "art.process_name": "Reco",
  "art.run_type": "fardet-hd",
  "core.group": "dune",
  "core.run_type": "hd-protodune",
  "data_stream": "out1",
  "data_tier": "full-reconstructed",
  "dune.campaign": "pdhd_mc_2025a",
  "dune.config_file": "standard_reco_protodunehd_MC.fcl",
  "dune.user": "dunepro",
  "dune_mc.detector_type": "hd-protodune",
  "dune_mc.gen_fcl_filename": "standard_g4_protodunehd_stage1.fcl",
  "dune_mc.liquid_flow": "no",
  "dune_mc.space_charge": "no",
  "end_time": "2025-10-29T17:26:19",
  "event_count": 10,
  "file_format": "artroot",
  "file_name": "pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root",
  "file_size": 6067821103,
  "file_type": "mc",
  "first_event": 10,
  "group": "dune",
  "last_event": 19,
  "origin.applications.config_files": {
    "g4_stage1": "standard_g4_protodunehd_stage1.fcl",
    "gen": "pdhd_1GeV_h4input_cosmics.fcl"
  },
  "parents": [
    {
      "file_name": "temp_detsim.root"
    }
  ],
  "runs": [
    [
      20250619,
      1,
      "fardet-hd"
    ]
  ],
  "start_time": "2025-10-29T17:04:17"
}
==== End pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root.ext.json ====
==== Start pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root.json ====
{
    "metadata": {
        "dune.requestid": "ritm254286",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 10,
        "art.last_event": 19,
        "art.process_name": "Reco",
        "art.run_type": "fardet-hd",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "10_10_04d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1761758779.0,
        "core.event_count": 10,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 10,
        "core.group": "dune",
        "core.last_event_number": 19,
        "core.run_type": "hd-protodune",
        "core.runs": [
            20250619
        ],
        "core.runs_subruns": [
            2025061900001
        ],
        "core.start_time": 1761757457.0,
        "dune.campaign": "pdhd_mc_2025a",
        "dune.config_file": "standard_reco_protodunehd_MC.fcl",
        "dune.user": "dunepro",
        "dune_mc.detector_type": "hd-protodune",
        "dune_mc.gen_fcl_filename": "standard_g4_protodunehd_stage1.fcl",
        "dune_mc.liquid_flow": "no",
        "dune_mc.space_charge": "no",
        "origin.applications.config_files": {
            "g4_stage1": "standard_g4_protodunehd_stage1.fcl",
            "gen": "pdhd_1GeV_h4input_cosmics.fcl"
        }
    },
    "namespace": "usertests",
    "parents": [
        {
            "name": "pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root",
            "namespace": "usertests"
        }
    ]
}==== End pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root.json ====
==== Start pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root.temp.json ====
{
    "metadata": {
        "DUNE.requestid": "ritm254286",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 10,
        "art.last_event": 19,
        "art.process_name": "Reco",
        "art.run_type": "fardet-hd",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "10_10_04d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1761758779.0,
        "core.event_count": 10,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 10,
        "core.group": "dune",
        "core.last_event_number": 19,
        "core.run_type": "hd-protodune",
        "core.runs": [
            20250619
        ],
        "core.runs_subruns": [
            2025061900001
        ],
        "core.start_time": 1761757457.0,
        "dune.campaign": "pdhd_mc_2025a",
        "dune.config_file": "standard_reco_protodunehd_MC.fcl",
        "dune.user": "dunepro",
        "dune_mc.detector_type": "hd-protodune",
        "dune_mc.gen_fcl_filename": "standard_g4_protodunehd_stage1.fcl",
        "dune_mc.liquid_flow": "no",
        "dune_mc.space_charge": "no",
        "origin.applications.config_files": {
            "g4_stage1": "standard_g4_protodunehd_stage1.fcl",
            "gen": "pdhd_1GeV_h4input_cosmics.fcl"
        }
    },
    "namespace": "usertests",
    "parents": [
        {
            "name": "pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root",
            "namespace": "usertests"
        }
    ]
}==== End pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root.temp.json ====
.:
total 5978276
-rw-r--r-- 1 dune osgvo      45052 Oct 29 12:26 jobscript.log
-rw-r--r-- 1 dune osgvo        193 Oct 29 12:26 justin-processed-pfns.txt
-rw-r--r-- 1 dune osgvo       1746 Oct 29 12:26 pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root.json
-rw-r--r-- 1 dune osgvo       1746 Oct 29 12:26 pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root.temp.json
-rw-r--r-- 1 dune osgvo       1420 Oct 29 12:26 pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root.ext.json
-rw-r--r-- 1 dune osgvo        519 Oct 29 12:26 reco_protodunehd_hist.root
-rw-r--r-- 1 dune osgvo       3574 Oct 29 12:26 Pandora_Geometry.xml
-rw-r--r-- 1 dune osgvo     200704 Oct 29 12:26 mem.db
-rw-r--r-- 1 dune osgvo      36864 Oct 29 12:26 time.db
-rw-r--r-- 1 dune osgvo 6067821103 Oct 29 12:26 pdhd_prod_beam__233269_3_1_20251027T173544Z_gen_g4_IonScintPDExt.root_233303_14_1_20251027T193046Z_PDInt.root_240406_10_1_20251029T154626Z_detsim_reco1.root
-rw-r--r-- 1 dune osgvo   53594990 Oct 29 12:25 Pandora_Events.pndr
-rw-r--r-- 1 dune osgvo          0 Oct 29 12:03 ProtoDUNE.log
-rw-r--r-- 1 dune osgvo          0 Oct 29 12:00 debugprod.log
-rw-r--r-- 1 dune osgvo        519 Oct 29 12:00 detsim_single_protodunehd_hist.root
-rw-r--r-- 1 dune osgvo        240 Oct 29 10:46 all-input-dids.txt
justIN time: 2025-11-05 15:42:58 UTC       justIN version: 01.05.01