justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 256888.25@dunegpschedd02.fnal.gov

Jobsub ID256888.25@dunegpschedd02.fnal.gov
Workflow ID10961
Stage ID1
User nameamoor@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-03 11:07:11
SiteUS_UChicago
EntryEngage_US_MWT2_uiuc_gk02_condce_mcore
Last heartbeat2025-12-03 11:10:34
From worker nodeHostnameuct2-c629.mwt2.org
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-03 11:09:35
Input filesusertests:000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z.root
JobscriptExit code0
Real time0m (45s)
CPU time0m (38s = 84%)
Max RSS bytes922042368 (879 MiB)
Outputting started2025-12-03 11:10:21
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/amoor/fnal/10961/1/001/000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z_reco_data_2025-12-03T_110940Z.root
Finished2025-12-03 11:10:34
Saved logsjustin-logs:256888.25-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

AFM reco1 jobscript.
Input PFN = root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/usertests/b8/e4/000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
StandardRawDigitPrepService::ctor: Fetching extract service.
StandardRawDigitPrepService::ctor: Fetching channel status provider.
StandardRawDigitPrepService::ctor:   Channel status provider: @0x64885e0
StandardRawDigitPrepService::ctor:   Extract service: @0x8d0f300
StandardRawDigitPrepService::ctor: Fetching deconvolution service.
StandardRawDigitPrepService::ctor:   Deconvolution service: @0x4131f70
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0x3e74d60
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0x3e74d30
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
03-Dec-2025 05:10:13 CST  Initiating request to open input file "root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/usertests/b8/e4/000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z.root"
03-Dec-2025 05:10:15 CST  Opened input file "root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/usertests/b8/e4/000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z.root"
03-Dec-2025 05:10:18 CST  Opened output file with pattern "000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z_reco_data_2025-12-03T_110940Z.root"
03-Dec-2025 05:10:19 CST  Closed output file "000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z_reco_data_2025-12-03T_110940Z.root"
03-Dec-2025 05:10:19 CST  Closed input file "root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/usertests/b8/e4/000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
[ No processed events ]
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1855.58 MB
  Peak resident set size usage (VmHWM): 922.042 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w10961s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 4294967295,
        "art.last_event": 4294967295,
        "art.process_name": "Reco1",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v10_11_00d01",
        "core.data_stream": "out1",
        "core.data_tier": "hit-reconstructed",
        "core.end_time": 1764760219.0,
        "core.event_count": 0,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 4294967295,
        "core.last_event_number": 4294967295,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1764760218.0
    },
    "parents": [
        {
            "did": "usertests:000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z.root"
        }
    ]
}
===================
.:
total 248
-rw-r--r--. 1 dune osgvo 209351 Dec  3 05:10 000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z_reco_data_2025-12-03T_110940Z.root
-rw-r--r--. 1 dune osgvo   8473 Dec  3 05:10 000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z_reco_2025-12-03T_110940Z.log
-rw-r--r--. 1 dune osgvo   6050 Dec  3 05:10 jobscript.log
-rw-r--r--. 1 dune osgvo   1201 Dec  3 05:10 000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z_reco_data_2025-12-03T_110940Z.root.json
-rw-r--r--. 1 dune osgvo   1072 Dec  3 05:10 000986_reco_data_2025-12-01T_121503Z_reco_data_2025-12-01T_171716Z_reco_data_2025-12-02T_113836Z_reco_data_2025-12-02T_163907Z_reco_data_2025-12-03T_110940Z.root.ext.json
-rw-r--r--. 1 dune osgvo    519 Dec  3 05:10 reco1_hist.root
-rw-r--r--. 1 dune osgvo    284 Dec  3 05:09 all-input-dids.txt
-rw-r--r--. 1 dune osgvo    203 Dec  3 05:10 justin-processed-pfns.txt
-rw-r--r--. 1 dune osgvo      0 Dec  3 05:09 debugprod.log
justIN time: 2026-02-07 22:08:15 UTC       justIN version: 01.06.00