justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262932.1@dunegpschedd01.fnal.gov

Jobsub ID262932.1@dunegpschedd01.fnal.gov
Workflow ID10977
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-03 21:53:45
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce509
Last heartbeat2025-12-03 22:30:48
From worker nodeHostnameb9p06p8345.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-03 21:55:00
Input filesusertests:000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z.root
JobscriptExit code0
Real time34m (2082s)
CPU time33m (2025s = 97%)
Max RSS bytes7134191616 (6803 MiB)
Outputting started2025-12-03 22:29:44
Output filesusertests:000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z_reco_data_2025-12-03T_215507Z.root
Finished2025-12-03 22:30:48
Saved logsjustin-logs:262932.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

AFM detsim jobscript.
Input PFN = root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/a4/f1/000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
[22:55:46.802] W [sigproc ] <OmnibusSigProc:apa6sigproc6> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[22:55:46.806] W [sigproc ] <OmnibusSigProc:apa7sigproc7> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[22:55:46.811] W [sigproc ] <OmnibusSigProc:apa8sigproc8> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[22:55:46.816] W [sigproc ] <OmnibusSigProc:apa9sigproc9> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[22:55:46.820] W [sigproc ] <OmnibusSigProc:apa10sigproc10> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[22:55:46.825] W [sigproc ] <OmnibusSigProc:apa11sigproc11> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
Inputer: "wclsSimDepoSource:"
Outputer: "wclsSimChannelSink:postdrift"
Outputer: "wclsFrameSaver:spsignals"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce recob::Wires named "dnnsp"
03-Dec-2025 22:55:46 CET  Initiating request to open input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/a4/f1/000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z.root"
03-Dec-2025 22:55:48 CET  Opened input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/a4/f1/000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z.root"
Begin processing the 1st record. run: 20000031 subRun: 0 event: 29 at 03-Dec-2025 22:55:49 CET
SimDepoSource got 5377768 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 5377768 depos spanning: [0.0432409, 2.02045e+06]us
[23:02:35.227] W [  gen   ] <IncoherentAddNoise:addnoiseapa5> model EmpiricalNoiseModel:empericalnoisemeganodes produced 6174 samples instead of expected 6000, future warnings muted 
Retagger: tagging trace set: wiener with 132049 traces, 132049 summary
Retagger: tagging trace set: gauss with 108345 traces, 0 summary
wclsFrameSaver: saving 108345 traces tagged "gauss"
FrameSaver: q=7.20197e+07 n=2268856 tag=gauss
wclsFrameSaver: saving 132049 traces tagged "wiener"
FrameSaver: q=7.8933e+07 n=2086728 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Dec-2025 23:29:24 CET  Opened output file with pattern "000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z_reco_data_2025-12-03T_215507Z.root"
03-Dec-2025 23:29:38 CET  Closed output file "000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z_reco_data_2025-12-03T_215507Z.root"
03-Dec-2025 23:29:38 CET  Closed input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/a4/f1/000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      2019.24       2019.24       2019.24       2019.24          0            1     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0184366     0.0184366     0.0184366     0.0184366         0            1     
simulate:tpcrawdecoder:WireCellToolkit          2013.92       2013.92       2013.92       2013.92          0            1     
simulate:rns:RandomNumberSaver                0.000322753   0.000322753   0.000322753   0.000322753        0            1     
[art]:TriggerResults:TriggerResultInserter     4.129e-05     4.129e-05     4.129e-05     4.129e-05         0            1     
end_path:out1:RootOutput                       2.244e-05     2.244e-05     2.244e-05     2.244e-05         0            1     
end_path:out1:RootOutput(write)                 5.30186       5.30186       5.30186       5.30186          0            1     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9076.63 MB
  Peak resident set size usage (VmHWM): 7134.19 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
outfile is 000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z_reco_data_2025-12-03T_215507Z.root
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w10977s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 29,
        "art.last_event": 29,
        "art.process_name": "detsim",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v10_11_00d01",
        "core.data_stream": "out1",
        "core.data_tier": "detector-simulated",
        "core.end_time": 1764800977.0,
        "core.event_count": 1,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 29,
        "core.last_event_number": 29,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1764800964.0
    },
    "parents": [
        {
            "did": "usertests:000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z.root"
        }
    ]
}
===================
.:
total 793904
-rw-r--r--. 1 duneprd np-comp 812804904 Dec  3 23:29 000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z_reco_data_2025-12-03T_215507Z.root
-rw-r--r--. 1 duneprd np-comp    116664 Dec  3 23:29 wcls-sim-drift-simchannel-nf-sp.log
-rw-r--r--. 1 duneprd np-comp      8168 Dec  3 23:29 000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z_reco_2025-12-03T_215507Z.log
-rw-r--r--. 1 duneprd np-comp      7100 Dec  3 23:29 jobscript.log
-rw-r--r--. 1 duneprd np-comp      1141 Dec  3 23:29 000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z_reco_data_2025-12-03T_215507Z.root.json
-rw-r--r--. 1 duneprd np-comp       985 Dec  3 23:29 000644_reco_data_2025-12-01T_121059Z_reco_data_2025-12-03T_160221Z_reco_data_2025-12-03T_174006Z_reco_data_2025-12-03T_215507Z.root.ext.json
-rw-r--r--. 1 duneprd np-comp       224 Dec  3 22:55 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp       193 Dec  3 23:29 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp         0 Dec  3 22:55 debugprod.log
justIN time: 2025-12-19 15:43:54 UTC       justIN version: 01.05.03