justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 299906.62@dunegpschedd01.fnal.gov

Jobsub ID299906.62@dunegpschedd01.fnal.gov
Workflow ID12309
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-23 11:54:20
SiteUK_Brunel
EntryCMSHTPC_T2_UK_London_Brunel_dc2_22
Last heartbeat2026-01-23 15:27:27
From worker nodeHostnamewn-b8-28-00.brunel.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-23 14:15:47
Input filesmonte-carlo-012309-000555
JobscriptExit code0
Real time1h (4248s)
CPU time1h (4095s = 96%)
Max RSS bytes3876659200 (3697 MiB)
Outputting started2026-01-23 15:26:37
Output files
Finished2026-01-23 15:27:27
Saved logsjustin-logs:299906.62-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

d "wiener"
FrameSaver: q=2.52218e+06 n=422588 tag=wiener

Error in processing reco
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  hitpdune
  pandora
  pandora2Shower
  pandora2Track
  pandora2cali
  pandora2calipid
  pandora2pid
  pandoraShower
  pandoraTrack
  pandoraWriter
  pandoracalipid
  pandorapid
  reco3d
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/protodune_v7.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 36176 nodes/ 5435 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
23-Jan-2026 14:48:52 GMT  Initiating request to open input file "prod_mpvmpr_protodunesp_1_299906_62_1769177755_gen_g4_stage1_detsim.root"
23-Jan-2026 14:48:52 GMT  Opened input file "prod_mpvmpr_protodunesp_1_299906_62_1769177755_gen_g4_stage1_detsim.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 37671 traces, 37671 summary
Retagger: tagging trace set: gauss with 33728 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 33728 traces tagged "gauss"
FrameSaver: q=2.0561e+06 n=426819 tag=gauss
wclsFrameSaver: saving 37671 traces tagged "wiener"
FrameSaver: q=2.27034e+06 n=370359 tag=wiener
23-Jan-2026 14:51:25 GMT  Opened output file with pattern "prod_mpvmpr_protodunesp_1_299906_62_1769177755_gen_g4_stage1_detsim_reco.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 36017 traces, 36017 summary
Retagger: tagging trace set: gauss with 33665 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 33665 traces tagged "gauss"
FrameSaver: q=2.09239e+06 n=469175 tag=gauss
wclsFrameSaver: saving 36017 traces tagged "wiener"
FrameSaver: q=2.25133e+06 n=418116 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 46418 traces, 46418 summary
Retagger: tagging trace set: gauss with 40049 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 40049 traces tagged "gauss"
FrameSaver: q=3.07977e+06 n=565878 tag=gauss
wclsFrameSaver: saving 46418 traces tagged "wiener"
FrameSaver: q=3.39387e+06 n=499702 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 51916 traces, 51916 summary
Retagger: tagging trace set: gauss with 45622 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 45622 traces tagged "gauss"
FrameSaver: q=4.08775e+06 n=710020 tag=gauss
wclsFrameSaver: saving 51916 traces tagged "wiener"
FrameSaver: q=4.41537e+06 n=638664 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 40401 traces, 40401 summary
Retagger: tagging trace set: gauss with 37449 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 37449 traces tagged "gauss"
FrameSaver: q=2.78932e+06 n=582195 tag=gauss
wclsFrameSaver: saving 40401 traces tagged "wiener"
FrameSaver: q=2.96384e+06 n=530254 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 54991 traces, 54991 summary
Retagger: tagging trace set: gauss with 48085 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 48085 traces tagged "gauss"
FrameSaver: q=3.98011e+06 n=736923 tag=gauss
wclsFrameSaver: saving 54991 traces tagged "wiener"
FrameSaver: q=4.23e+06 n=644172 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 39591 traces, 39591 summary
Retagger: tagging trace set: gauss with 37752 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 37752 traces tagged "gauss"
FrameSaver: q=3.09898e+06 n=580194 tag=gauss
wclsFrameSaver: saving 39591 traces tagged "wiener"
FrameSaver: q=3.27832e+06 n=526224 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 45503 traces, 45503 summary
Retagger: tagging trace set: gauss with 40489 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 40489 traces tagged "gauss"
FrameSaver: q=3.34149e+06 n=589678 tag=gauss
wclsFrameSaver: saving 45503 traces tagged "wiener"
FrameSaver: q=3.57705e+06 n=518495 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 39886 traces, 39886 summary
Retagger: tagging trace set: gauss with 37460 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 37460 traces tagged "gauss"
FrameSaver: q=2.57752e+06 n=556320 tag=gauss
wclsFrameSaver: saving 39886 traces tagged "wiener"
FrameSaver: q=2.71968e+06 n=494922 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 40572 traces, 40572 summary
Retagger: tagging trace set: gauss with 38183 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 38183 traces tagged "gauss"
FrameSaver: q=3.05262e+06 n=602314 tag=gauss
wclsFrameSaver: saving 40572 traces tagged "wiener"
FrameSaver: q=3.24586e+06 n=549835 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 39498 traces, 39498 summary
Retagger: tagging trace set: gauss with 36040 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 36040 traces tagged "gauss"
FrameSaver: q=2.95644e+06 n=498348 tag=gauss
wclsFrameSaver: saving 39498 traces tagged "wiener"
FrameSaver: q=3.27526e+06 n=444554 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 34337 traces, 34337 summary
Retagger: tagging trace set: gauss with 33326 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 33326 traces tagged "gauss"
FrameSaver: q=1.97824e+06 n=458698 tag=gauss
wclsFrameSaver: saving 34337 traces tagged "wiener"
FrameSaver: q=2.11143e+06 n=409621 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 39402 traces, 39402 summary
Retagger: tagging trace set: gauss with 36934 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 36934 traces tagged "gauss"
FrameSaver: q=2.57129e+06 n=554188 tag=gauss
wclsFrameSaver: saving 39402 traces tagged "wiener"
FrameSaver: q=2.71754e+06 n=498533 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 44009 traces, 44009 summary
Retagger: tagging trace set: gauss with 40138 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 40138 traces tagged "gauss"
FrameSaver: q=3.28141e+06 n=622842 tag=gauss
wclsFrameSaver: saving 44009 traces tagged "wiener"
FrameSaver: q=3.53067e+06 n=558835 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 39640 traces, 39640 summary
Retagger: tagging trace set: gauss with 35950 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 35950 traces tagged "gauss"
FrameSaver: q=2.88792e+06 n=524795 tag=gauss
wclsFrameSaver: saving 39640 traces tagged "wiener"
FrameSaver: q=3.1086e+06 n=464905 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 39886 traces, 39886 summary
Retagger: tagging trace set: gauss with 35663 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 35663 traces tagged "gauss"
FrameSaver: q=2.33751e+06 n=486982 tag=gauss
wclsFrameSaver: saving 39886 traces tagged "wiener"
FrameSaver: q=2.52218e+06 n=422588 tag=wiener

ls: cannot access *larcvpdsp*.root: No such file or directory
Output files:
 larcv files: 
formed
{
  "name": "",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_16_00d00",
    "core.data_tier": "root-tuple-virtual",
    "core.runs": null,
    "core.runs_subruns": null,
    "dune.config_file": "run_supera_pdunesp_mpvmpr_d.fcl",
    "dune.campaign": "sp-protodune-spine-reco",
    "core.start_time": 1769177755.0,
    "core.end_time": 1769181993.0
  }
}
justIN time: 2026-02-04 04:32:54 UTC       justIN version: 01.06.00