justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 271743.2@dunegpschedd02.fnal.gov

Jobsub ID271743.2@dunegpschedd02.fnal.gov
Workflow ID11746
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-13 23:13:52
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk_multicore
Last heartbeat2026-01-14 00:48:47
From worker nodeHostnamewn-lot-011.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-13 23:58:25
Input filesmonte-carlo-011746-000039
JobscriptExit code0
Real time50m (3000s)
CPU time48m (2883s = 96%)
Max RSS bytes2470993920 (2356 MiB)
Outputting started2026-01-14 00:48:27
Output files
Finished2026-01-14 00:48:47
Saved logsjustin-logs:271743.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ts
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 47078 traces, 47078 summary
Retagger: tagging trace set: gauss with 42714 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 42714 traces tagged "gauss"
FrameSaver: q=636721 n=511008 tag=gauss
wclsFrameSaver: saving 47078 traces tagged "wiener"
FrameSaver: q=895220 n=526357 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 43228 traces, 43228 summary
Retagger: tagging trace set: gauss with 39847 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39847 traces tagged "gauss"
FrameSaver: q=463965 n=465444 tag=gauss
wclsFrameSaver: saving 43228 traces tagged "wiener"
FrameSaver: q=642670 n=481044 tag=wiener

Error in processing reco
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  crtreco
  crttag
  emtrkmichelid
  hitpdune
  pandora
  pandora2GnocchiCalo
  pandora2GnocchiCalonosce
  pandora2Shower
  pandora2Showercalo
  pandora2Showercalonosce
  pandora2Track
  pandora2calo
  pandora2calonosce
  pandoraGnocchiCalo
  pandoraGnocchiCalonosce
  pandoraShower
  pandoraShowercalo
  pandoraShowercalonosce
  pandoraTrack
  pandoraWriter
  pandoracalo
  pandoracalonosce
  pandorapid
  reco3d
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_15_00d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
14-Jan-2026 01:33:58 CET  Initiating request to open input file "prod_mpvmpr_protodunehd_1_271743_2_1768348715_gen_g4_stage1_detsim.root"
14-Jan-2026 01:33:58 CET  Opened input file "prod_mpvmpr_protodunehd_1_271743_2_1768348715_gen_g4_stage1_detsim.root"
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 43384 traces, 43384 summary
Retagger: tagging trace set: gauss with 40686 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 40686 traces tagged "gauss"
FrameSaver: q=673443 n=556035 tag=gauss
wclsFrameSaver: saving 43384 traces tagged "wiener"
FrameSaver: q=869974 n=587527 tag=wiener
14-Jan-2026 01:34:55 CET  Opened output file with pattern "prod_mpvmpr_protodunehd_1_271743_2_1768348715_gen_g4_stage1_detsim_reco.root"
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 49610 traces, 49610 summary
Retagger: tagging trace set: gauss with 45145 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 45145 traces tagged "gauss"
FrameSaver: q=799639 n=547634 tag=gauss
wclsFrameSaver: saving 49610 traces tagged "wiener"
FrameSaver: q=1.11409e+06 n=579235 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 50639 traces, 50639 summary
Retagger: tagging trace set: gauss with 46593 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 46593 traces tagged "gauss"
FrameSaver: q=857955 n=637787 tag=gauss
wclsFrameSaver: saving 50639 traces tagged "wiener"
FrameSaver: q=1.07516e+06 n=648128 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 49028 traces, 49028 summary
Retagger: tagging trace set: gauss with 44553 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 44553 traces tagged "gauss"
FrameSaver: q=748158 n=591982 tag=gauss
wclsFrameSaver: saving 49028 traces tagged "wiener"
FrameSaver: q=949755 n=596408 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 49421 traces, 49421 summary
Retagger: tagging trace set: gauss with 45026 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 45026 traces tagged "gauss"
FrameSaver: q=826587 n=604511 tag=gauss
wclsFrameSaver: saving 49421 traces tagged "wiener"
FrameSaver: q=1.08676e+06 n=613971 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 38228 traces, 38228 summary
Retagger: tagging trace set: gauss with 36931 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 36931 traces tagged "gauss"
FrameSaver: q=432715 n=433380 tag=gauss
wclsFrameSaver: saving 38228 traces tagged "wiener"
FrameSaver: q=596560 n=459554 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 46720 traces, 46720 summary
Retagger: tagging trace set: gauss with 42448 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 42448 traces tagged "gauss"
FrameSaver: q=730748 n=528127 tag=gauss
wclsFrameSaver: saving 46720 traces tagged "wiener"
FrameSaver: q=982657 n=545446 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 48581 traces, 48581 summary
Retagger: tagging trace set: gauss with 43546 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 43546 traces tagged "gauss"
FrameSaver: q=761502 n=571193 tag=gauss
wclsFrameSaver: saving 48581 traces tagged "wiener"
FrameSaver: q=994217 n=576574 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 40086 traces, 40086 summary
Retagger: tagging trace set: gauss with 38294 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 38294 traces tagged "gauss"
FrameSaver: q=460954 n=458782 tag=gauss
wclsFrameSaver: saving 40086 traces tagged "wiener"
FrameSaver: q=648514 n=484276 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 48175 traces, 48175 summary
Retagger: tagging trace set: gauss with 43163 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 43163 traces tagged "gauss"
FrameSaver: q=723309 n=553179 tag=gauss
wclsFrameSaver: saving 48175 traces tagged "wiener"
FrameSaver: q=937139 n=568520 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 41066 traces, 41066 summary
Retagger: tagging trace set: gauss with 39157 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39157 traces tagged "gauss"
FrameSaver: q=449329 n=453336 tag=gauss
wclsFrameSaver: saving 41066 traces tagged "wiener"
FrameSaver: q=650603 n=478702 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 37778 traces, 37778 summary
Retagger: tagging trace set: gauss with 36595 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 36595 traces tagged "gauss"
FrameSaver: q=344271 n=389203 tag=gauss
wclsFrameSaver: saving 37778 traces tagged "wiener"
FrameSaver: q=521740 n=418169 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 44888 traces, 44888 summary
Retagger: tagging trace set: gauss with 41653 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 41653 traces tagged "gauss"
FrameSaver: q=605043 n=489826 tag=gauss
wclsFrameSaver: saving 44888 traces tagged "wiener"
FrameSaver: q=891050 n=512044 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 47078 traces, 47078 summary
Retagger: tagging trace set: gauss with 42714 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 42714 traces tagged "gauss"
FrameSaver: q=636721 n=511008 tag=gauss
wclsFrameSaver: saving 47078 traces tagged "wiener"
FrameSaver: q=895220 n=526357 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 43228 traces, 43228 summary
Retagger: tagging trace set: gauss with 39847 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39847 traces tagged "gauss"
FrameSaver: q=463965 n=465444 tag=gauss
wclsFrameSaver: saving 43228 traces tagged "wiener"
FrameSaver: q=642670 n=481044 tag=wiener

ls: cannot access *_g4_stage2.root: No such file or directory
ls: cannot access *_reco.root: No such file or directory
Forming g4 metadata
Forming reco metadata
justIN time: 2026-02-06 09:01:34 UTC       justIN version: 01.06.00