justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267771.1@dunegpschedd02.fnal.gov

Jobsub ID267771.1@dunegpschedd02.fnal.gov
Workflow ID11673
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-10 10:39:26
SiteCA_Victoria
EntryDUNE_CA_Victoria_dune-condor_whole
Last heartbeat2026-01-10 14:01:40
From worker nodeHostnamedune--arbutus--3456932580--218442528117589-1
cpuinfoIntel Xeon Processor (Skylake, IBRS)
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-10 10:40:38
Input filesmonte-carlo-011673-000001
JobscriptExit code0
Real time3h (12037s)
CPU time19m (1162s = 9%)
Max RSS bytes98816000 (94 MiB)
Outputting started2026-01-10 14:01:16
Output files
Finished2026-01-10 14:01:40
Saved logsjustin-logs:267771.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseOr
2026-01-10 13:53:34.340418: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseOr
2026-01-10 13:53:34.340455: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseOr
2026-01-10 13:53:34.340500: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseOr
2026-01-10 13:53:34.340528: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseOr
2026-01-10 13:53:34.341422: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "LookupTableImport" device_type: "CPU"') for unknown op: LookupTableImport
2026-01-10 13:53:34.342113: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: BitwiseXor
2026-01-10 13:53:34.342166: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: BitwiseXor
2026-01-10 13:53:34.342198: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: BitwiseXor
2026-01-10 13:53:34.342227: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseXor
2026-01-10 13:53:34.342256: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseXor
2026-01-10 13:53:34.342284: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseXor
2026-01-10 13:53:34.342314: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseXor
2026-01-10 13:53:34.342342: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseXor
2026-01-10 13:53:34.343847: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: Invert
2026-01-10 13:53:34.343944: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: Invert
2026-01-10 13:53:34.343987: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: Invert
2026-01-10 13:53:34.344023: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: Invert
2026-01-10 13:53:34.344047: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: Invert
2026-01-10 13:53:34.344071: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: Invert
2026-01-10 13:53:34.344094: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: Invert
2026-01-10 13:53:34.344118: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: Invert
2026-01-10 13:53:34.344220: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: BitwiseAnd
2026-01-10 13:53:34.344245: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: BitwiseAnd
2026-01-10 13:53:34.344290: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: BitwiseAnd
2026-01-10 13:53:34.344315: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseAnd
2026-01-10 13:53:34.344339: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseAnd
2026-01-10 13:53:34.344362: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseAnd
2026-01-10 13:53:34.344385: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseAnd
2026-01-10 13:53:34.344408: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseAnd
2026-01-10 13:53:34.354221: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: PopulationCount
2026-01-10 13:53:34.354304: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: PopulationCount
2026-01-10 13:53:34.354334: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: PopulationCount
2026-01-10 13:53:34.354358: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: PopulationCount
2026-01-10 13:53:34.354376: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: PopulationCount
2026-01-10 13:53:34.354395: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: PopulationCount
Inputer: "wclsCookedFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
MultiPandoraApiImpl::DeletePandoraInstances - unable to find daughter instances associated with primary 0
MultiPandoraApiImpl::DeletePandoraInstances - unable to find daughter instances associated with primary 0
ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  10-Jan-2026 14:01:02 UTC ModuleConstruction
cet::exception caught in art
---- CatalogServiceError BEGIN
  Input file not found: detsim_stage2.root.
---- CatalogServiceError END
%MSG
Art has completed and will exit with status 24.
lar exit code 24
.:
total 342668
-rw-r--r-- 1 slot01 slot01 350666925 Jan 10 13:30 RootOutput-f891-ccba-d93a-ba0d.root
-rw-r--r-- 1 slot01 slot01    127657 Jan 10 14:01 jobscript.log
-rw-r--r-- 1 slot01 slot01     36864 Jan 10 14:01 mem.db
-rw-r--r-- 1 slot01 slot01     16384 Jan 10 13:53 time.db
-rw-r--r-- 1 slot01 slot01       519 Jan 10 13:51 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 slot01 slot01       519 Jan 10 13:31 g4_protoDUNE_hist.root
-rw-r--r-- 1 slot01 slot01       519 Jan 10 14:01 protoDUNE_reco1_hist.root
-rw-r--r-- 1 slot01 slot01       274 Jan 10 10:44 TFileService-319e-fc89-52ca-93ef.root
-rw-r--r-- 1 slot01 slot01        52 Jan 10 10:40 all-input-dids.txt
-rw-r--r-- 1 slot01 slot01         7 Jan 10 14:01 justin-processed-pfns.txt
-rw-r--r-- 1 slot01 slot01         0 Jan 10 13:51 debugprod.log
justIN time: 2026-02-06 12:56:22 UTC       justIN version: 01.06.00