justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 277793.0@dunegpschedd01.fnal.gov

Jobsub ID277793.0@dunegpschedd01.fnal.gov
Workflow ID11902
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-14 14:28:39
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce16-multicore
Last heartbeat2026-01-14 14:30:51
From worker nodeHostnamehnode72.pic.es
cpuinfoAMD EPYC 7443P 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-14 14:29:35
Input filesmonte-carlo-011902-000001
JobscriptExit code0
Real time0m (58s)
CPU time0m (48s = 82%)
Max RSS bytes991395840 (945 MiB)
Outputting started2026-01-14 14:30:34
Output files
Finished2026-01-14 14:30:51
Saved logsjustin-logs:277793.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: BitwiseOr
2026-01-14 15:30:21.970886: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseOr
2026-01-14 15:30:21.970899: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseOr
2026-01-14 15:30:21.970913: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseOr
2026-01-14 15:30:21.970926: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseOr
2026-01-14 15:30:21.970939: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseOr
2026-01-14 15:30:21.970974: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "LookupTableImport" device_type: "CPU"') for unknown op: LookupTableImport
2026-01-14 15:30:21.971019: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: BitwiseXor
2026-01-14 15:30:21.971035: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: BitwiseXor
2026-01-14 15:30:21.971057: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: BitwiseXor
2026-01-14 15:30:21.971077: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseXor
2026-01-14 15:30:21.971094: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseXor
2026-01-14 15:30:21.971110: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseXor
2026-01-14 15:30:21.971125: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseXor
2026-01-14 15:30:21.971141: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseXor
2026-01-14 15:30:21.971183: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: Invert
2026-01-14 15:30:21.971197: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: Invert
2026-01-14 15:30:21.971209: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: Invert
2026-01-14 15:30:21.971223: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: Invert
2026-01-14 15:30:21.971234: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: Invert
2026-01-14 15:30:21.971243: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: Invert
2026-01-14 15:30:21.971252: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: Invert
2026-01-14 15:30:21.971261: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: Invert
2026-01-14 15:30:21.971284: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: BitwiseAnd
2026-01-14 15:30:21.971295: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: BitwiseAnd
2026-01-14 15:30:21.971309: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: BitwiseAnd
2026-01-14 15:30:21.971323: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseAnd
2026-01-14 15:30:21.971337: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseAnd
2026-01-14 15:30:21.971600: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseAnd
2026-01-14 15:30:21.971625: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseAnd
2026-01-14 15:30:21.971640: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseAnd
2026-01-14 15:30:21.971771: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: PopulationCount
2026-01-14 15:30:21.971793: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: PopulationCount
2026-01-14 15:30:21.971808: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: PopulationCount
2026-01-14 15:30:21.971821: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: PopulationCount
2026-01-14 15:30:21.971834: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: PopulationCount
2026-01-14 15:30:21.971875: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: PopulationCount
Inputer: "wclsCookedFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
MultiPandoraApiImpl::DeletePandoraInstances - unable to find daughter instances associated with primary 0
MultiPandoraApiImpl::DeletePandoraInstances - unable to find daughter instances associated with primary 0
ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  14-Jan-2026 15:30:33 CET ModuleConstruction
cet::exception caught in art
---- CatalogServiceError BEGIN
  Input file not found: detsim_stage2.root.
---- CatalogServiceError END
%MSG
Art has completed and will exit with status 24.
lar exit code 24
.:
total 160
-rw-r--r-- 1 dune001 dune 81420 Jan 14 15:30 jobscript.log
-rw-r--r-- 1 dune001 dune 36864 Jan 14 15:30 mem.db
-rw-r--r-- 1 dune001 dune 16384 Jan 14 15:30 time.db
-rw-r--r-- 1 dune001 dune   519 Jan 14 15:30 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune   519 Jan 14 15:29 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune   519 Jan 14 15:30 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune    52 Jan 14 15:29 all-input-dids.txt
-rw-r--r-- 1 dune001 dune     7 Jan 14 15:30 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune     0 Jan 14 15:30 debugprod.log
justIN time: 2026-02-06 03:34:15 UTC       justIN version: 01.06.00