justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266071.0@dunegpschedd02.fnal.gov

Jobsub ID266071.0@dunegpschedd02.fnal.gov
Workflow ID11527
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-05 08:00:05
SiteCA_Victoria
EntryDUNE_CA_Victoria_dune-condor_whole
Last heartbeat2026-01-05 22:19:31
From worker nodeHostnamedune--arbutus--3456932580--273829438399019
cpuinfoIntel Core Processor (Broadwell, IBRS)
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-05 08:05:37
Input filesmonte-carlo-011527-000001
JobscriptExit code0
Real time14h (51213s)
CPU time38m (2294s = 4%)
Max RSS bytes113315840 (108 MiB)
Outputting started2026-01-05 22:19:11
Output files
Finished2026-01-05 22:19:31
Saved logsjustin-logs:266071.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

rnel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseOr
2026-01-05 22:18:22.452599: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseOr
2026-01-05 22:18:22.452613: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseOr
2026-01-05 22:18:22.452630: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseOr
2026-01-05 22:18:22.452645: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseOr
2026-01-05 22:18:22.453346: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "LookupTableImport" device_type: "CPU"') for unknown op: LookupTableImport
2026-01-05 22:18:22.453426: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: BitwiseXor
2026-01-05 22:18:22.453443: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: BitwiseXor
2026-01-05 22:18:22.453457: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: BitwiseXor
2026-01-05 22:18:22.453472: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseXor
2026-01-05 22:18:22.453486: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseXor
2026-01-05 22:18:22.453500: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseXor
2026-01-05 22:18:22.453515: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseXor
2026-01-05 22:18:22.453529: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseXor
2026-01-05 22:18:22.453591: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: Invert
2026-01-05 22:18:22.453607: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: Invert
2026-01-05 22:18:22.453621: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: Invert
2026-01-05 22:18:22.453636: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: Invert
2026-01-05 22:18:22.453650: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: Invert
2026-01-05 22:18:22.453825: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: Invert
2026-01-05 22:18:22.453847: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: Invert
2026-01-05 22:18:22.453861: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: Invert
2026-01-05 22:18:22.453907: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: BitwiseAnd
2026-01-05 22:18:22.453939: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: BitwiseAnd
2026-01-05 22:18:22.453956: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: BitwiseAnd
2026-01-05 22:18:22.453970: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseAnd
2026-01-05 22:18:22.453985: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseAnd
2026-01-05 22:18:22.453999: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseAnd
2026-01-05 22:18:22.454013: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseAnd
2026-01-05 22:18:22.454027: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseAnd
2026-01-05 22:18:22.458629: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: PopulationCount
2026-01-05 22:18:22.458661: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: PopulationCount
2026-01-05 22:18:22.458677: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: PopulationCount
2026-01-05 22:18:22.458691: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: PopulationCount
2026-01-05 22:18:22.458706: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: PopulationCount
2026-01-05 22:18:22.458720: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: PopulationCount
Inputer: "wclsCookedFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
MultiPandoraApiImpl::DeletePandoraInstances - unable to find daughter instances associated with primary 0
MultiPandoraApiImpl::DeletePandoraInstances - unable to find daughter instances associated with primary 0
ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  05-Jan-2026 22:19:06 UTC ModuleConstruction
cet::exception caught in art
---- CatalogServiceError BEGIN
  Input file not found: detsim_stage2.root.
---- CatalogServiceError END
%MSG
Art has completed and will exit with status 24.
lar exit code 24
.:
total 1581312
-rw-r--r-- 1 slot01 slot01 1619013762 Jan  5 22:10 RootOutput-ce8c-a922-f69f-2242.root
-rw-r--r-- 1 slot01 slot01     157008 Jan  5 22:19 jobscript.log
-rw-r--r-- 1 slot01 slot01      36864 Jan  5 22:19 mem.db
-rw-r--r-- 1 slot01 slot01      16384 Jan  5 22:18 time.db
-rw-r--r-- 1 slot01 slot01        519 Jan  5 22:18 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 slot01 slot01        519 Jan  5 22:13 g4_protoDUNE_hist.root
-rw-r--r-- 1 slot01 slot01        519 Jan  5 22:19 protoDUNE_reco1_hist.root
-rw-r--r-- 1 slot01 slot01         52 Jan  5 08:05 all-input-dids.txt
-rw-r--r-- 1 slot01 slot01          7 Jan  5 22:19 justin-processed-pfns.txt
-rw-r--r-- 1 slot01 slot01          0 Jan  5 22:18 debugprod.log
justIN time: 2026-02-06 19:43:17 UTC       justIN version: 01.06.00