justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 252009.1@dunegpschedd02.fnal.gov

Jobsub ID252009.1@dunegpschedd02.fnal.gov
Workflow ID10686
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-11-25 19:06:36
SiteCA_Victoria
EntryDUNE_CA_Victoria_dune-condor_whole
Last heartbeat2025-11-25 22:30:25
From worker nodeHostnamedune--arbutus--3456932580--46331684364072
cpuinfoIntel Xeon Processor (Skylake, IBRS)
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-25 19:09:11
Input filesmonte-carlo-010686-000001
JobscriptExit code0
Real time3h (11971s)
CPU time19m (1175s = 9%)
Max RSS bytes64737280 (61 MiB)
Outputting started2025-11-25 22:28:45
Output files
Finished2025-11-25 22:30:25
Saved logsjustin-logs:252009.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

vice_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseOr
2025-11-25 21:35:20.301795: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseOr
2025-11-25 21:35:20.308079: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseOr
2025-11-25 21:35:20.308153: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseOr
2025-11-25 21:35:20.308184: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseOr
2025-11-25 21:35:20.329420: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "LookupTableImport" device_type: "CPU"') for unknown op: LookupTableImport
2025-11-25 21:35:20.333191: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: BitwiseXor
2025-11-25 21:35:20.333256: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: BitwiseXor
2025-11-25 21:35:20.333287: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: BitwiseXor
2025-11-25 21:35:20.333317: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseXor
2025-11-25 21:35:20.333345: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseXor
2025-11-25 21:35:20.333373: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseXor
2025-11-25 21:35:20.333412: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseXor
2025-11-25 21:35:20.333441: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseXor
2025-11-25 21:35:20.380046: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: Invert
2025-11-25 21:35:20.380173: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: Invert
2025-11-25 21:35:20.380210: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: Invert
2025-11-25 21:35:20.380239: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: Invert
2025-11-25 21:35:20.380269: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: Invert
2025-11-25 21:35:20.380298: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: Invert
2025-11-25 21:35:20.380325: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: Invert
2025-11-25 21:35:20.380354: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: Invert
2025-11-25 21:35:20.421841: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: BitwiseAnd
2025-11-25 21:35:20.421920: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: BitwiseAnd
2025-11-25 21:35:20.429566: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: BitwiseAnd
2025-11-25 21:35:20.429636: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseAnd
2025-11-25 21:35:20.429667: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseAnd
2025-11-25 21:35:20.429713: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseAnd
2025-11-25 21:35:20.429742: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseAnd
2025-11-25 21:35:20.429862: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseAnd
2025-11-25 21:35:20.624657: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: PopulationCount
2025-11-25 21:35:20.624763: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: PopulationCount
2025-11-25 21:35:20.624799: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: PopulationCount
2025-11-25 21:35:20.624830: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: PopulationCount
2025-11-25 21:35:20.624859: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: PopulationCount
2025-11-25 21:35:20.624890: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: PopulationCount
Inputer: "wclsCookedFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
MultiPandoraApiImpl::DeletePandoraInstances - unable to find daughter instances associated with primary 0
MultiPandoraApiImpl::DeletePandoraInstances - unable to find daughter instances associated with primary 0
ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  25-Nov-2025 22:27:08 UTC ModuleConstruction
cet::exception caught in art
---- CatalogServiceError BEGIN
  Input file not found: detsim_stage2.root.
---- CatalogServiceError END
%MSG
Art has completed and will exit with status 24.
lar exit code 24
.:
total 208
-rw-r--r-- 1 slot01 slot01 122770 Nov 25 22:28 jobscript.log
-rw-r--r-- 1 slot01 slot01  36864 Nov 25 22:27 mem.db
-rw-r--r-- 1 slot01 slot01  16384 Nov 25 21:34 time.db
-rw-r--r-- 1 slot01 slot01    519 Nov 25 21:17 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 slot01 slot01    519 Nov 25 20:36 g4_protoDUNE_hist.root
-rw-r--r-- 1 slot01 slot01    519 Nov 25 22:27 protoDUNE_reco1_hist.root
-rw-r--r-- 1 slot01 slot01    274 Nov 25 20:47 TFileService-74c9-5f75-ab58-e41a.root
-rw-r--r-- 1 slot01 slot01    274 Nov 25 19:19 TFileService-8672-c23a-f23f-421e.root
-rw-r--r-- 1 slot01 slot01     52 Nov 25 19:09 all-input-dids.txt
-rw-r--r-- 1 slot01 slot01      7 Nov 25 22:28 justin-processed-pfns.txt
-rw-r--r-- 1 slot01 slot01      0 Nov 25 21:18 debugprod.log
justIN time: 2025-12-19 05:14:32 UTC       justIN version: 01.05.03