justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267737.1@dunegpschedd01.fnal.gov

Jobsub ID267737.1@dunegpschedd01.fnal.gov
Workflow ID11202
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-13 04:58:14
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-13 05:02:16
From worker nodeHostnamedunegli-7890616-0-fnpc23048.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 04:59:43
Input filesmonte-carlo-011202-000001
JobscriptExit code0
Real time1m (110s)
CPU time0m (55s = 49%)
Max RSS bytes991547392 (945 MiB)
Outputting started2025-12-13 05:01:33
Output files
Finished2025-12-13 05:02:16
Saved logsjustin-logs:267737.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

pe: DT_UINT16 } } }') for unknown op: BitwiseOr
2025-12-13 05:01:20.149339: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseOr
2025-12-13 05:01:20.149349: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseOr
2025-12-13 05:01:20.149358: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseOr
2025-12-13 05:01:20.149369: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseOr
2025-12-13 05:01:20.149379: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseOr" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseOr
2025-12-13 05:01:20.149438: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "LookupTableImport" device_type: "CPU"') for unknown op: LookupTableImport
2025-12-13 05:01:20.149504: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: BitwiseXor
2025-12-13 05:01:20.149514: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: BitwiseXor
2025-12-13 05:01:20.149533: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: BitwiseXor
2025-12-13 05:01:20.149543: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseXor
2025-12-13 05:01:20.149556: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseXor
2025-12-13 05:01:20.149567: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseXor
2025-12-13 05:01:20.149577: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseXor
2025-12-13 05:01:20.149585: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseXor" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseXor
2025-12-13 05:01:20.149644: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: Invert
2025-12-13 05:01:20.149654: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: Invert
2025-12-13 05:01:20.149663: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: Invert
2025-12-13 05:01:20.149672: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: Invert
2025-12-13 05:01:20.149682: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: Invert
2025-12-13 05:01:20.149692: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: Invert
2025-12-13 05:01:20.149703: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: Invert
2025-12-13 05:01:20.149712: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "Invert" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: Invert
2025-12-13 05:01:20.149764: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT64 } } }') for unknown op: BitwiseAnd
2025-12-13 05:01:20.149775: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT32 } } }') for unknown op: BitwiseAnd
2025-12-13 05:01:20.149784: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: BitwiseAnd
2025-12-13 05:01:20.149794: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: BitwiseAnd
2025-12-13 05:01:20.149802: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: BitwiseAnd
2025-12-13 05:01:20.149819: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: BitwiseAnd
2025-12-13 05:01:20.149828: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: BitwiseAnd
2025-12-13 05:01:20.149837: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "BitwiseAnd" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: BitwiseAnd
2025-12-13 05:01:20.150218: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT64 } } }') for unknown op: PopulationCount
2025-12-13 05:01:20.150232: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT32 } } }') for unknown op: PopulationCount
2025-12-13 05:01:20.150242: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT16 } } }') for unknown op: PopulationCount
2025-12-13 05:01:20.150252: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT16 } } }') for unknown op: PopulationCount
2025-12-13 05:01:20.150261: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_INT8 } } }') for unknown op: PopulationCount
2025-12-13 05:01:20.150272: E tensorflow/core/framework/op_kernel.cc:1197] OpKernel ('op: "PopulationCount" device_type: "CPU" constraint { name: "T" allowed_values { list { type: DT_UINT8 } } }') for unknown op: PopulationCount
Inputer: "wclsCookedFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
MultiPandoraApiImpl::DeletePandoraInstances - unable to find daughter instances associated with primary 0
MultiPandoraApiImpl::DeletePandoraInstances - unable to find daughter instances associated with primary 0
ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  13-Dec-2025 05:01:32 UTC ModuleConstruction
cet::exception caught in art
---- CatalogServiceError BEGIN
  Input file not found: detsim_stage2.root.
---- CatalogServiceError END
%MSG
Art has completed and will exit with status 24.
lar exit code 24
.:
total 156
-rw-r--r-- 1 dunegli fnalgrid 81420 Dec 13 05:01 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 13 05:01 mem.db
-rw-r--r-- 1 dunegli fnalgrid 16384 Dec 13 05:01 time.db
-rw-r--r-- 1 dunegli fnalgrid   519 Dec 13 05:01 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid   519 Dec 13 05:00 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid   519 Dec 13 05:01 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid    52 Dec 13 04:59 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid     7 Dec 13 05:01 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid     0 Dec 13 05:01 debugprod.log
justIN time: 2025-12-20 00:05:30 UTC       justIN version: 01.05.03