justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 16859.1@dunegpschedd01.fnal.gov

Jobsub ID16859.1@dunegpschedd01.fnal.gov
Workflow ID14
Stage ID1
User nameamcnab@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-21 12:02:51
SiteCA_Victoria
EntryDUNE_CA_Victoria_dune-condor_whole
Last heartbeat2025-07-21 23:29:42
From worker nodeHostnamedune--arbutus--3456932580--112824028104746
cpuinfoIntel Core Processor (Broadwell, IBRS)
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-07-21 12:04:33
Input filesjustin-tutorial:tut_np02bde_307160012_np02_bde_coldbox_run012352_0055_20211216T000712.hdf5
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-07-21 23:29:42
Saved logsjustin-logs:16859.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/justin-tutorial/09/9c/tut_np02bde_307160012_np02_bde_coldbox_run012352_0055_20211216T000712.hdf5
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e20-p3913-prof/lib/libXrdPosixPreload.so
../justin-jobscript: line 73:  1127 Killed                  lar -c $FCL_FILE $events_option -o $outFile "$pfn" > ${fname}_reco_${now}.log 2>&1
=== Start last 100 lines of lar log file ===
DuneDeconvolutionService::ctor: DuneDeconvolutionService:
DuneDeconvolutionService::ctor:                LogLevel: 1
DuneRoiBuildingService::ctor: DuneRoiBuildingService:
DuneRoiBuildingService::ctor:     LogLevel: 1
DuneRoiBuildingService::ctor:  NSigmaStart: 3
DuneRoiBuildingService::ctor:    NSigmaEnd: 1
DuneRoiBuildingService::ctor:       PadLow: 50
DuneRoiBuildingService::ctor:      PadHigh: 50
StandardAdcWireBuildingService::ctor: StandardAdcWireBuildingService:
StandardAdcWireBuildingService::ctor:     LogLevel: 1
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_75_00d00/gdml/dunevdcb1_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Error: Unsupported GDML Tag Used :gdml_simple_extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 320
Info in <TGeoManager::CloseGeometry>: 3483 nodes/ 270 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
GeoApaChannelGroupService::ctor: Group 0 (apa0) has 1600 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 1 (apa1) has 1600 channels from 3/3 readout planes.
VD Coldbox Channel Map: Building TPC wiremap from file vdcbce_chanmap_v2_dcchan3200.txt
DuneToolManager::fclFilename: Taking fcl name from command line: lar -c vdcoldbox_raw_dataprep_reco.fcl -n 1 -o tut_np02bde_307160012_np02_bde_coldbox_run012352_0055_20211216T000712_reco_data_2025-07-21T_120449Z.root root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/justin-tutorial/09/9c/tut_np02bde_307160012_np02_bde_coldbox_run012352_0055_20211216T000712.hdf5
=== End last 100 lines of lar log file ===
lar exit code 0
Traceback (most recent call last):
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_00d00/bin/extractor_prod.py", line 434, in <module>
    main()
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_00d00/bin/extractor_prod.py", line 373, in main
    mddict = expSpecificMetadata.getmetadata()
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_00d00/bin/extractor_prod.py", line 344, in getmetadata
    jobt = self.get_job(proc)
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_00d00/bin/extractor_prod.py", line 69, in get_job
    raise RuntimeError('sam_metadata_dumper returned nonzero exit status {}.'.format(rc))
RuntimeError: sam_metadata_dumper returned nonzero exit status 1.
extractor_prod.py exit code 1
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
pdjson2metadata exit code 1
.:
total 48
-rw-r--r-- 1 slot01 slot01 28672 Jul 21 19:22 mem.db
-rw-r--r-- 1 slot01 slot01  4232 Jul 21 23:28 jobscript.log
-rw-r--r-- 1 slot01 slot01  2643 Jul 21 19:23 tut_np02bde_307160012_np02_bde_coldbox_run012352_0055_20211216T000712_reco_2025-07-21T_120449Z.log
-rw-r--r-- 1 slot01 slot01   182 Jul 21 12:04 all-input-dids.txt
-rw-r--r-- 1 slot01 slot01     0 Jul 21 19:17 debugprod.log
-rw-r--r-- 1 slot01 slot01     0 Jul 21 22:22 tut_np02bde_307160012_np02_bde_coldbox_run012352_0055_20211216T000712_reco_data_2025-07-21T_120449Z.root.ext.json
-rw-r--r-- 1 slot01 slot01     0 Jul 21 23:28 tut_np02bde_307160012_np02_bde_coldbox_run012352_0055_20211216T000712_reco_data_2025-07-21T_120449Z.root.json
justIN time: 2025-08-04 21:36:50 UTC       justIN version: 01.04.00