justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 237408.0@dunegpschedd02.fnal.gov

Jobsub ID237408.0@dunegpschedd02.fnal.gov
Workflow ID9593
Stage ID1
User nameweishi@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit12000 (3 hours)
Submitted time2025-11-04 18:00:22
SiteCA_SFU
EntryDUNE_CA_SFU_lcg-ce3
Last heartbeat2025-11-04 18:06:47
From worker nodeHostnamefc30562.int.fir.alliancecan.ca
cpuinfoAMD EPYC 9655 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit84598 (23 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-04 18:03:32
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T235814Z_gen_003424_supernova_g4stage1_g4stage2_detsim_reco_20250627T074235Z_reco2.root
JobscriptExit code0
Real time3m (186s)
CPU time0m (3s = 1%)
Max RSS bytes256749568 (244 MiB)
Outputting started2025-11-04 18:06:38
Output files
Finished2025-11-04 18:06:47
Saved logsjustin-logs:237408.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

000)
	libcrypto.so.10 => /lib64/libcrypto.so.10 (0x00001466bd200000)
	libboost_regex.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_regex.so.1.82.0 (0x00001466bce00000)
	libboost_filesystem.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_filesystem.so.1.82.0 (0x00001466bca00000)
	libboost_atomic.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_atomic.so.1.82.0 (0x00001466bc600000)
	libcetlib_except.so => /cvmfs/larsoft.opensciencegrid.org/products/cetlib_except/v1_09_01/slf7.x86_64.e26.prof/lib/libcetlib_except.so (0x00001466bc200000)
	libboost_date_time.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_date_time.so.1.82.0 (0x00001466bbe00000)
	libCLHEP-Vector-2.4.7.1.so => /cvmfs/larsoft.opensciencegrid.org/products/clhep/v2_4_7_1/Linux64bit+3.10-2.17-e26-prof/lib/libCLHEP-Vector-2.4.7.1.so (0x00001466bba00000)
	libCLHEP-Random-2.4.7.1.so => /cvmfs/larsoft.opensciencegrid.org/products/clhep/v2_4_7_1/Linux64bit+3.10-2.17-e26-prof/lib/libCLHEP-Random-2.4.7.1.so (0x00001466bb600000)
	libstdc++.so.6 => /cvmfs/larsoft.opensciencegrid.org/products/gcc/v12_1_0/Linux64bit+3.10-2.17/lib64/libstdc++.so.6 (0x00001466bb000000)
	libm.so.6 => /lib64/libm.so.6 (0x00001466bac00000)
	libgcc_s.so.1 => /cvmfs/larsoft.opensciencegrid.org/products/gcc/v12_1_0/Linux64bit+3.10-2.17/lib64/libgcc_s.so.1 (0x00001466ba800000)
	libc.so.6 => /lib64/libc.so.6 (0x00001466ba400000)
	libfftw3.so.3 => /cvmfs/larsoft.opensciencegrid.org/products/fftw/v3_3_10/Linux64bit+3.10-2.17/lib/libfftw3.so.3 (0x00001466b9e00000)
	libart_root_io_RootDB.so => /cvmfs/larsoft.opensciencegrid.org/products/art_root_io/v1_13_06/slf7.x86_64.e26.prof/lib/libart_root_io_RootDB.so (0x00001466b9a00000)
	libart_root_io_detail.so => /cvmfs/larsoft.opensciencegrid.org/products/art_root_io/v1_13_06/slf7.x86_64.e26.prof/lib/libart_root_io_detail.so (0x00001466b9600000)
	libcetlib_sqlite.so => /cvmfs/larsoft.opensciencegrid.org/products/cetlib/v3_18_02/slf7.x86_64.e26.prof/lib/libcetlib_sqlite.so (0x00001466b9200000)
	libsqlite3_ups.so.0 => /cvmfs/larsoft.opensciencegrid.org/products/sqlite/v3_40_01_00/Linux64bit+3.10-2.17/lib/libsqlite3_ups.so.0 (0x00001466b8e00000)
	libart_root_io.so => /cvmfs/larsoft.opensciencegrid.org/products/art_root_io/v1_13_06/slf7.x86_64.e26.prof/lib/libart_root_io.so (0x00001466b8a00000)
	libart_Framework_IO_Catalog.so => /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_IO_Catalog.so (0x00001466b8600000)
	libdune_BlipUtils.so => not found
	libz.so.1 => /lib64/libz.so.1 (0x00001466b8200000)
	/lib64/ld-linux-x86-64.so.2 (0x00001466d1e00000)
	libFFTW.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libFFTW.so.6.28 (0x00001466b7e00000)
	libEG.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libEG.so.6.28 (0x00001466b7a00000)
	libGraf3d.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libGraf3d.so.6.28 (0x00001466b7600000)
	libGpad.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libGpad.so.6.28 (0x00001466b7200000)
	libGraf.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libGraf.so.6.28 (0x00001466b6e00000)
	libtbb.so.12 => /cvmfs/larsoft.opensciencegrid.org/products/tbb/v2021_9_0/Linux64bit+3.10-2.17-e26/lib/libtbb.so.12 (0x00001466b6a00000)
	libssl.so.10 => /lib64/libssl.so.10 (0x00001466b6600000)
	libpcre.so.1 => /lib64/libpcre.so.1 (0x00001466b6200000)
	liblzma.so.5 => /lib64/liblzma.so.5 (0x00001466b5e00000)
	libxxhash.so.0 => /lib64/libxxhash.so.0 (0x00001466b5a00000)
	liblz4.so.1 => /lib64/liblz4.so.1 (0x00001466b5600000)
	libzstd.so.1 => /lib64/libzstd.so.1 (0x00001466b5200000)
	liblarsim_Simulation_LArVoxelCalculator.so => /cvmfs/larsoft.opensciencegrid.org/products/larsim/v09_44_02/slf7.x86_64.e26.prof/lib/liblarsim_Simulation_LArVoxelCalculator.so (0x00001466b4e00000)
	liblarsim_Simulation_LArG4Parameters.so => /cvmfs/larsoft.opensciencegrid.org/products/larsim/v09_44_02/slf7.x86_64.e26.prof/lib/liblarsim_Simulation_LArG4Parameters.so (0x00001466b4a00000)
	libGetDetectorType.so => /cvmfs/larsoft.opensciencegrid.org/products/larpandora/v09_22_11_01/slf7.x86_64.e26.prof/lib/libGetDetectorType.so (0x00001466b4600000)
	liblarreco_ClusterFinder.so => /cvmfs/larsoft.opensciencegrid.org/products/larreco/v09_25_06/slf7.x86_64.e26.prof/lib/liblarreco_ClusterFinder.so (0x00001466b4200000)
	liblarreco_RecoAlg_ClusterRecoUtil.so => /cvmfs/larsoft.opensciencegrid.org/products/larreco/v09_25_06/slf7.x86_64.e26.prof/lib/liblarreco_RecoAlg_ClusterRecoUtil.so (0x00001466b3e00000)
	libROOTDataFrame.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libROOTDataFrame.so.6.28 (0x00001466b3a00000)
	libTreePlayer.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libTreePlayer.so.6.28 (0x00001466b3600000)
	libRint.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libRint.so.6.28 (0x00001466b3200000)
	libPostscript.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libPostscript.so.6.28 (0x00001466b2e00000)
	libROOTVecOps.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libROOTVecOps.so.6.28 (0x00001466b2a00000)
	libEve.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libEve.so.6.28 (0x00001466b2400000)
	libRGL.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libRGL.so.6.28 (0x00001466b1e00000)
	libart_Framework_IO_detail.so => /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_IO_detail.so (0x00001466b1a00000)
	liblardata_ArtDataHelper.so => /cvmfs/larsoft.opensciencegrid.org/products/lardata/v09_16_06/slf7.x86_64.e26.prof/lib/liblardata_ArtDataHelper.so (0x00001466b1600000)
	libboost_graph.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_graph.so.1.82.0 (0x00001466b1200000)
	libboost_json.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_json.so.1.82.0 (0x00001466b0e00000)
	libboost_container.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_container.so.1.82.0 (0x00001466b0a00000)
	libCLHEP-Matrix-2.4.7.1.so => /cvmfs/larsoft.opensciencegrid.org/products/clhep/v2_4_7_1/Linux64bit+3.10-2.17-e26-prof/lib/libCLHEP-Matrix-2.4.7.1.so (0x00001466b0600000)
	librt.so.1 => /lib64/librt.so.1 (0x00001466b0200000)
	libcanvas_root_io.so => /cvmfs/larsoft.opensciencegrid.org/products/canvas_root_io/v1_13_06/slf7.x86_64.e26.prof/lib/libcanvas_root_io.so (0x00001466afe00000)
	libfreetype.so.6 => /lib64/libfreetype.so.6 (0x00001466afa00000)
	libgssapi_krb5.so.2 => /lib64/libgssapi_krb5.so.2 (0x00001466af600000)
	libkrb5.so.3 => /lib64/libkrb5.so.3 (0x00001466af200000)
	libcom_err.so.2 => /lib64/libcom_err.so.2 (0x00001466aee00000)
	libk5crypto.so.3 => /lib64/libk5crypto.so.3 (0x00001466aea00000)
	liblarpandora_LArPandoraInterface_Detectors.so => /cvmfs/larsoft.opensciencegrid.org/products/larpandora/v09_22_11_01/slf7.x86_64.e26.prof/lib/liblarpandora_LArPandoraInterface_Detectors.so (0x00001466ae600000)
	libROOTNTuple.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libROOTNTuple.so.6.28 (0x00001466ae200000)
	libGLU.so.1 => /lib64/libGLU.so.1 (0x00001466ade00000)
	libftgl.so.2 => /lib64/libftgl.so.2 (0x00001466ada00000)
	libGLX.so.0 => /lib64/libGLX.so.0 (0x00001466ad600000)
	libOpenGL.so.0 => /lib64/libOpenGL.so.0 (0x00001466ad200000)
	libGLEW.so.1.10 => /lib64/libGLEW.so.1.10 (0x00001466ace00000)
	libGed.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libGed.so.6.28 (0x00001466aca00000)
	libGui.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libGui.so.6.28 (0x00001466ac200000)
	libRCsg.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libRCsg.so.6.28 (0x00001466abe00000)
	libgl2ps.so.1 => /lib64/libgl2ps.so.1 (0x00001466aba00000)
	libSM.so.6 => /lib64/libSM.so.6 (0x00001466ab600000)
	libICE.so.6 => /lib64/libICE.so.6 (0x00001466ab200000)
	libX11.so.6 => /lib64/libX11.so.6 (0x00001466aae00000)
	libXext.so.6 => /lib64/libXext.so.6 (0x00001466aaa00000)
	libboost_thread.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_thread.so.1.82.0 (0x00001466aa600000)
	libbz2.so.1 => /lib64/libbz2.so.1 (0x00001466aa200000)
	libpng15.so.15 => /lib64/libpng15.so.15 (0x00001466a9e00000)
	libkrb5support.so.0 => /lib64/libkrb5support.so.0 (0x00001466a9a00000)
	libkeyutils.so.1 => /lib64/libkeyutils.so.1 (0x00001466a9600000)
	libresolv.so.2 => /lib64/libresolv.so.2 (0x00001466a9200000)
	libGL.so.1 => /lib64/libGL.so.1 (0x00001466a8e00000)
	libGLdispatch.so.0 => /lib64/libGLdispatch.so.0 (0x00001466a8a00000)
	libuuid.so.1 => /lib64/libuuid.so.1 (0x00001466a8600000)
	libxcb.so.1 => /lib64/libxcb.so.1 (0x00001466a8200000)
	libselinux.so.1 => /lib64/libselinux.so.1 (0x00001466a7e00000)
	libXau.so.6 => /lib64/libXau.so.6 (0x00001466a7a00000)
lar exit code 9
justIN time: 2025-11-05 07:30:54 UTC       justIN version: 01.05.01