justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 237421.0@dunegpschedd02.fnal.gov

Jobsub ID237421.0@dunegpschedd02.fnal.gov
Workflow ID9594
Stage ID1
User nameweishi@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit12000 (3 hours)
Submitted time2025-11-04 18:40:24
SiteCA_SFU
EntryDUNE_CA_SFU_lcg-ce3
Last heartbeat2025-11-04 19:03:13
From worker nodeHostnamefc30554.int.fir.alliancecan.ca
cpuinfoAMD EPYC 9655 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit84598 (23 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-04 18:41:47
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T235814Z_gen_003424_supernova_g4stage1_g4stage2_detsim_reco_20250627T074235Z_reco2.root
JobscriptExit code0
Real time20m (1259s)
CPU time11m (719s = 57%)
Max RSS bytes2723708928 (2597 MiB)
Outputting started2025-11-04 19:02:46
Output filesusertests:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T235814Z_gen_003424_supernova_g4stage1_g4stage2_detsim_reco_20250627T074235Z_reco2_QLMatch_ana_2025-11-04T_184220Z_hist.root
Finished2025-11-04 19:03:13
Saved logsjustin-logs:237421.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

grid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_regex.so.1.82.0 (0x00001475c6c00000)
	libboost_filesystem.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_filesystem.so.1.82.0 (0x00001475c6800000)
	libboost_atomic.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_atomic.so.1.82.0 (0x00001475c6400000)
	libcetlib_except.so => /cvmfs/larsoft.opensciencegrid.org/products/cetlib_except/v1_09_01/slf7.x86_64.e26.prof/lib/libcetlib_except.so (0x00001475c6000000)
	libboost_date_time.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_date_time.so.1.82.0 (0x00001475c5c00000)
	libCLHEP-Vector-2.4.7.1.so => /cvmfs/larsoft.opensciencegrid.org/products/clhep/v2_4_7_1/Linux64bit+3.10-2.17-e26-prof/lib/libCLHEP-Vector-2.4.7.1.so (0x00001475c5800000)
	libCLHEP-Random-2.4.7.1.so => /cvmfs/larsoft.opensciencegrid.org/products/clhep/v2_4_7_1/Linux64bit+3.10-2.17-e26-prof/lib/libCLHEP-Random-2.4.7.1.so (0x00001475c5400000)
	libstdc++.so.6 => /cvmfs/larsoft.opensciencegrid.org/products/gcc/v12_1_0/Linux64bit+3.10-2.17/lib64/libstdc++.so.6 (0x00001475c4e00000)
	libm.so.6 => /lib64/libm.so.6 (0x00001475c4a00000)
	libgcc_s.so.1 => /cvmfs/larsoft.opensciencegrid.org/products/gcc/v12_1_0/Linux64bit+3.10-2.17/lib64/libgcc_s.so.1 (0x00001475c4600000)
	libc.so.6 => /lib64/libc.so.6 (0x00001475c4200000)
	libfftw3.so.3 => /cvmfs/larsoft.opensciencegrid.org/products/fftw/v3_3_10/Linux64bit+3.10-2.17/lib/libfftw3.so.3 (0x00001475c3c00000)
	libart_root_io_RootDB.so => /cvmfs/larsoft.opensciencegrid.org/products/art_root_io/v1_13_06/slf7.x86_64.e26.prof/lib/libart_root_io_RootDB.so (0x00001475c3800000)
	libart_root_io_detail.so => /cvmfs/larsoft.opensciencegrid.org/products/art_root_io/v1_13_06/slf7.x86_64.e26.prof/lib/libart_root_io_detail.so (0x00001475c3400000)
	libcetlib_sqlite.so => /cvmfs/larsoft.opensciencegrid.org/products/cetlib/v3_18_02/slf7.x86_64.e26.prof/lib/libcetlib_sqlite.so (0x00001475c3000000)
	libsqlite3_ups.so.0 => /cvmfs/larsoft.opensciencegrid.org/products/sqlite/v3_40_01_00/Linux64bit+3.10-2.17/lib/libsqlite3_ups.so.0 (0x00001475c2c00000)
	libart_root_io.so => /cvmfs/larsoft.opensciencegrid.org/products/art_root_io/v1_13_06/slf7.x86_64.e26.prof/lib/libart_root_io.so (0x00001475c2800000)
	libart_Framework_IO_Catalog.so => /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_IO_Catalog.so (0x00001475c2400000)
	libz.so.1 => /lib64/libz.so.1 (0x00001475c2000000)
	/lib64/ld-linux-x86-64.so.2 (0x00001475dc000000)
	libFFTW.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libFFTW.so.6.28 (0x00001475c1c00000)
	libEG.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libEG.so.6.28 (0x00001475c1800000)
	libGraf3d.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libGraf3d.so.6.28 (0x00001475c1400000)
	libGpad.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libGpad.so.6.28 (0x00001475c1000000)
	libGraf.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libGraf.so.6.28 (0x00001475c0c00000)
	libtbb.so.12 => /cvmfs/larsoft.opensciencegrid.org/products/tbb/v2021_9_0/Linux64bit+3.10-2.17-e26/lib/libtbb.so.12 (0x00001475c0800000)
	libssl.so.10 => /lib64/libssl.so.10 (0x00001475c0400000)
	libpcre.so.1 => /lib64/libpcre.so.1 (0x00001475c0000000)
	liblzma.so.5 => /lib64/liblzma.so.5 (0x00001475bfc00000)
	libxxhash.so.0 => /lib64/libxxhash.so.0 (0x00001475bf800000)
	liblz4.so.1 => /lib64/liblz4.so.1 (0x00001475bf400000)
	libzstd.so.1 => /lib64/libzstd.so.1 (0x00001475bf000000)
	liblarsim_Simulation_LArVoxelCalculator.so => /cvmfs/larsoft.opensciencegrid.org/products/larsim/v09_44_02/slf7.x86_64.e26.prof/lib/liblarsim_Simulation_LArVoxelCalculator.so (0x00001475bec00000)
	liblarsim_Simulation_LArG4Parameters.so => /cvmfs/larsoft.opensciencegrid.org/products/larsim/v09_44_02/slf7.x86_64.e26.prof/lib/liblarsim_Simulation_LArG4Parameters.so (0x00001475be800000)
	libGetDetectorType.so => /cvmfs/larsoft.opensciencegrid.org/products/larpandora/v09_22_11_01/slf7.x86_64.e26.prof/lib/libGetDetectorType.so (0x00001475be400000)
	liblarreco_ClusterFinder.so => /cvmfs/larsoft.opensciencegrid.org/products/larreco/v09_25_06/slf7.x86_64.e26.prof/lib/liblarreco_ClusterFinder.so (0x00001475be000000)
	liblarreco_RecoAlg_ClusterRecoUtil.so => /cvmfs/larsoft.opensciencegrid.org/products/larreco/v09_25_06/slf7.x86_64.e26.prof/lib/liblarreco_RecoAlg_ClusterRecoUtil.so (0x00001475bdc00000)
	libROOTDataFrame.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libROOTDataFrame.so.6.28 (0x00001475bd800000)
	libTreePlayer.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libTreePlayer.so.6.28 (0x00001475bd400000)
	libRint.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libRint.so.6.28 (0x00001475bd000000)
	libPostscript.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libPostscript.so.6.28 (0x00001475bcc00000)
	libROOTVecOps.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libROOTVecOps.so.6.28 (0x00001475bc800000)
	libEve.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libEve.so.6.28 (0x00001475bc200000)
	libRGL.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libRGL.so.6.28 (0x00001475bbc00000)
	libart_Framework_IO_detail.so => /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_IO_detail.so (0x00001475bb800000)
	liblardata_ArtDataHelper.so => /cvmfs/larsoft.opensciencegrid.org/products/lardata/v09_16_06/slf7.x86_64.e26.prof/lib/liblardata_ArtDataHelper.so (0x00001475bb400000)
	libboost_graph.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_graph.so.1.82.0 (0x00001475bb000000)
	libboost_json.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_json.so.1.82.0 (0x00001475bac00000)
	libboost_container.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_container.so.1.82.0 (0x00001475ba800000)
	libCLHEP-Matrix-2.4.7.1.so => /cvmfs/larsoft.opensciencegrid.org/products/clhep/v2_4_7_1/Linux64bit+3.10-2.17-e26-prof/lib/libCLHEP-Matrix-2.4.7.1.so (0x00001475ba400000)
	librt.so.1 => /lib64/librt.so.1 (0x00001475ba000000)
	libcanvas_root_io.so => /cvmfs/larsoft.opensciencegrid.org/products/canvas_root_io/v1_13_06/slf7.x86_64.e26.prof/lib/libcanvas_root_io.so (0x00001475b9c00000)
	libfreetype.so.6 => /lib64/libfreetype.so.6 (0x00001475b9800000)
	libgssapi_krb5.so.2 => /lib64/libgssapi_krb5.so.2 (0x00001475b9400000)
	libkrb5.so.3 => /lib64/libkrb5.so.3 (0x00001475b9000000)
	libcom_err.so.2 => /lib64/libcom_err.so.2 (0x00001475b8c00000)
	libk5crypto.so.3 => /lib64/libk5crypto.so.3 (0x00001475b8800000)
	liblarpandora_LArPandoraInterface_Detectors.so => /cvmfs/larsoft.opensciencegrid.org/products/larpandora/v09_22_11_01/slf7.x86_64.e26.prof/lib/liblarpandora_LArPandoraInterface_Detectors.so (0x00001475b8400000)
	libROOTNTuple.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libROOTNTuple.so.6.28 (0x00001475b8000000)
	libGLU.so.1 => /lib64/libGLU.so.1 (0x00001475b7c00000)
	libftgl.so.2 => /lib64/libftgl.so.2 (0x00001475b7800000)
	libGLX.so.0 => /lib64/libGLX.so.0 (0x00001475b7400000)
	libOpenGL.so.0 => /lib64/libOpenGL.so.0 (0x00001475b7000000)
	libGLEW.so.1.10 => /lib64/libGLEW.so.1.10 (0x00001475b6c00000)
	libGed.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libGed.so.6.28 (0x00001475b6800000)
	libGui.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libGui.so.6.28 (0x00001475b6000000)
	libRCsg.so.6.28 => /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libRCsg.so.6.28 (0x00001475b5c00000)
	libgl2ps.so.1 => /lib64/libgl2ps.so.1 (0x00001475b5800000)
	libSM.so.6 => /lib64/libSM.so.6 (0x00001475b5400000)
	libICE.so.6 => /lib64/libICE.so.6 (0x00001475b5000000)
	libX11.so.6 => /lib64/libX11.so.6 (0x00001475b4c00000)
	libXext.so.6 => /lib64/libXext.so.6 (0x00001475b4800000)
	libboost_thread.so.1.82.0 => /cvmfs/larsoft.opensciencegrid.org/products/boost/v1_82_0/Linux64bit+3.10-2.17-e26-prof/lib/libboost_thread.so.1.82.0 (0x00001475b4400000)
	libbz2.so.1 => /lib64/libbz2.so.1 (0x00001475b4000000)
	libpng15.so.15 => /lib64/libpng15.so.15 (0x00001475b3c00000)
	libkrb5support.so.0 => /lib64/libkrb5support.so.0 (0x00001475b3800000)
	libkeyutils.so.1 => /lib64/libkeyutils.so.1 (0x00001475b3400000)
	libresolv.so.2 => /lib64/libresolv.so.2 (0x00001475b3000000)
	libGL.so.1 => /lib64/libGL.so.1 (0x00001475b2c00000)
	libGLdispatch.so.0 => /lib64/libGLdispatch.so.0 (0x00001475b2800000)
	libuuid.so.1 => /lib64/libuuid.so.1 (0x00001475b2400000)
	libxcb.so.1 => /lib64/libxcb.so.1 (0x00001475b2000000)
	libselinux.so.1 => /lib64/libselinux.so.1 (0x00001475b1c00000)
	libXau.so.6 => /lib64/libXau.so.6 (0x00001475b1800000)
../justin-jobscript: line 79:  1150 Aborted                 lar -c $ANA_FILE $events_option -T ${outAnaFile}_hist.root $pfn > ${fname}_myana_${now}.log 2>&1
lar exit code 134
justIN time: 2025-11-05 07:28:35 UTC       justIN version: 01.05.01