Jobsub ID 263658.1@dunegpschedd01.fnal.gov

Jobsub ID	263658.1@dunegpschedd01.fnal.gov
Workflow ID	11007
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	8388608000 (8000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-05 08:05:28
Site	NL_SURFsara
Entry	DUNE_SurfSARA_arc03
Last heartbeat	2025-12-05 10:30:57
From worker node	Hostname	wn-lb-01.gina.surf.nl
	cpuinfo	AMD EPYC 9754 128-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	10485760000 (10000 MiB)
	Wall seconds limit	129600 (36 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-05 08:06:16
Input files	monte-carlo-011007-000001
Jobscript	Exit code	0
	Real time	1h (6619s)
	CPU time	1h (6592s = 99%)
	Max RSS bytes	89951227904 (85784 MiB)
Outputting started	2025-12-05 09:56:36
Output files	usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen.root usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen.log usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen.err usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1.root usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1.log usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1.err usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1_g4_stage2.root usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1_g4_stage2.log usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1_g4_stage2.err usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1_g4_stage2_detsim.root usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1_g4_stage2_detsim.log usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1_g4_stage2_detsim.err usertests:prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1_g4_stage2.root.json
Finished	2025-12-05 10:30:57
Saved logs	justin-logs:263658.1-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

4b118273000-14b118274000 r--p 00000000 00:00 0 
14b118274000-14b118275000 r-xp 00000000 00:00 0 
14b118275000-14b118276000 rw-p 00000000 00:00 0 
14b118276000-14b118277000 r--p 00000000 00:00 0 
14b118277000-14b1182e2000 r--p 00000000 00:283 192296                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/RHTTPSniff.pcm
14b1182e2000-14b118400000 r--p 00000000 00:283 192265                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/Net.pcm
14b118400000-14b1184e9000 r-xp 00000000 00:283 558757                    /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_Art.so
14b1184e9000-14b1186e9000 ---p 000e9000 00:283 558757                    /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_Art.so
14b1186e9000-14b1186ec000 r--p 000e9000 00:283 558757                    /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_Art.so
14b1186ec000-14b1186ee000 rw-p 000ec000 00:283 558757                    /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_Art.so
14b1186ee000-14b1186ef000 r-xp 00000000 00:00 0 
14b1186ef000-14b1186f0000 rw-p 00000000 00:00 0 
14b1186f0000-14b1186f1000 r--p 00000000 00:00 0 
14b1186f1000-14b1186f2000 r-xp 00000000 00:00 0 
14b1186f2000-14b1186f3000 rw-p 00000000 00:00 0 
14b1186f3000-14b1186f4000 r--p 00000000 00:00 0 
14b1186f4000-14b118704000 rw-p 00000000 00:00 0 
14b118704000-14b118776000 r--p 00000000 00:283 192556                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/XMLParser.pcm
14b118776000-14b118800000 r--p 00000000 00:283 192327                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/Unfold.pcm
14b118800000-14b118801000 r-xp 00000000 00:287 4297458                   /usr/libexec/coreutils/libstdbuf.so
14b118801000-14b118a00000 ---p 00001000 00:287 4297458                   /usr/libexec/coreutils/libstdbuf.so
14b118a00000-14b118a01000 r--p 00000000 00:287 4297458                   /usr/libexec/coreutils/libstdbuf.so
14b118a01000-14b118a02000 rw-p 00001000 00:287 4297458                   /usr/libexec/coreutils/libstdbuf.so
14b118a02000-14b118a03000 r-xp 00000000 00:00 0 
14b118a03000-14b118a04000 rw-p 00000000 00:00 0 
14b118a04000-14b118a05000 r--p 00000000 00:00 0 
14b118a05000-14b118a06000 r-xp 00000000 00:00 0 
14b118a06000-14b118a37000 rw-p 00000000 00:00 0 
14b118a37000-14b118a38000 r--p 00000000 00:00 0 
14b118a38000-14b118a39000 r-xp 00000000 00:00 0 
14b118a39000-14b118a3a000 rw-p 00000000 00:00 0 
14b118a3a000-14b118a3b000 r--p 00000000 00:00 0 
14b118a3b000-14b118a3c000 r-xp 00000000 00:00 0 
14b118a3c000-14b118a3e000 rw-p 00000000 00:00 0 
14b118a3e000-14b118a3f000 r--p 00000000 00:00 0 
14b118a3f000-14b118a40000 r-xp 00000000 00:00 0 
14b118a40000-14b118a41000 rw-p 00000000 00:00 0 
14b118a41000-14b118a42000 r--p 00000000 00:00 0 
14b118a42000-14b118a43000 r-xp 00000000 00:00 0 
14b118a43000-14b118a44000 rw-p 00000000 00:00 0 
14b118a44000-14b118a45000 r--p 00000000 00:00 0 
14b118a45000-14b118a46000 r-xp 00000000 00:00 0 
14b118a46000-14b118a47000 rw-p 00000000 00:00 0 
14b118a47000-14b118a48000 r--p 00000000 00:00 0 
14b118a48000-14b118a49000 r-xp 00000000 00:00 0 
14b118a49000-14b118a4a000 rw-p 00000000 00:00 0 
14b118a4a000-14b118a4b000 r--p 00000000 00:00 0 
14b118a4b000-14b118a4c000 r-xp 00000000 00:00 0 
14b118a4c000-14b118a4d000 rw-p 00000000 00:00 0 
14b118a4d000-14b118a4e000 r--p 00000000 00:00 0 
14b118a4e000-14b118a4f000 r-xp 00000000 00:00 0 
14b118a4f000-14b118a50000 rw-p 00000000 00:00 0 
14b118a50000-14b118a51000 r--p 00000000 00:00 0 
14b118a51000-14b118a52000 r-xp 00000000 00:00 0 
14b118a52000-14b118a53000 rw-p 00000000 00:00 0 
14b118a53000-14b118a54000 r--p 00000000 00:00 0 
14b118a54000-14b118a55000 r-xp 00000000 00:00 0 
14b118a55000-14b118a56000 rw-p 00000000 00:00 0 
14b118a56000-14b118a57000 r--p 00000000 00:00 0 
14b118a57000-14b118a58000 r-xp 00000000 00:00 0 
14b118a58000-14b118a59000 rw-p 00000000 00:00 0 
14b118a59000-14b118a5a000 r--p 00000000 00:00 0 
14b118a5a000-14b118a5b000 r-xp 00000000 00:00 0 
14b118a5b000-14b118a5c000 rw-p 00000000 00:00 0 
14b118a5c000-14b118a5d000 r--p 00000000 00:00 0 
14b118a5d000-14b118a5e000 r-xp 00000000 00:00 0 
14b118a5e000-14b118a5f000 rw-p 00000000 00:00 0 
14b118a5f000-14b118a60000 r--p 00000000 00:00 0 
14b118a60000-14b118a61000 r-xp 00000000 00:00 0 
14b118a61000-14b118a62000 rw-p 00000000 00:00 0 
14b118a62000-14b118b9b000 r--p 00000000 00:283 191167                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/MultiProc.pcm
14b118b9b000-14b118c00000 r--p 00000000 00:283 191055                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/Rint.pcm
14b118c00000-14b118c22000 r-xp 00000000 00:287 4298077                   /usr/lib64/ld-2.17.so
14b118c22000-14b118c33000 r--p 00000000 00:283 158252                    /cvmfs/larsoft.opensciencegrid.org/products/gcc/v12_1_0/Linux64bit+3.10-2.17/include/c++/12.1.0/x86_64-pc-linux-gnu/bits/c++config.h
14b118c33000-14b118cb9000 r--p 00000000 00:283 192700                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/ROOT_Foundation_Stage1_NoRTTI.pcm
14b118cb9000-14b118cd8000 r--p 00000000 00:283 194068                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/ROOT_Config.pcm
14b118cd8000-14b118e21000 r--p 00000000 00:283 192443                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libc.pcm
14b118e21000-14b118e22000 r--p 00021000 00:287 4298077                   /usr/lib64/ld-2.17.so
14b118e22000-14b118e23000 rw-p 00022000 00:287 4298077                   /usr/lib64/ld-2.17.so
14b118e23000-14b118e24000 rw-p 00000000 00:00 0 
14b118e24000-14b118e25000 r--p 00000000 00:00 0 
14b118e25000-14b118e26000 r-xp 00000000 00:00 0 
14b118e26000-14b118e27000 rw-p 00000000 00:00 0 
14b118e27000-14b118e28000 r--p 00000000 00:00 0 
14b118e28000-14b118e29000 r-xp 00000000 00:00 0 
14b118e29000-14b118e2a000 rw-p 00000000 00:00 0 
14b118e2a000-14b118e4f000 r--p 00000000 00:283 194388                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/ROOT_Rtypes.pcm
14b118e4f000-14b118ea3000 r--p 00000000 00:283 192434                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/ROOT_Foundation_C.pcm
14b118ea3000-14b118ed0000 r--p 00000000 00:283 192621                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/Cling_Runtime_Extra.pcm
14b118ed0000-14b118eef000 r--p 00000000 00:283 194077                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/Cling_Runtime.pcm
14b118eef000-14b118f3c000 r--p 00000000 00:283 192973                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/modules.idx
14b118f3c000-14b118f4a000 r--p 00000000 00:283 192408                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/_Builtin_stddef_max_align_t.pcm
14b118f4a000-14b118f58000 r--p 00000000 00:283 194091                    /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/xlocale.h.pcm
14b118f58000-14b118fcc000 rw-p 00000000 00:00 0 
14b118fcc000-14b118fcd000 rw-p 00000000 00:00 0 
14b118fcd000-14b118fce000 r--p 00000000 00:00 0 
14b118fce000-14b118fcf000 r-xp 00000000 00:00 0 
14b118fcf000-14b118fd0000 rw-p 00000000 00:00 0 
14b118fd0000-14b118fd1000 r--p 00000000 00:00 0 
14b118fd1000-14b118fd2000 r-xp 00000000 00:00 0 
14b118fd2000-14b118fd3000 rw-p 00000000 00:00 0 
14b118fd3000-14b118fd4000 r--p 00000000 00:00 0 
14b118fd4000-14b118fd5000 r-xp 00000000 00:00 0 
14b118fd5000-14b118fd6000 rw-p 00000000 00:00 0 
14b118fd6000-14b118fd7000 r--p 00000000 00:00 0 
14b118fd7000-14b118fd8000 r-xp 00000000 00:00 0 
14b118fd8000-14b118fe3000 rw-p 00000000 00:00 0 
14b118fe3000-14b118fe7000 r--p 00000000 00:00 0                          [vvar]
14b118fe7000-14b118fe9000 r-xp 00000000 00:00 0                          [vdso]
7ffe537c0000-7ffe53801000 rw-p 00000000 00:00 0                          [stack]
ffffffffff600000-ffffffffff601000 --xp 00000000 00:00 0                  [vsyscall]

ls: cannot access *_reco.root: No such file or directory
Forming g4 metadata
  G4 file: prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1_g4_stage2.root
    KEY: g4_stage2
    FCL:  protodunevd_g4_stage2.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1_g4_stage2.root
  Ran successfully
{
  "name": "prod_cosmics_protodunevd_1_263658_1_1764921996_gen_g4_stage1_g4_stage2.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_12_01d00",
    "core.data_tier": "detector-simulated",
    "core.runs": "1",
    "core.runs_subruns": "1",
    "dune.config_file": "protodunevd_g4_stage2.fcl",
    "dune.campaign": "pdvd-cosmics-test",
    "core.start_time": 1764921995.0,
    "core.end_time": 1764928583.0,
    "core.subruns": "1",
    "core.events": [
      1
    ],
    "core.event_count": 1,
    "core.first_event_number": 1,
    "core.last_event_number": 1
  }
}Forming reco metadata