Jobsub ID 263849.0@dunegpschedd01.fnal.gov

Jobsub ID	263849.0@dunegpschedd01.fnal.gov
Workflow ID	11037
Stage ID	1
User name	ykermaid@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	8388608000 (8000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-05 13:47:46
Site	UK_Manchester
Entry	UBoone_T2_UK_Manchester_ce02
Last heartbeat	2025-12-05 16:06:21
From worker node	Hostname	wn1205090.tier2.hep.manchester.ac.uk
	cpuinfo	AMD EPYC 7702P 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	10485760000 (10000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-05 13:48:35
Input files	monte-carlo-011037-000001
Jobscript	Exit code	0
	Real time	1h (7137s)
	CPU time	1h (7178s = 100%)
	Max RSS bytes	76509683712 (72965 MiB)
Outputting started	2025-12-05 15:47:33
Output files	usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1.err usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1_g4_stage2_detsim.err usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1_g4_stage2_detsim.log usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen.root usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1_g4_stage2.log usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1_g4_stage2_detsim.root usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1.root usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1.log usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen.err usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1_g4_stage2.err usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1_g4_stage2.root.json usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen.log usertests:prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1_g4_stage2.root
Finished	2025-12-05 16:06:21
Saved logs	justin-logs:263849.0-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0-14fd85c00000 r--p 00000000 00:f9 192366                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/Net.pcm
14fd85c00000-14fd85ce9000 r-xp 00000000 00:f9 558858                     /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_Art.so
14fd85ce9000-14fd85ee9000 ---p 000e9000 00:f9 558858                     /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_Art.so
14fd85ee9000-14fd85eec000 r--p 000e9000 00:f9 558858                     /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_Art.so
14fd85eec000-14fd85eee000 rw-p 000ec000 00:f9 558858                     /cvmfs/larsoft.opensciencegrid.org/products/art/v3_14_04/slf7.x86_64.e26.prof/lib/libart_Framework_Art.so
14fd85eee000-14fd85eef000 rw-p 00000000 00:00 0 
14fd85eef000-14fd85ef0000 r--p 00000000 00:00 0 
14fd85ef0000-14fd85ef1000 r-xp 00000000 00:00 0 
14fd85ef1000-14fd85ef2000 rw-p 00000000 00:00 0 
14fd85ef2000-14fd85ef3000 r--p 00000000 00:00 0 
14fd85ef3000-14fd85ef4000 r-xp 00000000 00:00 0 
14fd85ef4000-14fd85f04000 rw-p 00000000 00:00 0 
14fd85f04000-14fd85f76000 r--p 00000000 00:f9 192657                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/XMLParser.pcm
14fd85f76000-14fd86000000 r--p 00000000 00:f9 192428                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/Unfold.pcm
14fd86000000-14fd86001000 r-xp 00000000 00:73 14933                      /usr/libexec/coreutils/libstdbuf.so
14fd86001000-14fd86200000 ---p 00001000 00:73 14933                      /usr/libexec/coreutils/libstdbuf.so
14fd86200000-14fd86201000 r--p 00000000 00:73 14933                      /usr/libexec/coreutils/libstdbuf.so
14fd86201000-14fd86202000 rw-p 00001000 00:73 14933                      /usr/libexec/coreutils/libstdbuf.so
14fd86202000-14fd86203000 rw-p 00000000 00:00 0 
14fd86203000-14fd86204000 r--p 00000000 00:00 0 
14fd86204000-14fd86205000 r-xp 00000000 00:00 0 
14fd86205000-14fd86206000 rw-p 00000000 00:00 0 
14fd86206000-14fd86207000 r--p 00000000 00:00 0 
14fd86207000-14fd86208000 r-xp 00000000 00:00 0 
14fd86208000-14fd86209000 rw-p 00000000 00:00 0 
14fd86209000-14fd8620a000 r--p 00000000 00:00 0 
14fd8620a000-14fd8620b000 r-xp 00000000 00:00 0 
14fd8620b000-14fd8620c000 rw-p 00000000 00:00 0 
14fd8620c000-14fd8620d000 r--p 00000000 00:00 0 
14fd8620d000-14fd8620e000 r-xp 00000000 00:00 0 
14fd8620e000-14fd8625f000 rw-p 00000000 00:00 0 
14fd8625f000-14fd86260000 r--p 00000000 00:00 0 
14fd86260000-14fd86261000 r-xp 00000000 00:00 0 
14fd86261000-14fd86262000 rw-p 00000000 00:00 0 
14fd86262000-14fd8639b000 r--p 00000000 00:f9 191268                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/MultiProc.pcm
14fd8639b000-14fd86400000 r--p 00000000 00:f9 191156                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/Rint.pcm
14fd86400000-14fd86422000 r-xp 00000000 00:73 15552                      /usr/lib64/ld-2.17.so
14fd86422000-14fd86423000 r--p 00000000 00:00 0 
14fd86423000-14fd86424000 r-xp 00000000 00:00 0 
14fd86424000-14fd86426000 rw-p 00000000 00:00 0 
14fd86426000-14fd86427000 r--p 00000000 00:00 0 
14fd86427000-14fd86428000 r-xp 00000000 00:00 0 
14fd86428000-14fd86429000 rw-p 00000000 00:00 0 
14fd86429000-14fd8642a000 r--p 00000000 00:00 0 
14fd8642a000-14fd8642b000 r-xp 00000000 00:00 0 
14fd8642b000-14fd8642c000 rw-p 00000000 00:00 0 
14fd8642c000-14fd8642d000 r--p 00000000 00:00 0 
14fd8642d000-14fd8642e000 r-xp 00000000 00:00 0 
14fd8642e000-14fd8642f000 rw-p 00000000 00:00 0 
14fd8642f000-14fd86430000 r--p 00000000 00:00 0 
14fd86430000-14fd86431000 r-xp 00000000 00:00 0 
14fd86431000-14fd86432000 rw-p 00000000 00:00 0 
14fd86432000-14fd86433000 r--p 00000000 00:00 0 
14fd86433000-14fd86434000 r-xp 00000000 00:00 0 
14fd86434000-14fd86435000 rw-p 00000000 00:00 0 
14fd86435000-14fd86436000 r--p 00000000 00:00 0 
14fd86436000-14fd86437000 r-xp 00000000 00:00 0 
14fd86437000-14fd86438000 rw-p 00000000 00:00 0 
14fd86438000-14fd86439000 r--p 00000000 00:00 0 
14fd86439000-14fd8643a000 r-xp 00000000 00:00 0 
14fd8643a000-14fd8643b000 rw-p 00000000 00:00 0 
14fd8643b000-14fd8643c000 r--p 00000000 00:00 0 
14fd8643c000-14fd8643d000 r-xp 00000000 00:00 0 
14fd8643d000-14fd8643e000 rw-p 00000000 00:00 0 
14fd8643e000-14fd8643f000 r--p 00000000 00:00 0 
14fd8643f000-14fd86440000 r-xp 00000000 00:00 0 
14fd86440000-14fd86441000 rw-p 00000000 00:00 0 
14fd86441000-14fd86442000 r--p 00000000 00:00 0 
14fd86442000-14fd86443000 r-xp 00000000 00:00 0 
14fd86443000-14fd86444000 rw-p 00000000 00:00 0 
14fd86444000-14fd86445000 r--p 00000000 00:00 0 
14fd86445000-14fd86446000 r-xp 00000000 00:00 0 
14fd86446000-14fd86447000 rw-p 00000000 00:00 0 
14fd86447000-14fd86448000 r--p 00000000 00:00 0 
14fd86448000-14fd86449000 r-xp 00000000 00:00 0 
14fd86449000-14fd8644a000 rw-p 00000000 00:00 0 
14fd8644a000-14fd8644b000 r--p 00000000 00:00 0 
14fd8644b000-14fd8645c000 r--p 00000000 00:f9 158353                     /cvmfs/larsoft.opensciencegrid.org/products/gcc/v12_1_0/Linux64bit+3.10-2.17/include/c++/12.1.0/x86_64-pc-linux-gnu/bits/c++config.h
14fd8645c000-14fd864e2000 r--p 00000000 00:f9 192801                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/ROOT_Foundation_Stage1_NoRTTI.pcm
14fd864e2000-14fd86501000 r--p 00000000 00:f9 194169                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/ROOT_Config.pcm
14fd86501000-14fd86526000 r--p 00000000 00:f9 194489                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/ROOT_Rtypes.pcm
14fd86526000-14fd8657a000 r--p 00000000 00:f9 192535                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/ROOT_Foundation_C.pcm
14fd8657a000-14fd865a7000 r--p 00000000 00:f9 192722                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/Cling_Runtime_Extra.pcm
14fd865a7000-14fd865c6000 r--p 00000000 00:f9 194178                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/Cling_Runtime.pcm
14fd865c6000-14fd86613000 r--p 00000000 00:f9 193074                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/modules.idx
14fd86613000-14fd86621000 r--p 00000000 00:f9 192509                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/_Builtin_stddef_max_align_t.pcm
14fd86621000-14fd86622000 r--p 00021000 00:73 15552                      /usr/lib64/ld-2.17.so
14fd86622000-14fd86623000 rw-p 00022000 00:73 15552                      /usr/lib64/ld-2.17.so
14fd86623000-14fd86624000 rw-p 00000000 00:00 0 
14fd86624000-14fd86625000 r-xp 00000000 00:00 0 
14fd86625000-14fd86626000 rw-p 00000000 00:00 0 
14fd86626000-14fd86627000 r--p 00000000 00:00 0 
14fd86627000-14fd86628000 r-xp 00000000 00:00 0 
14fd86628000-14fd86629000 rw-p 00000000 00:00 0 
14fd86629000-14fd86637000 r--p 00000000 00:f9 194192                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/xlocale.h.pcm
14fd86637000-14fd86780000 r--p 00000000 00:f9 192544                     /cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libc.pcm
14fd86780000-14fd867f4000 rw-p 00000000 00:00 0 
14fd867f4000-14fd867f5000 rw-p 00000000 00:00 0 
14fd867f5000-14fd867f6000 r--p 00000000 00:00 0 
14fd867f6000-14fd867f7000 r-xp 00000000 00:00 0 
14fd867f7000-14fd867f8000 rw-p 00000000 00:00 0 
14fd867f8000-14fd867f9000 r--p 00000000 00:00 0 
14fd867f9000-14fd867fa000 r-xp 00000000 00:00 0 
14fd867fa000-14fd867fb000 rw-p 00000000 00:00 0 
14fd867fb000-14fd867fc000 r--p 00000000 00:00 0 
14fd867fc000-14fd867fd000 r-xp 00000000 00:00 0 
14fd867fd000-14fd867fe000 rw-p 00000000 00:00 0 
14fd867fe000-14fd867ff000 r--p 00000000 00:00 0 
14fd867ff000-14fd86800000 r-xp 00000000 00:00 0 
14fd86800000-14fd8680b000 rw-p 00000000 00:00 0 
7ffd2b280000-7ffd2b2c1000 rw-p 00000000 00:00 0                          [stack]
7ffd2b2d5000-7ffd2b2d9000 r--p 00000000 00:00 0                          [vvar]
7ffd2b2d9000-7ffd2b2db000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 --xp 00000000 00:00 0                  [vsyscall]

ls: cannot access *_reco.root: No such file or directory
Forming g4 metadata
  G4 file: prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1_g4_stage2.root
    KEY: g4_stage2
    FCL:  protodunevd_g4_stage2.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1_g4_stage2.root
  Ran successfully
{
  "name": "prod_cosmics_protodunevd_1_263849_0_1764942537_gen_g4_stage1_g4_stage2.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_12_01d00",
    "core.data_tier": "detector-simulated",
    "core.runs": "1",
    "core.runs_subruns": "0",
    "dune.config_file": "protodunevd_g4_stage2.fcl",
    "dune.campaign": "pdvd-cosmics-test",
    "core.start_time": 1764942535.0,
    "core.end_time": 1764949645.0,
    "core.subruns": "1",
    "core.events": [
      1
    ],
    "core.event_count": 1,
    "core.first_event_number": 1,
    "core.last_event_number": 1
  }
}Forming reco metadata