Jobsub ID 17996.21@dunegpschedd02.fnal.gov
Jobsub ID | 17996.21@dunegpschedd02.fnal.gov | |
Workflow ID | 1035 | |
Stage ID | 1 | |
User name | ayankele@fnal.gov | |
HTCondor Group | group_dune | |
Requested | Processors | 1 |
GPU | No | |
RSS bytes | 2097152000 (2000 MiB) | |
Wall seconds limit | 80000 (22 hours) | |
Submitted time | 2025-08-16 01:19:25 | |
Site | CZ_FZU | |
Entry | Nova_CZ_FZU_osgce1 | |
Last heartbeat | 2025-08-16 01:36:53 | |
From worker node | Hostname | milan22.farm.particle.cz |
cpuinfo | AMD EPYC 7543 32-Core Processor | |
OS release | Scientific Linux release 7.9 (Nitrogen) | |
Processors | 1 | |
RSS bytes | 2097152000 (2000 MiB) | |
Wall seconds limit | 172800 (48 hours) | |
GPU | ||
Inner Apptainer? | True | |
Job state | finished | |
Started | 2025-08-16 01:20:55 | |
Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6389847_38_20231201T180932Z_gen_g4_detsim_hitreco__20240507T212430Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74577407_761_20231208T072002Z_gen_g4_detsim_hitreco__20240510T061027Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515154_201_20231201T071007Z_gen_g4_detsim_hitreco__20240507T184710Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6420351_355_20231204T034025Z_gen_g4_detsim_hitreco__20240509T194849Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6209058_492_20231122T130613Z_gen_g4_detsim_hitreco__20240503T064229Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_796_20231204T140413Z_gen_g4_detsim_hitreco__20240509T202818Z_reco2.root | |
Jobscript | Exit code | 0 |
Real time | 15m (908s) | |
CPU time | 13m (824s = 90%) | |
Max RSS bytes | 2916585472 (2781 MiB) | |
Outputting started | 2025-08-16 01:36:04 | |
Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ayankele/fnal/01035/1/001/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74577407_761_20231208T072002Z_gen_g4_detsim_hitreco__20240510T061027Z_reco2_cvnpreprocess.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ayankele/fnal/01035/1/001/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6420351_355_20231204T034025Z_gen_g4_detsim_hitreco__20240509T194849Z_reco2_cvnpreprocess.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ayankele/fnal/01035/1/001/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515154_201_20231201T071007Z_gen_g4_detsim_hitreco__20240507T184710Z_reco2_cvnpreprocess.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ayankele/fnal/01035/1/001/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_796_20231204T140413Z_gen_g4_detsim_hitreco__20240509T202818Z_reco2_cvnpreprocess.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ayankele/fnal/01035/1/001/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6209058_492_20231122T130613Z_gen_g4_detsim_hitreco__20240503T064229Z_reco2_cvnpreprocess.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ayankele/fnal/01035/1/001/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6389847_38_20231201T180932Z_gen_g4_detsim_hitreco__20240507T212430Z_reco2_cvnpreprocess.root | |
Finished | 2025-08-16 01:36:53 | |
Saved logs | justin-logs:17996.21-dunegpschedd02.fnal.gov.logs.tgz | |
List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
------------- WARNING: Unable to open file /cvmfs/fifeuser4.opensciencegrid.org/sw/dune/7610af3dffce908cd92377912a9d2dbbc399c94f/preprocess_atmnu/localProducts_larsoft_v10_03_01_e26_prof. --------------------------------------------------------- ln: failed to create symbolic link './CCNuSelection.fcl': File exists ln: failed to create symbolic link './CTPEvaluator.fcl': File exists ln: failed to create symbolic link './CTPTrackDump.fcl': File exists ln: failed to create symbolic link './CVNCreateLMDB.fcl': File exists ln: failed to create symbolic link './CVNCreateLevelDB.fcl': File exists ln: failed to create symbolic link './CVNCreateLevelDBTest.fcl': File exists ln: failed to create symbolic link './CVNCreateZlibImages.fcl': File exists ln: failed to create symbolic link './CVNEvaluator.fcl': File exists ln: failed to create symbolic link './CVNEventDump.fcl': File exists ln: failed to create symbolic link './CVNMapper.fcl': File exists ln: failed to create symbolic link './CVNProngCreateLevelDB.fcl': File exists ln: failed to create symbolic link './CVNSparseMapper.fcl': File exists ln: failed to create symbolic link './CVNTrain.fcl': File exists ln: failed to create symbolic link './CVNValidation.fcl': File exists ln: failed to create symbolic link './CVNZlibMaker.fcl': File exists ln: failed to create symbolic link './GCNGraphMaker.fcl': File exists ln: failed to create symbolic link './GCNZlibMaker.fcl': File exists ln: failed to create symbolic link './InfillChannelsConfig.fcl': File exists ln: failed to create symbolic link './MakeInfillTrainingDataConfig.fcl': File exists ln: failed to create symbolic link './RegCNNAna.fcl': File exists ln: failed to create symbolic link './RegCNNEvaluator.fcl': File exists ln: failed to create symbolic link './RegCNNEventDump.fcl': File exists ln: failed to create symbolic link './RegCNNMapper.fcl': File exists ln: failed to create symbolic link './RegCNNPyTorch.fcl': File exists ln: failed to create symbolic link './RegCNNVertexAna.fcl': File exists ln: failed to create symbolic link './VLNEnergyDataGenConfigs.fcl': File exists ln: failed to create symbolic link './VLNEvaluatorConfigs.fcl': File exists ln: failed to create symbolic link './VLNVarConfigs.fcl': File exists ln: failed to create symbolic link './angularreco.fcl': File exists ln: failed to create symbolic link './checkrecoenergy.fcl': File exists ln: failed to create symbolic link './cluster3dalgorithms_dune35t.fcl': File exists ln: failed to create symbolic link './clusteralgorithms_dune35t.fcl': File exists ln: failed to create symbolic link './clusterfinder_dune.fcl': File exists ln: failed to create symbolic link './ctphelper.fcl': File exists ln: failed to create symbolic link './cvn_dune.fcl': File exists ln: failed to create symbolic link './cvnmapevaluatejob.fcl': File exists ln: failed to create symbolic link './cvnmapeventdumpjob.fcl': File exists ln: failed to create symbolic link './disambigcheck.fcl': File exists ln: failed to create symbolic link './dune_cvn_eval.fcl': File exists ln: failed to create symbolic link './dune_cvn_event_dump_fhc.fcl': File exists ln: failed to create symbolic link './dune_cvn_event_dump_rhc.fcl': File exists ln: failed to create symbolic link './dune_cvn_zlib_maker.fcl': File exists ln: failed to create symbolic link './dunehd_1x2x6_cvn_eval_fhc.fcl': File exists ln: failed to create symbolic link './dunehd_1x2x6_cvn_eval_rhc.fcl': File exists ln: failed to create symbolic link './dunehd_1x2x6_cvn_zlib_maker.fcl': File exists ln: failed to create symbolic link './dunevd_3view_cvn_eval.fcl': File exists ln: failed to create symbolic link './dunevd_3view_cvn_zlib_maker.fcl': File exists ln: failed to create symbolic link './dunevd_8x6_cvn_eval_fhc.fcl': File exists ln: failed to create symbolic link './dunevd_8x6_cvn_eval_rhc.fcl': File exists ln: failed to create symbolic link './dunevd_8x6_cvn_zlib_maker.fcl': File exists ln: failed to create symbolic link './energyreco.fcl': File exists ln: failed to create symbolic link './hitfindermodules_dune.fcl': File exists ln: failed to create symbolic link './multitpcdump.fcl': File exists ln: failed to create symbolic link './mvamodule.fcl': File exists ln: failed to create symbolic link './mvaselectnue.fcl': File exists ln: failed to create symbolic link './mvaselectnumu.fcl': File exists ln: failed to create symbolic link './neutrinoangularrecoalg_dune.fcl': File exists ln: failed to create symbolic link './neutrinoenergyrecoalg_dune.fcl': File exists ln: failed to create symbolic link './nueanamodule.fcl': File exists ln: failed to create symbolic link './numberofhitsfilter.fcl': File exists ln: failed to create symbolic link './pandoramodularshowertools_dune.fcl': File exists ln: failed to create symbolic link './pandoramodules_dune.fcl': File exists ln: failed to create symbolic link './pandoranuselection.fcl': File exists ln: failed to create symbolic link './pdhd_wirecell_sim_deposplat.fcl': File exists ln: failed to create symbolic link './pfpeff.fcl': File exists ln: failed to create symbolic link './pointrestree.fcl': File exists ln: failed to create symbolic link './pointrestree_1x2x2.fcl': File exists ln: failed to create symbolic link './pointrestree_NuEScatter.fcl': File exists ln: failed to create symbolic link './pointrestree_legacy.fcl': File exists ln: failed to create symbolic link './pointrestree_marley.fcl': File exists ln: failed to create symbolic link './protodune_cvn_eval.fcl': File exists ln: failed to create symbolic link './protodune_cvn_event_dump.fcl': File exists ln: failed to create symbolic link './protodune_gcn_zlib_maker.fcl': File exists ln: failed to create symbolic link './protodunevd_wirecell_img.fcl': File exists ln: failed to create symbolic link './protodunevd_wirecell_sim_deposplat.fcl': File exists ln: failed to create symbolic link './recoenergys.fcl': File exists ln: failed to create symbolic link './recoenergys_v1.fcl': File exists ln: failed to create symbolic link './recoenergys_vd.fcl': File exists ln: failed to create symbolic link './recoenergystudies.fcl': File exists ln: failed to create symbolic link './regcnn_numu_ana_job.fcl': File exists ln: failed to create symbolic link './regcnn_numu_eval_job.fcl': File exists ln: failed to create symbolic link './regcnnanajob.fcl': File exists ln: failed to create symbolic link './regcnnevaluatejob.fcl': File exists ln: failed to create symbolic link './regcnneventdumpjob.fcl': File exists ln: failed to create symbolic link './runConvTrackDump.fcl': File exists ln: failed to create symbolic link './runConvTrackPID.fcl': File exists ln: failed to create symbolic link './runPandoraNuSelection_standard.fcl': File exists ln: failed to create symbolic link './run_InfillChannelsFD.fcl': File exists ln: failed to create symbolic link './run_InfillChannelsPD.fcl': File exists ln: failed to create symbolic link './run_MakeInfillTrainingData.fcl': File exists ln: failed to create symbolic link './runcheckereco.fcl': File exists ln: failed to create symbolic link './sp_fd_adcdump_job_example.fcl': File exists ln: failed to create symbolic link './trackfindermodules_dune.fcl': File exists ln: failed to create symbolic link './vlnenergyanalyzejob.fcl': File exists ln: failed to create symbolic link './vlnenergydatagenjob.fcl': File exists ln: failed to create symbolic link './vlnenergyevalnumujob.fcl': File exists ln: failed to create symbolic link './wirecell_dune.fcl': File exists === Start last 20 lines of lar log file === 16-Aug-2025 03:35:56 CEST Closed input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/95/90/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_796_20231204T140413Z_gen_g4_detsim_hitreco__20240509T202818Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 0.092588 0.759939 7.04353 0.299031 1.28892 100 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.000994611 0.00529255 0.0383739 0.00221475 0.00624912 100 reco:rns:RandomNumberSaver 4.405e-05 8.48445e-05 0.000672291 7.6395e-05 6.21171e-05 100 [art]:TriggerResults:TriggerResultInserter 1.1e-05 2.1794e-05 6.8251e-05 1.915e-05 9.28561e-06 100 end_path:recoEnergy:RecoEnergyS 0.0908471 0.75421 7.02516 0.280956 1.28849 100 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 20718.5 MB Peak resident set size usage (VmHWM): 2298.76 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 20 lines of lar log file === lar exit code 0 No files available from this stage Could not get file No files available from this stage Could not get file No files available from this stage Could not get file No files available from this stage Could not get file No files available from this stage Could not get file No files available from this stage Could not get file No files available from this stage Could not get file No files available from this stage Could not get file No files available from this stage Could not get file