justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 207445.0@dunegpschedd02.fnal.gov

Jobsub ID207445.0@dunegpschedd02.fnal.gov
Workflow ID8113
Stage ID1
User namemsiden@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes2096103424 (1999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-26 18:38:53
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce02
Last heartbeat2025-09-26 18:41:12
From worker nodeHostnamecn515.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statestalled
Started2025-09-26 18:40:36
Input filesvd-protodune-det-reco:np02vd_raw_run039255_0620_df-s02-d0_dw_0_20250830T171244_reco_stage1_20250910T102745_keepup.root
Outputting started2025-09-26 18:41:12
Output files
Finished2025-09-26 19:40:53
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
  File: '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/6b5ffdf0c25700a16ee1758cfcb75a1d5c35e73c'
  Size: 4096      	Blocks: 9          IO Block: 4096   directory
Device: 8fh/143d	Inode: 4112        Links: 5
Access: (0755/drwxr-xr-x)  Uid: (65534/ UNKNOWN)   Gid: (65534/ UNKNOWN)
Access: 2025-09-23 17:57:42.000000000 +0100
Modify: 2025-09-23 17:57:42.000000000 +0100
Change: 2025-09-23 17:57:42.000000000 +0100
 Birth: -
Set dunesw to /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/6b5ffdf0c25700a16ee1758cfcb75a1d5c35e73c
Will use justin-get-file
pfn: root://se1.farm.particle.cz:1094//dune/RSE/vd-protodune-det-reco/c1/d8/np02vd_raw_run039255_0620_df-s02-d0_dw_0_20250830T171244_reco_stage1_20250910T102745_keepup.root
did: vd-protodune-det-reco:np02vd_raw_run039255_0620_df-s02-d0_dw_0_20250830T171244_reco_stage1_20250910T102745_keepup.root
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_10_02d00/gdml/protodunevd_v5_ggd.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Error: Unsupported GDML Tag Used :gdml_simple_extension. Please Check Geometry/Schema.
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16484 nodes/ 2469 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
GeoApaChannelGroupService::ctor: Group 0 (apa0) has 3072 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 1 (apa1) has 3072 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 2 (apa2) has 3072 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 3 (apa3) has 3072 channels from 3/3 readout planes.
DAPHNE Channel Map: Building DAPHNE channel map from file PDVD_PDS_Mapping_v07082025.json
PDSP Channel Map: Building RCE TPC wiremap from file protoDUNETPCChannelMap_RCE_v4.txt
PDSP Channel Map: Building FELIX TPC wiremap from file protoDUNETPCChannelMap_RCE_v4.txt
PDSP Channel Map: Building SSP channel map from file protoDUNESSPChannelMap_v1.txt
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
TPC Channel Map: Building TPC wiremap from file PD2VDBottomTPCChannelMap_v1.txt
26-Sep-2025 19:40:51 BST  Initiating request to open input file "root://se1.farm.particle.cz:1094//dune/RSE/vd-protodune-det-reco/c1/d8/np02vd_raw_run039255_0620_df-s02-d0_dw_0_20250830T171244_reco_stage1_20250910T102745_keepup.root"
26-Sep-2025 19:40:53 BST  Opened input file "root://se1.farm.particle.cz:1094//dune/RSE/vd-protodune-det-reco/c1/d8/np02vd_raw_run039255_0620_df-s02-d0_dw_0_20250830T171244_reco_stage1_20250910T102745_keepup.root"
db: runtime1756573962
Begin processing the 1st record. run: 39255 subRun: 1 event: 223202 at 26-Sep-2025 19:40:54 BST
26-Sep-2025 19:41:10 BST  Closed input file "root://se1.farm.particle.cz:1094//dune/RSE/vd-protodune-det-reco/c1/d8/np02vd_raw_run039255_0620_df-s02-d0_dw_0_20250830T171244_reco_stage1_20250910T102745_keepup.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          15.6707       15.6707       15.6707       15.6707          0            1     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)             0.0221572     0.0221572     0.0221572     0.0221572         0            1     
end_path:calibana:CalibAnaTree      15.6477       15.6477       15.6477       15.6477          0            1     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1301.5 MB
  Peak resident set size usage (VmHWM): 658.866 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 460K
-rw-r--r-- 1 pildune22 pildune 402K Sep 26 19:41 np02vd_raw_run039255_0620_df-s02-d0_dw_0_20250830T171244_reco_stage1_20250910T102745_keepup_reco_hist.root
-rw-r--r-- 1 pildune22 pildune  28K Sep 26 19:41 mem.db
-rw-r--r-- 1 pildune22 pildune  16K Sep 26 19:41 time.db
-rw-r--r-- 1 pildune22 pildune 5.2K Sep 26 19:41 jobscript.log
-rw-r--r-- 1 pildune22 pildune  119 Sep 26 19:40 all-input-dids.txt
-rw-r--r-- 1 pildune22 pildune    0 Sep 26 19:40 debugprod.log
disk usage
464K	.
justIN time: 2025-11-04 15:52:12 UTC       justIN version: 01.05.01