justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279089.138@dunegpschedd01.fnal.gov

Jobsub ID279089.138@dunegpschedd01.fnal.gov
Workflow ID11899
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-15 12:39:53
SiteUK_Bristol
EntryCMSHTPC_T2_UK_SGrid_Bristol_lcgce02
Last heartbeat2026-01-15 13:19:40
From worker nodeHostnamehd88.dice.priv
cpuinfoAMD EPYC 7713 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit259200 (72 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 13:02:12
Input filesmonte-carlo-011899-000515
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2026-01-15 13:19:40
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

eturns: okay
SimDepoSetSource: ready with 170603 depos spanning: [5.00355e-07, 1374.43]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 182904 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 182904 depos spanning: [5.00356e-07, 1329.94]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 231210 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 231210 depos spanning: [5.00424e-07, 992.133]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 282551 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 282551 depos spanning: [5.00357e-07, 729.214]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 212373 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 212373 depos spanning: [-596.746, 1276.63]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 242872 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 242872 depos spanning: [-1448.65, 5.00675]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 181673 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 181673 depos spanning: [5.00363e-07, 869.135]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"

Error in processing detsim
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  opdigi
  sipmSim
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/protodunevd_v5_ggd.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16484 nodes/ 2469 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsSimDepoSetSource:electron"
Outputer: "wclsDepoFluxWriter:postdrift"
Outputer: "wclsFrameSaver:simdigits"
wclsFrameSaver: promising to produce raw::RawDigits named "daq"
SimDepoSetSource got 136709 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 136709 depos spanning: [-1170.3, 1390.31]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 193271 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 193271 depos spanning: [-1440.22, 1172.82]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 266923 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 266923 depos spanning: [5.00356e-07, 1278.24]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 265981 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 265981 depos spanning: [-1327.25, 1096.1]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 287975 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 287975 depos spanning: [-657.854, 1.88208]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 218373 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 218373 depos spanning: [-1022.45, 2.99389]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 259168 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 259168 depos spanning: [-1453.95, 988.09]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 214540 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 214540 depos spanning: [-909.335, 1067.44]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 185495 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 185495 depos spanning: [-924.59, 612.62]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 220427 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 220427 depos spanning: [-1353.34, 1262.51]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 190288 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 190288 depos spanning: [-729.039, 727.305]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 218948 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 218948 depos spanning: [5.0036e-07, 638.855]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 298503 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 298503 depos spanning: [-1411, 3.53486]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 170603 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 170603 depos spanning: [5.00355e-07, 1374.43]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 182904 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 182904 depos spanning: [5.00356e-07, 1329.94]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 231210 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 231210 depos spanning: [5.00424e-07, 992.133]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 282551 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 282551 depos spanning: [5.00357e-07, 729.214]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 212373 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 212373 depos spanning: [-596.746, 1276.63]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 242872 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 242872 depos spanning: [-1448.65, 5.00675]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"
SimDepoSetSource got 181673 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 181673 depos spanning: [5.00363e-07, 869.135]us
Retagger: tagging trace set: daq with 12288 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "daq"

../justin-jobscript: line 167: date: command not found
../justin-jobscript: line 170: ls: command not found
Output files:
 larcv files: 
../justin-jobscript: line 175: grep: command not found
../justin-jobscript: line 175: grep: command not found
../justin-jobscript: line 175: cut: command not found
../justin-jobscript: line 177: /cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: Transport endpoint is not connected
Error in larcv metadata
justIN time: 2026-02-04 04:49:08 UTC       justIN version: 01.06.00