Jobsub ID 297921.124@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.124@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 00:49:26 |
| From worker node | Hostname | dune001-1535463.0-lcg2708.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:38 |
| Input files | vd-protodune:np02vd_raw_run042433_0128_df-s02-d1_dw_0_20260203T193047.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 50m (3059s) |
| CPU time | 45m (2710s = 88%) |
| Max RSS bytes | 3398254592 (3240 MiB) |
| Outputting started | 2026-02-04 00:47:38 |
| Output files | |
| Finished | 2026-02-04 00:49:26 |
| Saved logs | justin-logs:297921.124-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x62d130a0, 0x3659b6c0
Caught exception in looking up space point ptr... 0x365a28b0, 0x6d5964a0
Caught exception in looking up space point ptr... 0x6d5964a0, 0x6984a6a0
Caught exception in looking up space point ptr... 0x6e49f2a0, 0x6e49f0e0
Caught exception in looking up space point ptr... 0x7bd52930, 0x6e49f2a0
Caught exception in looking up space point ptr... 0x3c05a450, 0x3c05a6f0
Caught exception in looking up space point ptr... 0x3c05a940, 0x3c05a450
Caught exception in looking up space point ptr... 0x3b98c050, 0x70131360
Caught exception in looking up space point ptr... 0x70131360, 0x3b98c050
Caught exception in looking up space point ptr... 0x3b98c050, 0x2c7d8840
Caught exception in looking up space point ptr... 0x2c7d8840, 0x3b98c050
Caught exception in looking up space point ptr... 0xab7303f0, 0x599e3a90
Caught exception in looking up space point ptr... 0x599e3a90, 0xab7303f0
Caught exception in looking up space point ptr... 0x7ac3fec0, 0x7df3e890
Caught exception in looking up space point ptr... 0x7df3e890, 0x82149db0
Caught exception in looking up space point ptr... 0x82149db0, 0xab945b40
Caught exception in looking up space point ptr... 0xab945b40, 0x7ac3fec0
Caught exception in looking up space point ptr... 0x9e98c570, 0x95a20c50
Caught exception in looking up space point ptr... 0x6e148b90, 0x9e98c570
Caught exception in looking up space point ptr... 0x9fccd260, 0x89452790
Caught exception in looking up space point ptr... 0x89452790, 0x9fccd260
Caught exception in looking up space point ptr... 0x9fccd260, 0x2c6650f0
Caught exception in looking up space point ptr... 0x2c6650f0, 0x9fccd260
Caught exception in looking up space point ptr... 0x9fccd260, 0x2c658e90
Caught exception in looking up space point ptr... 0x2c658e90, 0x9fccd260
Caught exception in looking up space point ptr... 0x9fccd260, 0x2c68b560
Caught exception in looking up space point ptr... 0x2c68b560, 0x9fccd260
Caught exception in looking up space point ptr... 0x76e7eba0, 0x7ac3e270
Caught exception in looking up space point ptr... 0x6d562f20, 0x76e7eba0
Caught exception in looking up space point ptr... 0x62a24b20, 0x62a24db0
Caught exception in looking up space point ptr... 0x62a24db0, 0x31754e90
Caught exception in looking up space point ptr... 0x8355e930, 0x8355eac0
Caught exception in looking up space point ptr... 0x8355eac0, 0x8355e930
Caught exception in looking up space point ptr... 0xa36c47c0, 0x6b0efa50
Caught exception in looking up space point ptr... 0x6b0efa50, 0xa36c9240
Caught exception in looking up space point ptr... 0x64eb5c30, 0x64eb5dc0
Caught exception in looking up space point ptr... 0x64eb5dc0, 0x64eb5c30
Caught exception in looking up space point ptr... 0x2f0ce0c0, 0x2f0cf4e0
Caught exception in looking up space point ptr... 0x2f0cf4e0, 0x2f0ce0c0
Caught exception in looking up space point ptr... 0x6d9d1610, 0x6d9d13c0
Caught exception in looking up space point ptr... 0x6d9d13c0, 0x6d9d1610
Caught exception in looking up space point ptr... 0x58583dd0, 0x37e7e5b0
Caught exception in looking up space point ptr... 0x2c839fa0, 0x58583dd0
Caught exception in looking up space point ptr... 0x7b07cbe0, 0xa7504da0
Caught exception in looking up space point ptr... 0xa7504da0, 0xa7504c70
Caught exception in looking up space point ptr... 0x8409bb00, 0xab62c220
Caught exception in looking up space point ptr... 0xab62c220, 0x8409bb00
Caught exception in looking up space point ptr... 0x7a5eeb20, 0x7a5ee990
Caught exception in looking up space point ptr... 0x7a5ee990, 0x7a5ee670
Caught exception in looking up space point ptr... 0x7bcf8470, 0x7bcf72a0
Caught exception in looking up space point ptr... 0x7bcf72a0, 0x7bcf8470
Caught exception in looking up space point ptr... 0x76ce51d0, 0x76ce4eb0
Caught exception in looking up space point ptr... 0x76ce4eb0, 0x76ce51d0
Caught exception in looking up space point ptr... 0x2fdd7780, 0x2fdd75f0
Caught exception in looking up space point ptr... 0x2fdd75f0, 0x2fdd7910
Caught exception in looking up space point ptr... 0x648631f0, 0x95c07e60
Caught exception in looking up space point ptr... 0x95c07e60, 0x648631f0
Caught exception in looking up space point ptr... 0x8e23e280, 0x8e23e320
Caught exception in looking up space point ptr... 0x8e23e320, 0x8e23e280
Caught exception in looking up space point ptr... 0x2ef64fc0, 0x8e234890
Caught exception in looking up space point ptr... 0x8e234890, 0x2ef64fc0
Caught exception in looking up space point ptr... 0x3b984cd0, 0x3b9682b0
Caught exception in looking up space point ptr... 0x3b9682b0, 0x3b984cd0
Caught exception in looking up space point ptr... 0x6e4a3920, 0x5bae1290
Caught exception in looking up space point ptr... 0x5bae1290, 0x6e4a3920
Caught exception in looking up space point ptr... 0x6b2bff30, 0x6b2bc600
Caught exception in looking up space point ptr... 0x84106820, 0x6b2bff30
++++>>>> total num hits: 78014, num free: 74636
04-Feb-2026 00:47:30 UTC Closed output file "np02vd_raw_run042433_0128_df-s02-d1_dw_0_20260203T193047_reco_stage0_20260204T004730_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 144.031 156.96 170.554 156.069 7.25283 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.5293e-05 0.000130243 0.000366492 9.4882e-05 7.1165e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.3915 18.8003 27.169 18.3224 2.55335 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.666339 0.709198 0.811099 0.707793 0.0274935 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0230094 0.0257949 0.0393591 0.0233305 0.00464017 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0228216 0.0231477 0.0236521 0.0231583 0.000177924 19
produce:beamevent:BeamEvent 0.000103415 0.000208573 0.00108758 0.000170186 0.000208367 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.16836 3.50566 3.91154 3.48667 0.197778 19
produce:ophit:OpHitFinder 0.0253252 0.0411445 0.0509699 0.0411597 0.00542678 19
produce:wclsdatavd:WireCellToolkit 99.562 109.394 122.291 110.203 6.05671 19
produce:gaushit:GausHitFinder 0.777399 1.33867 2.12794 1.33444 0.333812 19
produce:nhitsfilter:NumberOfHitsFilter 0.000183436 0.000300475 0.000691801 0.000300662 0.000109096 19
produce:reco3d:SpacePointSolver 9.3561 14.9482 20.7584 14.1302 3.31998 19
produce:hitpdune:DisambigFromSpacePoints 0.0769961 0.202829 0.351207 0.179034 0.0748134 19
produce:cluster3d:Cluster3D 0.865048 2.64352 4.97058 2.35173 1.09479 19
[art]:TriggerResults:TriggerResultInserter 2.2494e-05 3.48567e-05 0.000110967 3.0877e-05 1.83697e-05 19
end_path:out1:RootOutput 3.856e-06 8.89695e-06 2.5048e-05 8.412e-06 4.36153e-06 19
end_path:out1:RootOutput(write) 3.84861 5.27678 6.32958 5.37878 0.748844 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5571.85 MB
Peak resident set size usage (VmHWM): 3398.25 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0128_df-s02-d1_dw_0_20260203T193047_reco_stage0_20260204T004730_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0128_df-s02-d1_dw_0_20260203T193047_reco_stage0_20260204T004730_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0128_df-s02-d1_dw_0_20260203T193047_reco_stage0_20260204T004730_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163009.0,
"core.end_time": 1770166052.0,
"core.events": [
14599,
14605,
14611,
14617,
14623,
14629,
14635,
14641,
14647,
14653,
14659,
14665,
14671,
14677,
14683,
14689,
14695,
14701,
14707
],
"core.event_count": 19,
"core.first_event_number": 14599,
"core.last_event_number": 14707,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0128_df-s02-d1_dw_0_20260203T193047.hdf5"
}
]
} 