Jobsub ID 293571.0@dunegpschedd02.fnal.gov
| Jobsub ID | 293571.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12245 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2026-01-22 14:19:05 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_brug |
| Last heartbeat | 2026-01-22 14:28:53 |
| From worker node | Hostname | wn-choc-010.farm.nikhef.nl |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-22 14:20:56 |
| Input files | vd-protodune:np02vd_raw_run040362_0065_df-s04-d1_dw_0_20251105T101452.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 6m (399s) |
| CPU time | 4m (258s = 64%) |
| Max RSS bytes | 2411667456 (2299 MiB) |
| Outputting started | 2026-01-22 14:27:37 |
| Output files | |
| Finished | 2026-01-22 14:28:53 |
| Saved logs | justin-logs:293571.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
20, 0x2ecf3da0
Caught exception in looking up space point ptr... 0x2ecf3da0, 0x2e9eea20
Caught exception in looking up space point ptr... 0x34504350, 0x55255770
Caught exception in looking up space point ptr... 0x55255770, 0x55255a00
Caught exception in looking up space point ptr... 0x34506fb0, 0x34504350
Caught exception in looking up space point ptr... 0x55124c10, 0x5508d7c0
Caught exception in looking up space point ptr... 0x5508d7c0, 0x55124c10
Caught exception in looking up space point ptr... 0x333c7be0, 0x333dd0b0
Caught exception in looking up space point ptr... 0x333dd0b0, 0x333c7be0
Caught exception in looking up space point ptr... 0x321a1ea0, 0x32192370
Caught exception in looking up space point ptr... 0x32193680, 0x321a1ea0
Caught exception in looking up space point ptr... 0x31ff01e0, 0x31ff0050
Caught exception in looking up space point ptr... 0x31ff0050, 0x31fefec0
Caught exception in looking up space point ptr... 0x5001e140, 0x50002b80
Caught exception in looking up space point ptr... 0x50002b80, 0x501f0580
Caught exception in looking up space point ptr... 0x3e249580, 0x44d23890
Caught exception in looking up space point ptr... 0x44d23890, 0x44d236d0
Caught exception in looking up space point ptr... 0x4faf91b0, 0x4faf9300
Caught exception in looking up space point ptr... 0x2ecedb30, 0x4faf91b0
Caught exception in looking up space point ptr... 0x2e8448b0, 0x2e8490a0
Caught exception in looking up space point ptr... 0x2e8490a0, 0x2e8491a0
Caught exception in looking up space point ptr... 0x332edea0, 0x332ee030
Caught exception in looking up space point ptr... 0x332ee030, 0x332ee1c0
Caught exception in looking up space point ptr... 0x3212ad50, 0x3212abc0
Caught exception in looking up space point ptr... 0x3212abc0, 0x332edea0
Caught exception in looking up space point ptr... 0x5513f050, 0x55141050
Caught exception in looking up space point ptr... 0x55141050, 0x551304a0
Caught exception in looking up space point ptr... 0x4498f5a0, 0x4498f4a0
Caught exception in looking up space point ptr... 0x4498f4a0, 0x4498f3d0
Caught exception in looking up space point ptr... 0x37a6f200, 0x37a93e10
Caught exception in looking up space point ptr... 0x37acdee0, 0x37a6f200
Caught exception in looking up space point ptr... 0x2e913340, 0x2e9131f0
Caught exception in looking up space point ptr... 0x2e9131f0, 0x2e9130a0
Caught exception in looking up space point ptr... 0x3e214730, 0x3e339d60
Caught exception in looking up space point ptr... 0x3e339d60, 0x3e214730
Caught exception in looking up space point ptr... 0x312dbb30, 0x31333750
Caught exception in looking up space point ptr... 0x31333750, 0x312dbb30
Caught exception in looking up space point ptr... 0x61c6ac30, 0x61c6ad30
Caught exception in looking up space point ptr... 0x61c7ea80, 0x61c6ac30
Caught exception in looking up space point ptr... 0x3e33c750, 0x3e3ee170
Caught exception in looking up space point ptr... 0x3e3ee170, 0x3e3f3f20
Caught exception in looking up space point ptr... 0x4b297090, 0x4b296f00
Caught exception in looking up space point ptr... 0x4b296f00, 0x4b296d70
Caught exception in looking up space point ptr... 0x38be1160, 0x38be1260
Caught exception in looking up space point ptr... 0x38be1260, 0x38b7bd70
Caught exception in looking up space point ptr... 0x61c632c0, 0x2ec06970
Caught exception in looking up space point ptr... 0x2ec06970, 0x61c632c0
Caught exception in looking up space point ptr... 0x346b0790, 0x346e1900
Caught exception in looking up space point ptr... 0x346e1900, 0x346ad6d0
Caught exception in looking up space point ptr... 0x38c162c0, 0x38b72b70
Caught exception in looking up space point ptr... 0x38b72b70, 0x38c162c0
Caught exception in looking up space point ptr... 0x2ea3bb80, 0x2e9d1af0
Caught exception in looking up space point ptr... 0x2e9d1af0, 0x2e9c4910
Caught exception in looking up space point ptr... 0x44b31cb0, 0x3e66b3d0
Caught exception in looking up space point ptr... 0x3e66b3d0, 0x3e66a030
Caught exception in looking up space point ptr... 0x2e85f860, 0x2e85f710
Caught exception in looking up space point ptr... 0x2e85f710, 0x2e843620
Caught exception in looking up space point ptr... 0x320aa1c0, 0x4b2d83b0
Caught exception in looking up space point ptr... 0x4b2d83b0, 0x320aa1c0
Caught exception in looking up space point ptr... 0x4fc42930, 0x4fc4b7c0
Caught exception in looking up space point ptr... 0x4fc4b7c0, 0x4fc4b520
Caught exception in looking up space point ptr... 0x6169c250, 0x57df65f0
Caught exception in looking up space point ptr... 0x6169c450, 0x6169c250
Caught exception in looking up space point ptr... 0x3e562b40, 0x3e562c40
Caught exception in looking up space point ptr... 0x3e562c40, 0x3e562b40
Caught exception in looking up space point ptr... 0x2e99d510, 0x2eafc120
Caught exception in looking up space point ptr... 0x2eafc120, 0x2eb0a710
Caught exception in looking up space point ptr... 0x347a0d40, 0x34591680
Caught exception in looking up space point ptr... 0x34591680, 0x34538d10
++++>>>> total num hits: 228640, num free: 221375
22-Jan-2026 15:27:19 CET Opened output file with pattern "%ifb_reco_stage0_%tc_offline.root"
22-Jan-2026 15:27:27 CET Closed output file "np02vd_raw_run040362_0065_df-s04-d1_dw_0_20251105T101452_reco_stage0_20260122T142727_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 315.822 315.822 315.822 315.822 0 1
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000183552 0.000183552 0.000183552 0.000183552 0 1
produce:tpcrawdecoder:PDVDTPCReader 129.647 129.647 129.647 129.647 0 1
produce:triggerrawdecoder:PDVDTriggerReader4 0.750484 0.750484 0.750484 0.750484 0 1
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0210344 0.0210344 0.0210344 0.0210344 0 1
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.086507 0.086507 0.086507 0.086507 0 1
produce:beamevent:BeamEvent 0.000820094 0.000820094 0.000820094 0.000820094 0 1
produce:pdvddaphne:DAPHNEReaderPDVD 0.000844097 0.000844097 0.000844097 0.000844097 0 1
produce:ophit:OpHitFinder 0.00056191 0.00056191 0.00056191 0.00056191 0 1
produce:wclsdatavd:WireCellToolkit 145.672 145.672 145.672 145.672 0 1
produce:gaushit:GausHitFinder 1.91551 1.91551 1.91551 1.91551 0 1
produce:nhitsfilter:NumberOfHitsFilter 0.000891432 0.000891432 0.000891432 0.000891432 0 1
produce:reco3d:SpacePointSolver 19.9207 19.9207 19.9207 19.9207 0 1
produce:hitpdune:DisambigFromSpacePoints 0.427292 0.427292 0.427292 0.427292 0 1
produce:cluster3d:Cluster3D 11.1575 11.1575 11.1575 11.1575 0 1
[art]:TriggerResults:TriggerResultInserter 9.6013e-05 9.6013e-05 9.6013e-05 9.6013e-05 0 1
end_path:out1:RootOutput 2.4566e-05 2.4566e-05 2.4566e-05 2.4566e-05 0 1
end_path:out1:RootOutput(write) 6.20134 6.20134 6.20134 6.20134 0 1
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4200.13 MB
Peak resident set size usage (VmHWM): 2411.67 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run040362_0065_df-s04-d1_dw_0_20251105T101452_reco_stage0_20260122T142727_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run040362_0065_df-s04-d1_dw_0_20251105T101452_reco_stage0_20260122T142727_offline.root
Ran successfully
{
"name": "np02vd_raw_run040362_0065_df-s04-d1_dw_0_20251105T101452_reco_stage0_20260122T142727_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline_hv220.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1769091669.0,
"core.end_time": 1769092049.0,
"core.events": [
6081
],
"core.event_count": 1,
"core.first_event_number": 6081,
"core.last_event_number": 6081,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
40362
],
"core.runs_subruns": [
4036200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run040362_0065_df-s04-d1_dw_0_20251105T101452.hdf5"
}
]
} 