Jobsub ID 240229.1@dunegpschedd01.fnal.gov
| Jobsub ID | 240229.1@dunegpschedd01.fnal.gov |
| Workflow ID | 9431 |
| Stage ID | 1 |
| User name | drivera@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 6815744000 (6500 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-10-29 12:46:29 |
| Site | UK_Sheffield |
| Entry | DUNE_UK_Sheffield_lcgce2 |
| Last heartbeat | 2025-10-29 20:29:42 |
| From worker node | Hostname | wn043.hep |
| cpuinfo | AMD EPYC 7402 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 7864320000 (7500 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-10-29 12:47:52 |
| Input files | hd-protodune:np04hd_raw_run032935_0003_dataflow5_datawriter_0_20241204T003417.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 7h (27301s) |
| CPU time | 7h (25816s = 94%) |
| Max RSS bytes | 2484740096 (2369 MiB) |
| Outputting started | 2025-10-29 20:22:54 |
| Output files | |
| Finished | 2025-10-29 20:29:42 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ples within desired window for channel 7536
wclsFrameSaver: no samples within desired window for channel 7537
wclsFrameSaver: no samples within desired window for channel 7537
wclsFrameSaver: no samples within desired window for channel 7537
wclsFrameSaver: no samples within desired window for channel 7537
wclsFrameSaver: no samples within desired window for channel 7538
wclsFrameSaver: no samples within desired window for channel 7538
wclsFrameSaver: no samples within desired window for channel 7539
wclsFrameSaver: no samples within desired window for channel 7539
wclsFrameSaver: no samples within desired window for channel 7540
wclsFrameSaver: no samples within desired window for channel 7541
wclsFrameSaver: no samples within desired window for channel 7542
wclsFrameSaver: no samples within desired window for channel 7641
wclsFrameSaver: no samples within desired window for channel 7642
wclsFrameSaver: no samples within desired window for channel 7643
wclsFrameSaver: no samples within desired window for channel 7650
wclsFrameSaver: no samples within desired window for channel 7652
wclsFrameSaver: no samples within desired window for channel 7858
wclsFrameSaver: no samples within desired window for channel 7859
wclsFrameSaver: no samples within desired window for channel 7859
wclsFrameSaver: no samples within desired window for channel 7863
wclsFrameSaver: no samples within desired window for channel 7864
wclsFrameSaver: no samples within desired window for channel 7865
wclsFrameSaver: no samples within desired window for channel 7868
wclsFrameSaver: no samples within desired window for channel 7868
wclsFrameSaver: no samples within desired window for channel 7869
wclsFrameSaver: no samples within desired window for channel 7870
wclsFrameSaver: no samples within desired window for channel 7870
wclsFrameSaver: no samples within desired window for channel 7871
wclsFrameSaver: no samples within desired window for channel 7871
wclsFrameSaver: no samples within desired window for channel 7872
wclsFrameSaver: no samples within desired window for channel 7872
wclsFrameSaver: no samples within desired window for channel 7873
wclsFrameSaver: no samples within desired window for channel 7874
wclsFrameSaver: no samples within desired window for channel 7874
wclsFrameSaver: no samples within desired window for channel 7875
wclsFrameSaver: no samples within desired window for channel 7876
wclsFrameSaver: no samples within desired window for channel 7876
wclsFrameSaver: no samples within desired window for channel 7877
wclsFrameSaver: no samples within desired window for channel 7878
wclsFrameSaver: no samples within desired window for channel 8276
wclsFrameSaver: no samples within desired window for channel 8277
wclsFrameSaver: no samples within desired window for channel 8592
wclsFrameSaver: no samples within desired window for channel 8663
wclsFrameSaver: no samples within desired window for channel 8742
wclsFrameSaver: no samples within desired window for channel 8743
wclsFrameSaver: no samples within desired window for channel 8744
wclsFrameSaver: no samples within desired window for channel 8744
wclsFrameSaver: no samples within desired window for channel 8744
wclsFrameSaver: no samples within desired window for channel 8744
wclsFrameSaver: no samples within desired window for channel 8746
wclsFrameSaver: no samples within desired window for channel 8747
wclsFrameSaver: no samples within desired window for channel 8748
wclsFrameSaver: no samples within desired window for channel 8749
wclsFrameSaver: no samples within desired window for channel 8749
wclsFrameSaver: no samples within desired window for channel 8900
wclsFrameSaver: no samples within desired window for channel 9052
wclsFrameSaver: no samples within desired window for channel 9059
wclsFrameSaver: no samples within desired window for channel 9426
wclsFrameSaver: no samples within desired window for channel 9427
wclsFrameSaver: no samples within desired window for channel 9561
wclsFrameSaver: no samples within desired window for channel 9561
wclsFrameSaver: no samples within desired window for channel 9562
wclsFrameSaver: no samples within desired window for channel 9562
wclsFrameSaver: no samples within desired window for channel 9562
wclsFrameSaver: no samples within desired window for channel 9563
wclsFrameSaver: no samples within desired window for channel 9563
wclsFrameSaver: no samples within desired window for channel 9564
wclsFrameSaver: no samples within desired window for channel 9564
wclsFrameSaver: no samples within desired window for channel 9564
wclsFrameSaver: no samples within desired window for channel 9565
wclsFrameSaver: no samples within desired window for channel 9565
wclsFrameSaver: no samples within desired window for channel 9566
wclsFrameSaver: no samples within desired window for channel 9567
wclsFrameSaver: no samples within desired window for channel 9567
wclsFrameSaver: no samples within desired window for channel 9568
wclsFrameSaver: no samples within desired window for channel 9570
wclsFrameSaver: no samples within desired window for channel 9622
wclsFrameSaver: no samples within desired window for channel 9730
wclsFrameSaver: no samples within desired window for channel 9751
FrameSaver: q=4.7299e+06 n=1202909 tag=wiener
29-Oct-2025 20:22:51 GMT Closed output file "np04hd_raw_run032935_0003_dataflow5_datawriter_0_20241204T003417_1_240229_1_1761742085_deco_reco.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 128.939 693.683 2501.33 540.969 494.496 39
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.917e-05 0.000115898 0.000629637 9.7023e-05 9.10237e-05 39
produce:tpcrawdecoder:PDHDTPCReader 19.4866 20.4175 21.4125 20.4755 0.473416 39
produce:fembfilter:PDHDFEMBFilter 0.000117311 0.000159776 0.000683008 0.000135034 8.91208e-05 39
produce:wclsdatahd:WireCellToolkit 62.3342 83.5985 95.5976 85.3841 8.05798 39
produce:gaushit:GausHitFinder 0.804585 1.77787 3.00561 1.71423 0.450595 39
produce:nhitsfilter:NumberOfHitsFilter 0.00038683 0.000929712 0.00129545 0.000889757 0.000229333 39
produce:reco3d:SpacePointSolver 0.486694 73.3595 198.075 68.6925 51.4342 39
produce:hitpdune:DisambigFromSpacePoints 0.498157 7.369 12.8711 7.69787 3.08132 39
produce:pandora:StandardPandora 16.7397 483.99 2151.65 323.89 438.024 39
produce:pandoraWriter:StandardPandora 0.215564 0.719296 1.43776 0.683965 0.235178 39
produce:pandoraTrack:LArPandoraTrackCreation 1.49695 6.75696 15.2796 6.95081 3.12003 39
produce:pandoraShower:LArPandoraShowerCreation 1.38892 6.51386 16.0507 5.88656 3.14765 39
produce:pandoracalo:Calorimetry 0.742118 3.03968 7.25511 2.85619 1.42914 39
produce:pandoracalonosce:Calorimetry 0.671113 2.90185 6.95662 2.89268 1.38852 39
[art]:TriggerResults:TriggerResultInserter 4.1318e-05 7.48565e-05 0.000218942 7.449e-05 2.68613e-05 39
end_path:out1:RootOutput 6.322e-06 2.23926e-05 6.1767e-05 2.0268e-05 1.13209e-05 39
end_path:out1:RootOutput(write) 1.15597 2.88134 5.48033 2.72094 0.823673 39
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4478.21 MB
Peak resident set size usage (VmHWM): 2484.74 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'np04hd_raw_run032935_0003_dataflow5_datawriter_0_20241204T003417_1_240229_1_1761742085_deco_reco.root', 'start_time': 1761742085.2853456, 'end_time': 1761769372.76954}
lsing
total 1.3G
-rw-r--r--. 1 dune004 dune 928M Oct 29 20:22 np04hd_raw_run032935_0003_dataflow5_datawriter_0_20241204T003417_1_240229_1_1761742085_deco_reco.root
-rw-r--r--. 1 dune004 dune 350M Oct 29 20:22 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune 5.9M Oct 29 20:22 jobscript.log
-rw-r--r--. 1 dune004 dune 5.7M Oct 29 20:22 np04hd_raw_run032935_0003_dataflow5_datawriter_0_20241204T003417_1_240229_1_1761742085_deco_reco.err
-rw-r--r--. 1 dune004 dune 280K Oct 29 20:22 mem.db
-rw-r--r--. 1 dune004 dune 56K Oct 29 20:22 time.db
-rw-r--r--. 1 dune004 dune 42K Oct 29 20:22 np04hd_raw_run032935_0003_dataflow5_datawriter_0_20241204T003417_1_240229_1_1761742085_deco_reco.log
-rw-r--r--. 1 dune004 dune 19K Oct 29 20:22 pdhd_keepup_decoder.root
-rw-r--r--. 1 dune004 dune 3.5K Oct 29 20:22 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune 83 Oct 29 12:48 all-input-dids.txt
-rw-r--r--. 1 dune004 dune 0 Oct 29 12:48 debugprod.log
disk usage
1.3G . 