Jobsub ID 32472.6@dunegpschedd02.fnal.gov
| Jobsub ID | 32472.6@dunegpschedd02.fnal.gov |
| Workflow ID | 2135 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod.mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-02 21:43:08 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc01 |
| Last heartbeat | 2025-09-02 23:20:36 |
| From worker node | Hostname | wn-la-18.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Started | 2025-09-02 21:51:31 |
| Input files | vd-protodune:np02vd_raw_run039275_0446_df-s02-d0_dw_0_20250902T052410.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Max RSS bytes | 0 (0 MiB) |
| Outputting started | |
| Output files | |
| Finished | 2025-09-02 23:20:36 |
| Saved logs | justin-logs:32472.6-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
16
wclsFrameSaver: no samples within desired window for channel 11416
wclsFrameSaver: no samples within desired window for channel 11418
FrameSaver: q=6.75695e+06 n=909592 tag=gauss
wclsFrameSaver: saving 52934 traces tagged "wiener"
wclsFrameSaver: no samples within desired window for channel 6461
wclsFrameSaver: no samples within desired window for channel 6780
wclsFrameSaver: no samples within desired window for channel 6901
wclsFrameSaver: no samples within desired window for channel 6903
wclsFrameSaver: no samples within desired window for channel 6903
wclsFrameSaver: no samples within desired window for channel 6941
wclsFrameSaver: no samples within desired window for channel 6942
wclsFrameSaver: no samples within desired window for channel 6989
wclsFrameSaver: no samples within desired window for channel 7168
wclsFrameSaver: no samples within desired window for channel 7340
wclsFrameSaver: no samples within desired window for channel 7443
wclsFrameSaver: no samples within desired window for channel 7630
wclsFrameSaver: no samples within desired window for channel 7679
wclsFrameSaver: no samples within desired window for channel 7682
wclsFrameSaver: no samples within desired window for channel 7740
wclsFrameSaver: no samples within desired window for channel 7772
wclsFrameSaver: no samples within desired window for channel 7772
wclsFrameSaver: no samples within desired window for channel 7773
wclsFrameSaver: no samples within desired window for channel 7774
wclsFrameSaver: no samples within desired window for channel 7774
wclsFrameSaver: no samples within desired window for channel 7799
wclsFrameSaver: no samples within desired window for channel 7929
wclsFrameSaver: no samples within desired window for channel 7930
wclsFrameSaver: no samples within desired window for channel 7930
wclsFrameSaver: no samples within desired window for channel 7931
wclsFrameSaver: no samples within desired window for channel 7931
wclsFrameSaver: no samples within desired window for channel 7932
wclsFrameSaver: no samples within desired window for channel 7932
wclsFrameSaver: no samples within desired window for channel 7933
wclsFrameSaver: no samples within desired window for channel 7985
wclsFrameSaver: no samples within desired window for channel 8597
wclsFrameSaver: no samples within desired window for channel 8715
wclsFrameSaver: no samples within desired window for channel 8716
wclsFrameSaver: no samples within desired window for channel 8946
wclsFrameSaver: no samples within desired window for channel 8949
wclsFrameSaver: no samples within desired window for channel 8950
wclsFrameSaver: no samples within desired window for channel 8950
wclsFrameSaver: no samples within desired window for channel 8951
wclsFrameSaver: no samples within desired window for channel 8951
wclsFrameSaver: no samples within desired window for channel 8952
wclsFrameSaver: no samples within desired window for channel 8953
wclsFrameSaver: no samples within desired window for channel 8953
wclsFrameSaver: no samples within desired window for channel 8953
wclsFrameSaver: no samples within desired window for channel 8954
wclsFrameSaver: no samples within desired window for channel 8955
wclsFrameSaver: no samples within desired window for channel 8955
wclsFrameSaver: no samples within desired window for channel 9113
wclsFrameSaver: no samples within desired window for channel 9314
wclsFrameSaver: no samples within desired window for channel 9409
wclsFrameSaver: no samples within desired window for channel 9859
wclsFrameSaver: no samples within desired window for channel 9873
wclsFrameSaver: no samples within desired window for channel 9952
wclsFrameSaver: no samples within desired window for channel 10233
wclsFrameSaver: no samples within desired window for channel 10318
wclsFrameSaver: no samples within desired window for channel 10328
wclsFrameSaver: no samples within desired window for channel 10453
wclsFrameSaver: no samples within desired window for channel 10455
wclsFrameSaver: no samples within desired window for channel 10633
wclsFrameSaver: no samples within desired window for channel 10937
wclsFrameSaver: no samples within desired window for channel 11091
wclsFrameSaver: no samples within desired window for channel 11122
wclsFrameSaver: no samples within desired window for channel 11160
wclsFrameSaver: no samples within desired window for channel 11160
wclsFrameSaver: no samples within desired window for channel 11161
wclsFrameSaver: no samples within desired window for channel 11161
wclsFrameSaver: no samples within desired window for channel 11162
wclsFrameSaver: no samples within desired window for channel 11416
wclsFrameSaver: no samples within desired window for channel 11416
wclsFrameSaver: no samples within desired window for channel 11418
wclsFrameSaver: no samples within desired window for channel 11418
FrameSaver: q=7.06566e+06 n=877473 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 348 XUs and 315 XVs -> 7 XUVs
C:0 T:1 73 XUs and 72 XVs -> 1 XUVs
C:0 T:2 469 XUs and 419 XVs -> 12 XUVs
C:0 T:3 1137 XUs and 1153 XVs -> 28 XUVs
C:0 T:4 251 XUs and 557 XVs -> 8 XUVs
C:0 T:5 271 XUs and 357 XVs -> 19 XUVs
C:0 T:6 417 XUs and 460 XVs -> 32 XUVs
C:0 T:7 1418 XUs and 1194 XVs -> 49 XUVs
C:0 T:8 2253 XUs and 2796 XVs -> 75 XUVs
C:0 T:9 816 XUs and 1125 XVs -> 37 XUVs
C:0 T:10 1319 XUs and 1747 XVs -> 71 XUVs
C:0 T:11 2184 XUs and 2774 XVs -> 133 XUVs
C:0 T:12 687 XUs and 1195 XVs -> 48 XUVs
C:0 T:13 2372 XUs and 2498 XVs -> 97 XUVs
C:0 T:14 736 XUs and 1197 XVs -> 60 XUVs
C:0 T:15 2027 XUs and 2626 XVs -> 94 XUVs
771 XUVs total
698 collection wire objects
771 potential space points
Neighbour search...
2959 tests to find 1526 neighbours
Iterating with no regularization...
Begin: 3.17717e+08
0 3.11114e+08
1 3.09008e+08
2 3.08991e+08
Now with regularization...
Begin: 3.06948e+08
0 3.06948e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
03-Sep-2025 01:19:38 CEST Closed output file "np02vd_raw_run039275_0446_df-s02-d0_dw_0_20250902T052410_reco_stage1_20250902T231938_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 202.369 289.952 483.963 281.392 71.4273 18
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.3209e-05 9.48537e-05 0.000286007 8.14425e-05 4.69069e-05 18
produce:tpcrawdecoder:PDVDTPCReader 23.684 35.8259 47.4103 36.0247 7.13851 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.0366247 0.0382824 0.0398029 0.0382372 0.000665993 18
produce:pdvddaphne:DAPHNEReaderPDVD 7.85098 9.29204 11.3183 9.38934 1.0512 18
produce:ophit:OpHitFinder 0.055606 0.0784607 0.0937859 0.0790413 0.00978523 18
produce:opflash:OpFlashFinderVerticalDrift 0.00921331 0.0166096 0.0274555 0.0166558 0.00353174 18
produce:wclsdatavd:WireCellToolkit 89.8036 109.812 124.995 110.565 9.72326 18
produce:gaushit:GausHitFinder 1.00412 1.73405 2.77154 1.79562 0.433513 18
produce:nhitsfilter:NumberOfHitsFilter 0.000286157 0.000632277 0.00112598 0.000604392 0.000236189 18
produce:reco3d:SpacePointSolver 11.3011 23.3894 48.7482 24.3711 8.50043 18
produce:hitpdune:DisambigFromSpacePoints 0.12816 0.354405 0.899834 0.327967 0.176917 18
produce:pandora:StandardPandora 22.4547 99.524 245.05 95.3607 61.4377 18
produce:pandoraTrack:LArPandoraTrackCreation 0.529318 2.80604 10.5457 2.13835 2.09068 18
produce:pandoraGnocalo:GnocchiCalorimetry 0.020574 0.0436013 0.090736 0.040631 0.0145708 18
[art]:TriggerResults:TriggerResultInserter 2.7822e-05 5.49577e-05 0.000149692 5.4371e-05 2.69789e-05 18
end_path:out1:RootOutput 6.149e-06 1.14865e-05 4.3264e-05 1.007e-05 8.28355e-06 18
end_path:out1:RootOutput(write) 6.43608 6.9221 7.6486 6.97314 0.27958 18
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5117.87 MB
Peak resident set size usage (VmHWM): 3231.42 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039275_0446_df-s02-d0_dw_0_20250902T052410_reco_stage1_20250902T231938_keepup.root
\tHists: np02vd_raw_run039275_0446_df-s02-d0_dw_0_20250902T052410_reco_stage1_20250902T231939_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
