Jobsub ID 242252.168@dunegpschedd01.fnal.gov

Jobsub ID	242252.168@dunegpschedd01.fnal.gov
Workflow ID	9538
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	2
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-11-03 08:44:39
Site	FR_CCIN2P3
Entry	DUNE_FR_CCIN2P3_cccondorce02
Last heartbeat	2025-11-03 10:56:25
From worker node	Hostname	ccwcondor0025
	cpuinfo	AMD EPYC 9334 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	2
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	106200 (29 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-03 09:42:09
Input files	vd-protodune:np02vd_raw_run040346_3182_df-s04-d3_dw_0_20251103T083228.hdf5
Jobscript	Exit code	0
	Real time	1h (4312s)
	CPU time	1h (4159s = 96%)
	Max RSS bytes	3655544832 (3486 MiB)
Outputting started	2025-11-03 10:54:02
Output files	vd-protodune-det-reco:np02vd_raw_run040346_3182_df-s04-d3_dw_0_20251103T083228_reco_stage1_20251103T105350_keepup.root
Finished	2025-11-03 10:56:25
Saved logs	justin-logs:242252.168-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

nel 9438
wclsFrameSaver: no samples within desired window for channel 9438
wclsFrameSaver: no samples within desired window for channel 9439
wclsFrameSaver: no samples within desired window for channel 9440
wclsFrameSaver: no samples within desired window for channel 9441
wclsFrameSaver: no samples within desired window for channel 9814
wclsFrameSaver: no samples within desired window for channel 10144
wclsFrameSaver: no samples within desired window for channel 10144
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10239
wclsFrameSaver: no samples within desired window for channel 10413
wclsFrameSaver: no samples within desired window for channel 10688
wclsFrameSaver: no samples within desired window for channel 10749
wclsFrameSaver: no samples within desired window for channel 10750
wclsFrameSaver: no samples within desired window for channel 11018
wclsFrameSaver: no samples within desired window for channel 11318
wclsFrameSaver: no samples within desired window for channel 11318
wclsFrameSaver: no samples within desired window for channel 11319
wclsFrameSaver: no samples within desired window for channel 11319
wclsFrameSaver: no samples within desired window for channel 11320
wclsFrameSaver: no samples within desired window for channel 11320
wclsFrameSaver: no samples within desired window for channel 11322
wclsFrameSaver: no samples within desired window for channel 11323
wclsFrameSaver: no samples within desired window for channel 11323
wclsFrameSaver: no samples within desired window for channel 11325
wclsFrameSaver: no samples within desired window for channel 11326
wclsFrameSaver: no samples within desired window for channel 11873
wclsFrameSaver: no samples within desired window for channel 11874
wclsFrameSaver: no samples within desired window for channel 11874
wclsFrameSaver: no samples within desired window for channel 11874
wclsFrameSaver: no samples within desired window for channel 11876
wclsFrameSaver: no samples within desired window for channel 11876
wclsFrameSaver: no samples within desired window for channel 11876
wclsFrameSaver: no samples within desired window for channel 11876
wclsFrameSaver: no samples within desired window for channel 11876
wclsFrameSaver: no samples within desired window for channel 12254
wclsFrameSaver: no samples within desired window for channel 12254
wclsFrameSaver: no samples within desired window for channel 12254
FrameSaver: q=1.16976e+07 n=1005978 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1182 XUs and 1310 XVs -> 49 XUVs
C:0 T:1 771 XUs and 719 XVs -> 40 XUVs
C:0 T:2 2204 XUs and 2379 XVs -> 62 XUVs
C:0 T:3 439 XUs and 439 XVs -> 29 XUVs
C:0 T:4 2341 XUs and 2229 XVs -> 95 XUVs
C:0 T:5 2187 XUs and 1336 XVs -> 167 XUVs
C:0 T:6 2746 XUs and 1843 XVs -> 356 XUVs
C:0 T:7 898 XUs and 824 XVs -> 33 XUVs
C:0 T:8 1580 XUs and 1520 XVs -> 84 XUVs
C:0 T:9 1763 XUs and 1816 XVs -> 118 XUVs
C:0 T:10 1233 XUs and 1071 XVs -> 91 XUVs
C:0 T:11 645 XUs and 744 XVs -> 43 XUVs
C:0 T:12 768 XUs and 841 XVs -> 57 XUVs
C:0 T:13 67 XUs and 96 XVs -> 3 XUVs
C:0 T:14 550 XUs and 690 XVs -> 32 XUVs
C:0 T:15 685 XUs and 712 XVs -> 35 XUVs
1294 XUVs total
968 collection wire objects
1294 potential space points
Neighbour search...
18062 tests to find 9792 neighbours
Iterating with no regularization...
Begin: 6.60334e+08
0 6.19739e+08
1 6.18799e+08
2 6.18755e+08
Now with regularization...
Begin: 6.06584e+08
0 6.06536e+08
03-Nov-2025 11:53:50 CET  Closed output file "np02vd_raw_run040346_3182_df-s04-d3_dw_0_20251103T083228_reco_stage1_20251103T105350_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        89.1845       185.311       1201.98       116.28        226.178        23     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      6.8574e-05    0.000115532   0.000248967   9.6105e-05    4.44322e-05      23     
produce:tpcrawdecoder:PDVDTPCReader               5.93263       6.82868       8.02822       6.73277      0.536461        23     
produce:triggerrawdecoder:PDVDTriggerReader4     0.0865556     0.0970264     0.117413      0.0952459    0.00883698       23     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000321197   0.000445066   0.000780142   0.000381118   0.000131548      23     
produce:ophit:OpHitFinder                       5.9731e-05    0.000168194   0.000640801   0.000118419   0.000142128      23     
produce:opflash:OpFlashFinderVerticalDrift      5.3391e-05    0.000106099   0.000424213   6.7202e-05    9.25201e-05      23     
produce:wclsdatavd:WireCellToolkit                52.4676       70.9066       130.31        60.1465       19.535         23     
produce:gaushit:GausHitFinder                    0.667876       1.36212       2.94035       1.2727       0.436837        23     
produce:nhitsfilter:NumberOfHitsFilter          0.000185661   0.00039026    0.00098339    0.000295638   0.000224419      23     
produce:reco3d:SpacePointSolver                   8.2407         13.45        38.717        11.6514       6.52078        23     
produce:hitpdune:DisambigFromSpacePoints         0.102823      0.274706       1.21828       0.19397      0.232796        23     
produce:pandora:StandardPandora                   12.4708       85.0541       999.583       24.0136       201.02         23     
produce:pandoraTrack:LArPandoraTrackCreation     0.647881       1.86508       14.5911      0.942986       2.78785        23     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0206001     0.0367849     0.0707335     0.0320705     0.0120147       23     
[art]:TriggerResults:TriggerResultInserter      2.3225e-05    5.3624e-05    0.000139432   4.4568e-05    2.39247e-05      23     
end_path:out1:RootOutput                         3.815e-06    1.33589e-05   3.6936e-05     9.504e-06    8.59598e-06      23     
end_path:out1:RootOutput(write)                   3.83587       5.3233        7.06904       5.14587      0.691924        23     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5728.22 MB
  Peak resident set size usage (VmHWM): 3655.54 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run040346_3182_df-s04-d3_dw_0_20251103T083228_reco_stage1_20251103T105350_keepup.root
\tHists: np02vd_raw_run040346_3182_df-s04-d3_dw_0_20251103T083228_reco_stage1_20251103T105350_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run040346_3182_df-s04-d3_dw_0_20251103T083228_reco_stage1_20251103T105350_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run040346_3182_df-s04-d3_dw_0_20251103T083228_reco_stage1_20251103T105350_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762167231.0,
    "core.end_time": 1762167231.0,
    "core.events": [
      293671,
      293675,
      293679,
      293683,
      293687,
      293691,
      293695,
      293699,
      293703,
      293707,
      293711,
      293715,
      293719,
      293723,
      293727,
      293731,
      293735,
      293739,
      293743,
      293747,
      293751,
      293755,
      293759
    ],
    "core.event_count": 23,
    "core.first_event_number": 293671,
    "core.last_event_number": 293759,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40346
    ],
    "core.runs_subruns": [
      4034600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040346_3182_df-s04-d3_dw_0_20251103T083228.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run040346_3182_df-s04-d3_dw_0_20251103T083228_reco_stage1_20251103T105350_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762167231.0,
    "core.end_time": 1762167231.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40346
    ],
    "core.runs_subruns": [
      4034600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040346_3182_df-s04-d3_dw_0_20251103T083228.hdf5"
    }
  ]
}