Jobsub ID 238114.0@dunegpschedd01.fnal.gov
| Jobsub ID | 238114.0@dunegpschedd01.fnal.gov | 
| Workflow ID | 9308 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-24 07:36:44 | 
| Site | UK_Lancaster | 
| Entry | UBoone_UK_Lancaster_HEC_grendel_ce02 | 
| Last heartbeat | 2025-10-24 10:27:21 | 
| From worker node | Hostname | comp11-15 | 
| cpuinfo | Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 257400 (71 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-24 07:37:34 | 
| Input files | monte-carlo-009308-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 2h (10086s) | 
| CPU time | 2h (9718s = 96%) | 
| Max RSS bytes | 4225814528 (4030 MiB) | 
| Outputting started | 2025-10-24 10:25:41 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09308/1/001/reco_stage1.root
  | 
| Finished | 2025-10-24 10:27:21 | 
| Saved logs | justin-logs:238114.0-dunegpschedd01.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 110882 traces, 0 summary
Retagger: tagging trace set: gauss with 83544 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 83544 traces tagged "gauss"
FrameSaver: q=2.88692e+06 n=1450131 tag=gauss
wclsFrameSaver: saving 110882 traces tagged "wiener"
FrameSaver: q=3.03798e+06 n=1268613 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 22827 XUs and 18464 XVs -> 122 XUVs
C:0 T:1 33468 XUs and 27352 XVs -> 2351 XUVs
C:0 T:2 58260 XUs and 92167 XVs -> 3197 XUVs
C:0 T:3 26955 XUs and 37401 XVs -> 295 XUVs
C:0 T:4 9911 XUs and 10700 XVs -> 112 XUVs
C:0 T:5 30848 XUs and 28312 XVs -> 3008 XUVs
C:0 T:6 83030 XUs and 116246 XVs -> 4496 XUVs
C:0 T:7 32880 XUs and 47676 XVs -> 340 XUVs
C:0 T:8 9319 XUs and 8126 XVs -> 101 XUVs
C:0 T:9 49687 XUs and 69870 XVs -> 4870 XUVs
C:0 T:10 40980 XUs and 22385 XVs -> 8157 XUVs
C:0 T:11 20 XUs and 39 XVs -> 2 XUVs
27051 XUVs total
9531 collection wire objects
25363 potential space points
Neighbour search...
2635871 tests to find 1254510 neighbours
Iterating with no regularization...
Begin: 6.05165e+07
0 5.0684e+07
1 5.00729e+07
2 4.99895e+07
3 4.99655e+07
Now with regularization...
Begin: 4.15204e+07
0 4.14953e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410082083
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410082083
fLifetime: 30000 [us]
24-Oct-2025 11:25:37 BST  Closed output file "reco_stage1.root"
24-Oct-2025 11:25:37 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          248.403       369.912       514.862       369.874       75.9423        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000776539   0.00313919    0.00487773    0.00335991    0.00128378       10     
reco:ophit:OpHitFinder                             0.213649      0.256252       0.27882      0.263914      0.0196799       10     
reco:opflash:OpFlashFinder                         0.152406      0.208751      0.249843      0.216173       0.02984        10     
reco:opslicer:OpSlicer                             0.487182      0.623795      0.740455      0.636038      0.0747774       10     
reco:caldata:DataPrepModule                         5.0085        5.11276       5.31138       5.10507      0.0818778       10     
reco:wclsdatasp:WireCellToolkit                     40.6136        42.98        45.2267       42.703        1.45557        10     
reco:gaushit:GausHitFinder                          0.93713       1.31231       1.62187       1.35424      0.203916        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000654271   0.000872909   0.00109066    0.000880412   0.000120313      10     
reco:reco3d:SpacePointSolver                        7.73392       14.1065       26.0451       13.6442       4.85857        10     
reco:hitpdune:DisambigFromSpacePoints               1.2393        2.14934       3.0002        2.26182      0.548679        10     
reco:pandora:StandardPandora                        21.2424       39.5425       57.5452       39.5702       12.8097        10     
reco:pandoraWriter:StandardPandora                  0.34704      0.469415      0.594119      0.478318      0.0747023       10     
reco:pandoraTrack:LArPandoraTrackCreation           2.9505        6.7171        11.5445       6.45065       2.42046        10     
reco:pandoraShower:LArPandoraShowerCreation         2.74854       6.4299        12.4855       6.3423        2.68557        10     
reco:pandoracalo:Calorimetry                        1.46983       3.04839       4.93859       2.92606      0.919101        10     
reco:pandoracalonosce:Calorimetry                   1.10806       2.81456       4.78089       2.72729       1.00948        10     
reco:pandorapid:Chi2ParticleID                     0.0037749    0.00523246    0.00626049    0.00524866    0.000701297      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0445391     0.0605373     0.0742668     0.0604835    0.00809537       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00376992    0.00507592     0.0060657    0.00510724    0.000620391      10     
reco:pandoraShowercalo:ShowerCalorimetry            2.65125       6.62455       12.2675       6.50931       2.73032        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.47177       6.4177        11.7098       6.49628       2.62937        10     
reco:emtrkmichelid:EmTrackMichelId                  126.115       168.618       214.877       170.257       25.4443        10     
reco:crttag:SingleCRTMatchingProducer               0.01986      0.026742      0.0388257     0.0252302    0.00498548       10     
reco:crtreco:TwoCRTMatchingProducer                0.0109901     0.0171073     0.0252998     0.0163232    0.00469233       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.955171       1.21312       1.64811       1.21436      0.191283        10     
reco:pandora2Track:LArPandoraTrackCreation          9.34256       21.1508       39.3471       20.8684       8.28053        10     
reco:pandora2calo:Calorimetry                       3.80584       8.85837       14.8543       8.8417        3.16787        10     
reco:pandora2calonosce:Calorimetry                  3.52436       8.32366       15.0411       8.02945       3.18907        10     
reco:pandora2pid:Chi2ParticleID                   0.00990341     0.0130036     0.0167267     0.0128026    0.00230246       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0588501     0.0771518     0.0939344     0.0783752     0.0110432       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00953811     0.0129254     0.0170983     0.0128189      0.00227        10     
reco:pandora2Shower:LArPandoraShowerCreation        3.16271       6.09698       10.5378       5.99925       1.98396        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.34263       7.27916       12.6083       7.11528       2.50992        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.11365       6.58101       11.252        6.50711       2.21422        10     
[art]:TriggerResults:TriggerResultInserter        4.0966e-05    5.13686e-05   0.000104042   4.5175e-05    1.81717e-05      10     
end_path:out1:RootOutput                           7.777e-06    8.9745e-06    1.3754e-05    8.3385e-06    1.68189e-06      10     
end_path:out1:RootOutput(write)                     1.85732       2.60726        3.406        2.68514      0.428221        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5035.32 MB
  Peak resident set size usage (VmHWM): 4225.81 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.19 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.18 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.17 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10564816
-rw-r--r-- 1 pltdune004 pltdune 2463408685 Oct 24 10:22 detsim_stage2.root
-rw-r--r-- 1 pltdune004 pltdune 2336201445 Oct 24 10:20 detsim_stage1.root
-rw-r--r-- 1 pltdune004 pltdune 2179102804 Oct 24 11:25 reco_stage1.root
-rw-r--r-- 1 pltdune004 pltdune 1923495433 Oct 24 09:00 g4_stage2.root
-rw-r--r-- 1 pltdune004 pltdune 1833621915 Oct 24 08:43 g4_stage1.root
-rw-r--r-- 1 pltdune004 pltdune   81975760 Oct 24 11:22 Pandora_Events.pndr
-rw-r--r-- 1 pltdune004 pltdune     242987 Oct 24 11:25 jobscript.log
-rw-r--r-- 1 pltdune004 pltdune     217088 Oct 24 11:25 mem.db
-rw-r--r-- 1 pltdune004 pltdune      62376 Oct 24 11:25 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune004 pltdune      36864 Oct 24 11:25 time.db
-rw-r--r-- 1 pltdune004 pltdune        519 Oct 24 10:22 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune004 pltdune        519 Oct 24 09:00 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune004 pltdune        519 Oct 24 11:25 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune004 pltdune         52 Oct 24 08:37 all-input-dids.txt
-rw-r--r-- 1 pltdune004 pltdune          7 Oct 24 11:25 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune004 pltdune          0 Oct 24 10:26 ProtoDUNE.log
-rw-r--r-- 1 pltdune004 pltdune          0 Oct 24 10:22 debugprod.log