Jobsub ID 251412.1@dunegpschedd02.fnal.gov
| Jobsub ID | 251412.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10661 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-25 08:32:05 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-25 12:19:11 |
| From worker node | Hostname | dunegli-7730565-0-fnpc18010.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-25 08:33:58 |
| Input files | monte-carlo-010661-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13487s) |
| CPU time | 3h (13309s = 98%) |
| Max RSS bytes | 4037541888 (3850 MiB) |
| Outputting started | 2025-11-25 12:18:45 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10661/1/001/reco_stage1.root
|
| Finished | 2025-11-25 12:19:11 |
| Saved logs | justin-logs:251412.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
igitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 118760 traces, 0 summary
Retagger: tagging trace set: gauss with 86866 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 86866 traces tagged "gauss"
FrameSaver: q=3.06579e+06 n=1481334 tag=gauss
wclsFrameSaver: saving 118760 traces tagged "wiener"
FrameSaver: q=3.27577e+06 n=1295922 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 20148 XUs and 22138 XVs -> 209 XUVs
C:0 T:1 47796 XUs and 46001 XVs -> 6466 XUVs
C:0 T:2 97132 XUs and 109949 XVs -> 10324 XUVs
C:0 T:3 37804 XUs and 39626 XVs -> 489 XUVs
C:0 T:4 12307 XUs and 15402 XVs -> 123 XUVs
C:0 T:5 54915 XUs and 68485 XVs -> 7252 XUVs
C:0 T:6 64839 XUs and 79590 XVs -> 5475 XUVs
C:0 T:7 25656 XUs and 31218 XVs -> 353 XUVs
C:0 T:8 8734 XUs and 10818 XVs -> 209 XUVs
C:0 T:9 73384 XUs and 133356 XVs -> 19018 XUVs
C:0 T:10 16704 XUs and 10501 XVs -> 1800 XUVs
C:0 T:11 83 XUs and 67 XVs -> 20 XUVs
51738 XUVs total
10095 collection wire objects
47122 potential space points
Neighbour search...
7948178 tests to find 3757978 neighbours
Iterating with no regularization...
Begin: 5.42314e+07
0 4.23462e+07
1 4.14435e+07
2 4.13079e+07
3 4.12635e+07
4 4.12428e+07
Now with regularization...
Begin: 3.19833e+07
0 3.19256e+07
1 3.18852e+07
2 3.18533e+07
3 3.18273e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410727082
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410727082
fLifetime: 30000 [us]
25-Nov-2025 12:18:42 UTC Closed output file "reco_stage1.root"
25-Nov-2025 12:18:42 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 317.868 467.605 594.02 456.76 85.4029 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00120641 0.00403498 0.007215 0.00374627 0.0017487 10
reco:ophit:OpHitFinder 0.289131 0.363661 0.456801 0.365473 0.0561864 10
reco:opflash:OpFlashFinder 0.175477 0.200286 0.249751 0.198089 0.0227089 10
reco:opslicer:OpSlicer 0.70525 0.965099 1.36128 0.888158 0.242449 10
reco:caldata:DataPrepModule 6.37808 7.58172 9.01719 7.48047 1.05299 10
reco:wclsdatasp:WireCellToolkit 39.8569 49.325 57.2271 49.1702 5.70046 10
reco:gaushit:GausHitFinder 1.19479 1.51233 2.28772 1.37911 0.350444 10
reco:nhitsfilter:NumberOfHitsFilter 0.000559305 0.000746326 0.000997052 0.000759357 0.000131178 10
reco:reco3d:SpacePointSolver 9.76783 19.3146 43.7425 18.2994 9.52188 10
reco:hitpdune:DisambigFromSpacePoints 1.17807 1.80948 2.75369 1.66558 0.453505 10
reco:pandora:StandardPandora 20.6336 40.004 61.3095 38.8347 11.6402 10
reco:pandoraWriter:StandardPandora 0.455679 0.589058 0.741948 0.567704 0.0962927 10
reco:pandoraTrack:LArPandoraTrackCreation 4.09642 6.21784 8.6691 5.97904 1.26117 10
reco:pandoraShower:LArPandoraShowerCreation 4.28465 7.41484 9.66807 7.81679 1.45043 10
reco:pandoracalo:Calorimetry 1.83166 3.34015 5.1306 3.23949 0.889649 10
reco:pandoracalonosce:Calorimetry 1.81527 3.10438 4.84092 2.99649 0.829047 10
reco:pandorapid:Chi2ParticleID 0.00546814 0.00774893 0.00966061 0.00774792 0.00135808 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0507611 0.068602 0.0913736 0.065268 0.0133617 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00524019 0.00719399 0.00943597 0.00646052 0.00143727 10
reco:pandoraShowercalo:ShowerCalorimetry 4.18502 7.47239 11.0261 7.78481 1.91808 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.12269 7.43441 10.1652 8.11502 2.0399 10
reco:emtrkmichelid:EmTrackMichelId 165.33 237.627 327.001 215.713 49.2061 10
reco:crttag:SingleCRTMatchingProducer 0.0187974 0.0224094 0.0306856 0.0208804 0.00361635 10
reco:crtreco:TwoCRTMatchingProducer 0.0114118 0.0173707 0.0255659 0.0162305 0.00372334 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.752541 1.02335 1.30755 1.02517 0.193657 10
reco:pandora2Track:LArPandoraTrackCreation 12.2757 22.1686 33.4366 24.3292 6.17518 10
reco:pandora2calo:Calorimetry 5.28905 10.5322 19.4705 10.1994 4.08852 10
reco:pandora2calonosce:Calorimetry 5.06659 10.0139 18.4486 9.98794 3.89456 10
reco:pandora2pid:Chi2ParticleID 0.014244 0.0200953 0.0289612 0.018373 0.00499349 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0626045 0.0944012 0.143348 0.0844143 0.0269676 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0134845 0.0190536 0.0258016 0.0180542 0.00447555 10
reco:pandora2Shower:LArPandoraShowerCreation 4.73576 8.36257 12.0589 8.6993 2.10346 10
reco:pandora2Showercalo:ShowerCalorimetry 4.59669 9.06845 16.5582 9.13311 3.30894 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.27471 7.9687 14.6954 7.4886 2.91381 10
[art]:TriggerResults:TriggerResultInserter 6.6174e-05 0.000104732 0.00016437 9.0977e-05 3.07448e-05 10
end_path:out1:RootOutput 1.2894e-05 1.77394e-05 2.672e-05 1.61705e-05 4.47734e-06 10
end_path:out1:RootOutput(write) 2.532 3.75186 4.90054 3.74709 0.706504 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4848.95 MB
Peak resident set size usage (VmHWM): 4037.54 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.31 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.73 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9256752
-rw-r--r-- 1 dunegli fnalgrid 2206900687 Nov 25 10:57 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2095135041 Nov 25 10:55 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1860794199 Nov 25 12:18 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1657834835 Nov 25 08:52 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1590985309 Nov 25 08:39 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 66647810 Nov 25 12:13 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242902 Nov 25 12:18 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 25 12:18 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 25 12:18 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 25 12:18 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 10:57 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 08:52 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 12:18 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 25 08:33 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 25 12:18 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 11:04 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 10:57 debugprod.log
