Jobsub ID 261923.1@dunegpschedd02.fnal.gov
| Jobsub ID | 261923.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11204 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-13 04:58:15 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-13 11:49:32 |
| From worker node | Hostname | dunegli-8047117-0-fnpc18002.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-13 04:59:10 |
| Input files | monte-carlo-011204-000001
|
| Jobscript | Exit code | 0 |
| Real time | 6h (24538s) |
| CPU time | 6h (24042s = 97%) |
| Max RSS bytes | 4475670528 (4268 MiB) |
| Outputting started | 2025-12-13 11:48:09 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11204/1/001/reco_stage1.root
|
| Finished | 2025-12-13 11:49:32 |
| Saved logs | justin-logs:261923.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
repare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 141253 traces, 0 summary
Retagger: tagging trace set: gauss with 106743 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 106743 traces tagged "gauss"
FrameSaver: q=3.76995e+06 n=1874278 tag=gauss
wclsFrameSaver: saving 141253 traces tagged "wiener"
FrameSaver: q=4.01873e+06 n=1657475 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 33084 XUs and 31009 XVs -> 330 XUVs
C:0 T:1 55077 XUs and 56649 XVs -> 3648 XUVs
C:0 T:2 101130 XUs and 117987 XVs -> 7920 XUVs
C:0 T:3 41814 XUs and 43866 XVs -> 488 XUVs
C:0 T:4 14759 XUs and 16925 XVs -> 236 XUVs
C:0 T:5 57290 XUs and 61794 XVs -> 5001 XUVs
C:0 T:6 188529 XUs and 184988 XVs -> 22493 XUVs
C:0 T:7 53619 XUs and 43163 XVs -> 769 XUVs
C:0 T:8 6829 XUs and 7508 XVs -> 62 XUVs
C:0 T:9 36241 XUs and 54449 XVs -> 3225 XUVs
C:0 T:10 53875 XUs and 60569 XVs -> 10659 XUVs
C:0 T:11 558 XUs and 413 XVs -> 52 XUVs
54883 XUVs total
12642 collection wire objects
50702 potential space points
Neighbour search...
8623840 tests to find 3830872 neighbours
Iterating with no regularization...
Begin: 9.40596e+07
0 8.09275e+07
1 7.98856e+07
2 7.97431e+07
3 7.96961e+07
Now with regularization...
Begin: 6.84005e+07
0 6.8347e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411086093
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411086093
fLifetime: 30000 [us]
13-Dec-2025 11:48:00 UTC Closed output file "reco_stage1.root"
13-Dec-2025 11:48:00 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 667.006 862.207 1029.43 853.74 116.318 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00313802 0.00623527 0.00932975 0.0058926 0.00200029 10
reco:ophit:OpHitFinder 0.321355 0.494879 0.737356 0.495952 0.110583 10
reco:opflash:OpFlashFinder 0.189278 0.375998 0.583692 0.362575 0.12993 10
reco:opslicer:OpSlicer 0.919863 1.35011 1.9047 1.39304 0.271961 10
reco:caldata:DataPrepModule 6.64604 10.0117 12.9566 10.2117 2.03263 10
reco:wclsdatasp:WireCellToolkit 48.3606 61.3888 69.5119 62.6073 5.57468 10
reco:gaushit:GausHitFinder 1.72533 2.48395 3.12984 2.45808 0.382786 10
reco:nhitsfilter:NumberOfHitsFilter 0.000702544 0.00125403 0.00224878 0.00115572 0.000405999 10
reco:reco3d:SpacePointSolver 20.7574 31.6383 44.9909 29.4184 7.89488 10
reco:hitpdune:DisambigFromSpacePoints 2.19377 3.7504 5.08098 3.46422 0.817509 10
reco:pandora:StandardPandora 60.7373 101.055 143.742 102.653 27.077 10
reco:pandoraWriter:StandardPandora 0.62643 0.968829 1.26272 0.927198 0.171287 10
reco:pandoraTrack:LArPandoraTrackCreation 10.8543 13.6747 17.0875 13.6813 2.11609 10
reco:pandoraShower:LArPandoraShowerCreation 12.0728 17.5528 25.9226 17.0438 3.83534 10
reco:pandoracalo:Calorimetry 5.49375 7.4251 10.6645 7.15856 1.51937 10
reco:pandoracalonosce:Calorimetry 4.82504 7.13987 9.14412 7.38813 1.46459 10
reco:pandorapid:Chi2ParticleID 0.0103467 0.0137479 0.0192557 0.0133071 0.0027023 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0699537 0.121598 0.159726 0.126181 0.0259765 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0098755 0.0130246 0.0151879 0.013582 0.00175016 10
reco:pandoraShowercalo:ShowerCalorimetry 11.5009 18.7605 31.4074 17.354 5.90144 10
reco:pandoraShowercalonosce:ShowerCalorimetry 11.8296 18.0829 29.1961 17.2363 5.43062 10
reco:emtrkmichelid:EmTrackMichelId 288.047 408.391 465.451 412.914 55.1385 10
reco:crttag:SingleCRTMatchingProducer 0.0275206 0.0438741 0.0704726 0.0413587 0.0125453 10
reco:crtreco:TwoCRTMatchingProducer 0.0194012 0.0282917 0.0361663 0.0275035 0.0046394 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.09646 1.87938 2.34222 1.96396 0.360274 10
reco:pandora2Track:LArPandoraTrackCreation 31.9604 46.2064 67.4825 45.6806 9.73537 10
reco:pandora2calo:Calorimetry 17.5599 25.7357 44.8608 23.6507 7.87535 10
reco:pandora2calonosce:Calorimetry 16.9058 23.1854 38.5961 20.4493 6.31034 10
reco:pandora2pid:Chi2ParticleID 0.0278976 0.0386321 0.0540184 0.0392079 0.00716486 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0996713 0.170355 0.234619 0.171423 0.0385699 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0275089 0.0366431 0.0470233 0.0375774 0.00588881 10
reco:pandora2Shower:LArPandoraShowerCreation 10.9799 16.5716 23.7645 15.8263 3.20395 10
reco:pandora2Showercalo:ShowerCalorimetry 11.5116 20.3481 38.5442 18.5664 7.05674 10
reco:pandora2Showercalonosce:ShowerCalorimetry 10.1154 17.3755 33.997 15.1681 6.68132 10
[art]:TriggerResults:TriggerResultInserter 8.1786e-05 0.000126561 0.000240747 0.000113703 4.76132e-05 10
end_path:out1:RootOutput 1.6274e-05 2.1372e-05 4.0998e-05 1.9137e-05 6.96414e-06 10
end_path:out1:RootOutput(write) 3.91314 5.61987 7.96129 5.51217 1.18328 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5289.58 MB
Peak resident set size usage (VmHWM): 4475.67 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.38 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 6.49 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10968680
-rw-r--r-- 1 dunegli fnalgrid 2553549133 Dec 13 09:20 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2423992019 Dec 13 09:16 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2288421444 Dec 13 11:48 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1983490739 Dec 13 05:46 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1895187910 Dec 13 05:10 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 86671440 Dec 13 11:39 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243087 Dec 13 11:48 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 13 11:48 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 13 11:48 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 13 11:48 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 09:20 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 05:46 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 11:48 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 13 04:59 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 13 11:48 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 13 09:35 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 13 09:20 debugprod.log
