Jobsub ID 257048.0@dunegpschedd01.fnal.gov
| Jobsub ID | 257048.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10660 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-25 08:32:05 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-25 12:54:23 |
| From worker node | Hostname | dunegli-7887287-0-fnpc18002.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-25 08:33:46 |
| Input files | monte-carlo-010660-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15609s) |
| CPU time | 4h (15566s = 99%) |
| Max RSS bytes | 4555132928 (4344 MiB) |
| Outputting started | 2025-11-25 12:53:55 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10660/1/001/reco_stage1.root
|
| Finished | 2025-11-25 12:54:23 |
| Saved logs | justin-logs:257048.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
emoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 117852 traces, 0 summary
Retagger: tagging trace set: gauss with 89728 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 89728 traces tagged "gauss"
FrameSaver: q=3.15394e+06 n=1601205 tag=gauss
wclsFrameSaver: saving 117852 traces tagged "wiener"
FrameSaver: q=3.35709e+06 n=1423282 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 21358 XUs and 26879 XVs -> 296 XUVs
C:0 T:1 36486 XUs and 42015 XVs -> 3052 XUVs
C:0 T:2 92626 XUs and 125365 XVs -> 5891 XUVs
C:0 T:3 45112 XUs and 48511 XVs -> 548 XUVs
C:0 T:4 12328 XUs and 8688 XVs -> 69 XUVs
C:0 T:5 38193 XUs and 21330 XVs -> 3267 XUVs
C:0 T:6 122196 XUs and 271287 XVs -> 18372 XUVs
C:0 T:7 48241 XUs and 49983 XVs -> 606 XUVs
C:0 T:8 11407 XUs and 7846 XVs -> 162 XUVs
C:0 T:9 69331 XUs and 58057 XVs -> 6469 XUVs
C:0 T:10 21576 XUs and 27968 XVs -> 4712 XUVs
C:0 T:11 26 XUs and 18 XVs -> 3 XUVs
43447 XUVs total
10181 collection wire objects
39883 potential space points
Neighbour search...
6612737 tests to find 2829082 neighbours
Iterating with no regularization...
Begin: 6.683e+07
0 5.35153e+07
1 5.23921e+07
2 5.22014e+07
3 5.21442e+07
4 5.21196e+07
Now with regularization...
Begin: 4.22486e+07
0 4.22039e+07
1 4.2177e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410727093
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410727093
fLifetime: 30000 [us]
25-Nov-2025 12:53:49 UTC Closed output file "reco_stage1.root"
25-Nov-2025 12:53:49 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 361.584 564.861 769.348 540.582 115.296 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0014507 0.00435555 0.00645246 0.00468685 0.0015837 10
reco:ophit:OpHitFinder 0.326606 0.414812 0.480152 0.438942 0.0537134 10
reco:opflash:OpFlashFinder 0.158125 0.235742 0.307393 0.25052 0.0433882 10
reco:opslicer:OpSlicer 0.736664 1.1726 1.61362 1.13448 0.237221 10
reco:caldata:DataPrepModule 6.73864 8.77386 9.21219 8.98037 0.699337 10
reco:wclsdatasp:WireCellToolkit 39.0789 53.0952 60.2652 53.406 5.25377 10
reco:gaushit:GausHitFinder 1.37155 2.16634 3.79743 2.15241 0.62325 10
reco:nhitsfilter:NumberOfHitsFilter 0.000588074 0.000969148 0.00175724 0.000927648 0.000297941 10
reco:reco3d:SpacePointSolver 11.2352 21.6621 29.7012 22.06 5.5593 10
reco:hitpdune:DisambigFromSpacePoints 1.02049 2.52136 3.59996 2.74971 0.772023 10
reco:pandora:StandardPandora 20.9392 52.3971 87.6706 54.7062 18.6391 10
reco:pandoraWriter:StandardPandora 0.424839 0.696445 0.903969 0.7465 0.154142 10
reco:pandoraTrack:LArPandoraTrackCreation 3.75225 8.48274 12.4058 9.24019 2.63942 10
reco:pandoraShower:LArPandoraShowerCreation 3.94793 9.31281 14.1518 9.48975 3.10307 10
reco:pandoracalo:Calorimetry 2.31267 4.76289 6.82016 5.04116 1.45741 10
reco:pandoracalonosce:Calorimetry 1.71074 4.33943 6.60712 4.58255 1.50374 10
reco:pandorapid:Chi2ParticleID 0.00604815 0.0113906 0.0149377 0.0122533 0.00264443 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0500655 0.0932214 0.124511 0.097809 0.0215701 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00594988 0.0110369 0.0158378 0.0117985 0.0026594 10
reco:pandoraShowercalo:ShowerCalorimetry 3.27659 9.07149 14.4554 9.48686 3.2559 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.12347 8.69799 14.6824 8.5542 3.58378 10
reco:emtrkmichelid:EmTrackMichelId 204.154 291.563 393.408 280.076 62.6374 10
reco:crttag:SingleCRTMatchingProducer 0.0123521 0.0256388 0.0415322 0.025 0.00764173 10
reco:crtreco:TwoCRTMatchingProducer 0.00991176 0.0196844 0.0270879 0.0202122 0.00464772 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.716552 1.43218 2.10923 1.37458 0.401431 10
reco:pandora2Track:LArPandoraTrackCreation 10.2313 25.5757 35.1091 27.0225 6.96541 10
reco:pandora2calo:Calorimetry 4.23566 12.2304 17.1622 13.0932 3.83254 10
reco:pandora2calonosce:Calorimetry 4.24381 11.634 16.2567 12.1797 3.39502 10
reco:pandora2pid:Chi2ParticleID 0.015829 0.0272232 0.0348091 0.0289518 0.00602812 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0656789 0.124669 0.213531 0.125885 0.039826 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0155968 0.029623 0.0542493 0.0291861 0.0101801 10
reco:pandora2Shower:LArPandoraShowerCreation 3.90948 10.0554 13.8165 10.5892 2.68058 10
reco:pandora2Showercalo:ShowerCalorimetry 3.58089 10.4306 15.5022 10.693 3.26938 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.25072 9.12954 14.0334 9.20328 2.68699 10
[art]:TriggerResults:TriggerResultInserter 7.0611e-05 0.000101111 0.000258348 8.66745e-05 5.30136e-05 10
end_path:out1:RootOutput 1.2502e-05 1.53721e-05 2.4724e-05 1.47715e-05 3.32419e-06 10
end_path:out1:RootOutput(write) 2.61938 4.495 6.02674 4.74617 0.838952 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5012.33 MB
Peak resident set size usage (VmHWM): 4196.63 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.62 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10325048
-rw-r--r-- 1 dunegli fnalgrid 2407577378 Nov 25 11:16 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2291114965 Nov 25 11:12 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2087772259 Nov 25 12:53 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1888964345 Nov 25 08:54 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1823514665 Nov 25 08:39 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 73284220 Nov 25 12:47 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242925 Nov 25 12:53 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 25 12:53 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 25 12:53 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 25 12:53 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 11:16 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 08:54 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 12:53 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 25 08:33 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 25 12:53 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 11:24 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 11:16 debugprod.log
