Jobsub ID 296190.0@dunegpschedd02.fnal.gov
| Jobsub ID | 296190.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12456 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-27 21:01:50 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-27 23:57:31 |
| From worker node | Hostname | dunegli-8293043-0-fnpc19120.fnal.gov |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-27 21:03:01 |
| Input files | monte-carlo-012456-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (10456s) |
| CPU time | 2h (10349s = 98%) |
| Max RSS bytes | 4265488384 (4067 MiB) |
| Outputting started | 2026-01-27 23:57:18 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12456/1/001/reco_stage1.root
|
| Finished | 2026-01-27 23:57:31 |
| Saved logs | justin-logs:296190.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
re: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 120733 traces, 0 summary
Retagger: tagging trace set: gauss with 90922 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 90922 traces tagged "gauss"
FrameSaver: q=3.20135e+06 n=1639441 tag=gauss
wclsFrameSaver: saving 120733 traces tagged "wiener"
FrameSaver: q=3.38256e+06 n=1443678 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 19617 XUs and 18016 XVs -> 121 XUVs
C:0 T:1 33500 XUs and 30326 XVs -> 1768 XUVs
C:0 T:2 133528 XUs and 136939 XVs -> 6980 XUVs
C:0 T:3 58241 XUs and 51501 XVs -> 492 XUVs
C:0 T:4 8630 XUs and 7004 XVs -> 64 XUVs
C:0 T:5 28741 XUs and 19310 XVs -> 1888 XUVs
C:0 T:6 133378 XUs and 126308 XVs -> 6867 XUVs
C:0 T:7 52553 XUs and 47568 XVs -> 488 XUVs
C:0 T:8 3285 XUs and 4461 XVs -> 30 XUVs
C:0 T:9 24285 XUs and 40804 XVs -> 2471 XUVs
C:0 T:10 77995 XUs and 55013 XVs -> 9733 XUVs
C:0 T:11 164 XUs and 121 XVs -> 18 XUVs
30920 XUVs total
11438 collection wire objects
28708 potential space points
Neighbour search...
2764018 tests to find 1297256 neighbours
Iterating with no regularization...
Begin: 5.82277e+07
0 4.59873e+07
1 4.51973e+07
2 4.50912e+07
3 4.50617e+07
Now with regularization...
Begin: 3.66836e+07
0 3.66502e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 412004782
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412004782
fLifetime: 30000 [us]
27-Jan-2026 23:57:16 UTC Closed output file "reco_stage1.root"
27-Jan-2026 23:57:16 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 228.664 333.056 533.832 300.023 84.0321 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000798872 0.00307527 0.00516818 0.00322079 0.00131015 10
reco:ophit:OpHitFinder 0.212984 0.260649 0.291156 0.269023 0.0241736 10
reco:opflash:OpFlashFinder 0.126451 0.157407 0.189325 0.154545 0.0204402 10
reco:opslicer:OpSlicer 0.471303 0.621521 0.780828 0.620057 0.100419 10
reco:caldata:DataPrepModule 4.29626 4.39643 4.66917 4.35459 0.104118 10
reco:wclsdatasp:WireCellToolkit 27.0307 32.0559 34.586 32.677 2.56463 10
reco:gaushit:GausHitFinder 0.784528 1.031 1.31313 1.05045 0.172009 10
reco:nhitsfilter:NumberOfHitsFilter 0.000428291 0.000572895 0.000787472 0.000536876 0.000107771 10
reco:reco3d:SpacePointSolver 4.68008 11.7291 20.1555 11.3064 4.13466 10
reco:hitpdune:DisambigFromSpacePoints 0.83604 1.4359 2.23562 1.38848 0.429632 10
reco:pandora:StandardPandora 18.7304 44.9475 156.336 30.3335 38.1725 10
reco:pandoraWriter:StandardPandora 0.307498 0.409887 0.510978 0.40078 0.0630043 10
reco:pandoraTrack:LArPandoraTrackCreation 2.31705 4.02891 6.70188 3.44124 1.24096 10
reco:pandoraShower:LArPandoraShowerCreation 2.21108 4.64822 8.29086 3.96853 1.87421 10
reco:pandoracalo:Calorimetry 1.1892 1.96872 3.27556 1.86551 0.560244 10
reco:pandoracalonosce:Calorimetry 0.979876 1.8443 3.00361 1.72239 0.562701 10
reco:pandorapid:Chi2ParticleID 0.00405632 0.00528656 0.00652175 0.00517651 0.000786723 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0392585 0.0463133 0.0605518 0.045141 0.00634102 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00432446 0.00509816 0.00636884 0.0049882 0.000580482 10
reco:pandoraShowercalo:ShowerCalorimetry 1.85669 4.29249 7.32841 3.76338 1.70244 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.80253 4.10996 7.09251 3.85247 1.56905 10
reco:emtrkmichelid:EmTrackMichelId 134.504 172.931 219.956 165.43 26.6013 10
reco:crttag:SingleCRTMatchingProducer 0.00742465 0.0154789 0.0245522 0.0165452 0.00508569 10
reco:crtreco:TwoCRTMatchingProducer 0.00521222 0.00893844 0.0153938 0.00790741 0.0028378 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.584476 0.822547 1.07625 0.814447 0.141728 10
reco:pandora2Track:LArPandoraTrackCreation 6.14427 13.7384 23.8774 11.8243 5.35136 10
reco:pandora2calo:Calorimetry 2.64983 5.6731 9.44794 5.14 2.03666 10
reco:pandora2calonosce:Calorimetry 2.55096 5.36503 8.75231 4.91715 1.87631 10
reco:pandora2pid:Chi2ParticleID 0.00954413 0.0132799 0.0186755 0.0127059 0.00259342 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0473281 0.0590868 0.076946 0.0575912 0.00876433 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00978537 0.0129107 0.0171451 0.0125907 0.00216029 10
reco:pandora2Shower:LArPandoraShowerCreation 2.29205 4.61817 7.60178 4.19806 1.61006 10
reco:pandora2Showercalo:ShowerCalorimetry 2.39755 4.71536 7.59317 4.51443 1.49617 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.13297 4.15666 6.23504 4.06839 1.22153 10
[art]:TriggerResults:TriggerResultInserter 3.8511e-05 4.90322e-05 9.848e-05 4.415e-05 1.67732e-05 10
end_path:out1:RootOutput 7.99e-06 9.352e-06 1.25e-05 9.22e-06 1.20714e-06 10
end_path:out1:RootOutput(write) 2.14856 2.79794 3.6015 2.625 0.456319 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5081.89 MB
Peak resident set size usage (VmHWM): 4265.49 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.71 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10336600
-rw-r--r-- 1 dunegli fnalgrid 2413274467 Jan 27 22:59 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2290598106 Jan 27 22:57 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2111943945 Jan 27 23:57 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1875610987 Jan 27 21:18 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1814386711 Jan 27 21:07 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 78240380 Jan 27 23:53 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242978 Jan 27 23:57 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 27 23:57 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 27 23:57 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 27 23:57 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 27 22:59 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 27 21:18 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 27 23:57 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 27 21:03 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 27 23:57 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 27 23:04 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 27 22:59 debugprod.log
