Jobsub ID 263384.0@dunegpschedd02.fnal.gov
| Jobsub ID | 263384.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11274 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-19 07:40:42 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-19 10:00:40 |
| From worker node | Hostname | dunegli-8112725-0-fnpc23032.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-19 07:41:49 |
| Input files | monte-carlo-011274-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8319s) |
| CPU time | 2h (8213s = 98%) |
| Max RSS bytes | 4424085504 (4219 MiB) |
| Outputting started | 2025-12-19 10:00:28 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11274/1/001/reco_stage1.root
|
| Finished | 2025-12-19 10:00:40 |
| Saved logs | justin-logs:263384.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 123860 traces, 0 summary
Retagger: tagging trace set: gauss with 90272 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 90272 traces tagged "gauss"
FrameSaver: q=3.15296e+06 n=1563197 tag=gauss
wclsFrameSaver: saving 123860 traces tagged "wiener"
FrameSaver: q=3.35342e+06 n=1373268 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 24728 XUs and 24819 XVs -> 208 XUVs
C:0 T:1 50117 XUs and 45167 XVs -> 4529 XUVs
C:0 T:2 113883 XUs and 199797 XVs -> 10835 XUVs
C:0 T:3 52213 XUs and 77137 XVs -> 602 XUVs
C:0 T:4 9831 XUs and 7626 XVs -> 82 XUVs
C:0 T:5 31736 XUs and 20553 XVs -> 6420 XUVs
C:0 T:6 96121 XUs and 89212 XVs -> 7003 XUVs
C:0 T:7 39948 XUs and 36471 XVs -> 592 XUVs
C:0 T:8 7397 XUs and 6309 XVs -> 44 XUVs
C:0 T:9 40210 XUs and 47111 XVs -> 4016 XUVs
C:0 T:10 23114 XUs and 28235 XVs -> 5570 XUVs
C:0 T:11 289 XUs and 228 XVs -> 41 XUVs
39942 XUVs total
10378 collection wire objects
36562 potential space points
Neighbour search...
3473784 tests to find 1857674 neighbours
Iterating with no regularization...
Begin: 5.47162e+07
0 4.79412e+07
1 4.72569e+07
2 4.71394e+07
3 4.70994e+07
Now with regularization...
Begin: 3.78274e+07
0 3.77892e+07
1 3.77581e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411209114
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411209114
fLifetime: 30000 [us]
19-Dec-2025 10:00:27 UTC Closed output file "reco_stage1.root"
19-Dec-2025 10:00:27 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 178.861 247.301 347.447 227.682 58.6375 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000848266 0.00286261 0.0046702 0.00279265 0.00124547 10
reco:ophit:OpHitFinder 0.198203 0.231478 0.284089 0.227534 0.0258887 10
reco:opflash:OpFlashFinder 0.131572 0.177853 0.233113 0.187865 0.0320406 10
reco:opslicer:OpSlicer 0.397702 0.510878 0.631923 0.498507 0.0725172 10
reco:caldata:DataPrepModule 3.32685 3.45821 3.74093 3.44121 0.110261 10
reco:wclsdatasp:WireCellToolkit 21.7247 22.5155 23.3314 22.6296 0.568164 10
reco:gaushit:GausHitFinder 0.642565 0.868041 1.14567 0.771052 0.184561 10
reco:nhitsfilter:NumberOfHitsFilter 0.000269506 0.000378256 0.000638434 0.000331265 0.000107767 10
reco:reco3d:SpacePointSolver 7.98155 14.2416 21.8663 13.7271 4.47853 10
reco:hitpdune:DisambigFromSpacePoints 0.826448 1.35173 2.16023 1.17554 0.458533 10
reco:pandora:StandardPandora 12.0037 28.696 64.337 20.8199 16.5871 10
reco:pandoraWriter:StandardPandora 0.221784 0.306393 0.424898 0.286983 0.0671349 10
reco:pandoraTrack:LArPandoraTrackCreation 1.64893 2.56073 4.30598 2.34512 0.800327 10
reco:pandoraShower:LArPandoraShowerCreation 1.74165 3.14701 5.19472 2.67773 1.25544 10
reco:pandoracalo:Calorimetry 1.02035 1.51907 2.40367 1.43734 0.410738 10
reco:pandoracalonosce:Calorimetry 0.935616 1.39372 2.23499 1.30973 0.385126 10
reco:pandorapid:Chi2ParticleID 0.00286632 0.00383598 0.00660064 0.00354095 0.00099458 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0295358 0.036324 0.0442594 0.0350996 0.00452706 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00273454 0.00344111 0.00506415 0.00323027 0.000651815 10
reco:pandoraShowercalo:ShowerCalorimetry 1.95226 3.49556 5.69345 3.00982 1.32 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.89594 3.41943 5.55922 2.96477 1.28942 10
reco:emtrkmichelid:EmTrackMichelId 97.9857 127.079 162.422 119.122 22.3753 10
reco:crttag:SingleCRTMatchingProducer 0.00878469 0.0119332 0.0175164 0.0111202 0.00277828 10
reco:crtreco:TwoCRTMatchingProducer 0.00425322 0.00557276 0.00716496 0.00543316 0.000877142 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.517278 0.624042 0.737815 0.629233 0.0770449 10
reco:pandora2Track:LArPandoraTrackCreation 5.09436 8.90734 14.1184 7.74471 3.31971 10
reco:pandora2calo:Calorimetry 2.91651 4.76708 7.33369 4.29161 1.59117 10
reco:pandora2calonosce:Calorimetry 2.78838 4.54669 6.95112 4.10403 1.5084 10
reco:pandora2pid:Chi2ParticleID 0.00672058 0.00928374 0.0127134 0.00875818 0.00221232 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0369738 0.0462531 0.0591847 0.0446754 0.00748586 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00647288 0.00900335 0.0122914 0.00863803 0.00213714 10
reco:pandora2Shower:LArPandoraShowerCreation 2.04334 3.2121 4.85814 2.877 1.0304 10
reco:pandora2Showercalo:ShowerCalorimetry 2.63586 4.10122 6.09443 3.74308 1.25526 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.47937 3.78195 5.50564 3.44397 1.11984 10
[art]:TriggerResults:TriggerResultInserter 2.8124e-05 4.71883e-05 0.00012544 3.89295e-05 2.65879e-05 10
end_path:out1:RootOutput 6.623e-06 1.17656e-05 1.7233e-05 1.16275e-05 2.40775e-06 10
end_path:out1:RootOutput(write) 1.64818 2.18764 2.89161 2.11493 0.394794 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5235.49 MB
Peak resident set size usage (VmHWM): 4424.09 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11171488
-rw-r--r-- 1 dunegli fnalgrid 2585862166 Dec 19 09:17 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2447637774 Dec 19 09:16 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2326374066 Dec 19 10:00 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2040275877 Dec 19 07:54 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1951091888 Dec 19 07:45 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 87747130 Dec 19 09:58 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243239 Dec 19 10:00 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 19 10:00 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 19 10:00 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 19 10:00 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 19 09:17 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 19 07:54 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 19 10:00 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 19 07:41 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 19 10:00 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 19 09:23 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 19 09:17 debugprod.log
