Jobsub ID 260607.0@dunegpschedd02.fnal.gov
| Jobsub ID | 260607.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11145 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-10 23:21:29 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-11 05:04:45 |
| From worker node | Hostname | dunegli-8024547-0-fnpc17115.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-10 23:22:56 |
| Input files | monte-carlo-011145-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (20480s) |
| CPU time | 5h (20183s = 98%) |
| Max RSS bytes | 4065824768 (3877 MiB) |
| Outputting started | 2025-12-11 05:04:17 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11145/1/001/reco_stage1.root
|
| Finished | 2025-12-11 05:04:45 |
| Saved logs | justin-logs:260607.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
epService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 108259 traces, 0 summary
Retagger: tagging trace set: gauss with 80929 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 80929 traces tagged "gauss"
FrameSaver: q=2.7927e+06 n=1414390 tag=gauss
wclsFrameSaver: saving 108259 traces tagged "wiener"
FrameSaver: q=2.94482e+06 n=1236805 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 22416 XUs and 20690 XVs -> 277 XUVs
C:0 T:1 40083 XUs and 34642 XVs -> 3047 XUVs
C:0 T:2 72924 XUs and 93062 XVs -> 9229 XUVs
C:0 T:3 33422 XUs and 43512 XVs -> 176 XUVs
C:0 T:4 17203 XUs and 13782 XVs -> 94 XUVs
C:0 T:5 63404 XUs and 48406 XVs -> 5495 XUVs
C:0 T:6 74867 XUs and 108240 XVs -> 4465 XUVs
C:0 T:7 31607 XUs and 43969 XVs -> 227 XUVs
C:0 T:8 5865 XUs and 6731 XVs -> 53 XUVs
C:0 T:9 37674 XUs and 49829 XVs -> 3446 XUVs
C:0 T:10 15017 XUs and 54397 XVs -> 5519 XUVs
C:0 T:11 120 XUs and 111 XVs -> 20 XUVs
32048 XUVs total
9725 collection wire objects
29430 potential space points
Neighbour search...
3111696 tests to find 1592236 neighbours
Iterating with no regularization...
Begin: 5.70794e+07
0 4.7734e+07
1 4.69959e+07
2 4.69054e+07
3 4.68772e+07
Now with regularization...
Begin: 3.85645e+07
0 3.85484e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411041187
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411041187
fLifetime: 30000 [us]
11-Dec-2025 05:04:12 UTC Closed output file "reco_stage1.root"
11-Dec-2025 05:04:12 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 411.415 597.473 778.215 617.549 123.959 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00165577 0.00535956 0.00833484 0.00550905 0.00215283 10
reco:ophit:OpHitFinder 0.285726 0.424089 0.567276 0.411475 0.09279 10
reco:opflash:OpFlashFinder 0.204354 0.267585 0.320121 0.283177 0.0384351 10
reco:opslicer:OpSlicer 0.605412 0.9581 1.37365 0.837523 0.259625 10
reco:caldata:DataPrepModule 6.86205 8.90211 11.4307 7.62392 1.96443 10
reco:wclsdatasp:WireCellToolkit 60.4406 69.3548 81.5318 64.9588 7.62294 10
reco:gaushit:GausHitFinder 1.36613 1.94208 3.0713 1.77187 0.49656 10
reco:nhitsfilter:NumberOfHitsFilter 0.000681902 0.000944226 0.00142282 0.00090865 0.000203759 10
reco:reco3d:SpacePointSolver 9.82825 18.8128 31.0037 18.3379 6.03303 10
reco:hitpdune:DisambigFromSpacePoints 1.70655 2.91761 5.19937 2.671 1.12363 10
reco:pandora:StandardPandora 25.6616 47.1373 83.586 41.8308 17.4319 10
reco:pandoraWriter:StandardPandora 0.48712 0.707127 1.07004 0.648948 0.177033 10
reco:pandoraTrack:LArPandoraTrackCreation 8.37162 12.5543 19.6634 11.3158 3.5907 10
reco:pandoraShower:LArPandoraShowerCreation 7.80864 14.7935 24.6782 15.296 5.28194 10
reco:pandoracalo:Calorimetry 3.23515 6.01735 9.07357 6.08012 1.8756 10
reco:pandoracalonosce:Calorimetry 2.76543 5.44688 8.47653 5.0419 1.78395 10
reco:pandorapid:Chi2ParticleID 0.00603648 0.00878469 0.0160558 0.00765852 0.00297854 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0641224 0.0911905 0.132673 0.0877834 0.0210043 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00610431 0.00797494 0.0125323 0.00691725 0.00221759 10
reco:pandoraShowercalo:ShowerCalorimetry 6.23561 13.3622 25.7988 12.9327 5.78965 10
reco:pandoraShowercalonosce:ShowerCalorimetry 5.64549 12.7999 25.7757 12.3916 5.94281 10
reco:emtrkmichelid:EmTrackMichelId 192.119 259.624 329.356 271.955 48.1265 10
reco:crttag:SingleCRTMatchingProducer 0.0283085 0.0876712 0.511293 0.0453 0.141407 10
reco:crtreco:TwoCRTMatchingProducer 0.0236153 0.0329299 0.0416042 0.0345479 0.00548966 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.21308 1.56988 1.9497 1.54039 0.19959 10
reco:pandora2Track:LArPandoraTrackCreation 25.1183 41.1265 53.8147 45.9605 10.3361 10
reco:pandora2calo:Calorimetry 8.71648 16.9735 23.8223 17.9641 4.93071 10
reco:pandora2calonosce:Calorimetry 8.55454 16.6178 22.7999 17.7523 4.79844 10
reco:pandora2pid:Chi2ParticleID 0.0135864 0.0253643 0.0559322 0.022061 0.0114141 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0845958 0.120986 0.150334 0.119984 0.0220255 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0131313 0.0221743 0.0308666 0.021622 0.00567226 10
reco:pandora2Shower:LArPandoraShowerCreation 7.41796 13.7177 19.5543 13.5145 3.60076 10
reco:pandora2Showercalo:ShowerCalorimetry 7.06715 14.4794 21.7131 14.8272 4.5488 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.76065 12.5103 18.9426 12.3062 3.85452 10
[art]:TriggerResults:TriggerResultInserter 7.3724e-05 9.74106e-05 0.000172553 8.68595e-05 2.83401e-05 10
end_path:out1:RootOutput 1.0899e-05 6.06339e-05 0.00048079 1.2732e-05 0.00014009 10
end_path:out1:RootOutput(write) 2.65488 3.82986 5.14263 3.91288 0.740295 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4887.24 MB
Peak resident set size usage (VmHWM): 4065.82 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.44 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.32 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9838204
-rw-r--r-- 1 dunegli fnalgrid 2325018366 Dec 11 03:21 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2208181549 Dec 11 03:17 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1999288905 Dec 11 05:04 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1771797389 Dec 10 23:54 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1697417824 Dec 10 23:31 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 71990290 Dec 11 04:58 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242815 Dec 11 05:04 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 11 05:04 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 11 05:04 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 11 05:04 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 11 03:21 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 10 23:54 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 11 05:04 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 10 23:22 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 11 05:04 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 11 03:32 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 11 03:21 debugprod.log
