Jobsub ID 269135.1@dunegpschedd01.fnal.gov
| Jobsub ID | 269135.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11268 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-18 22:20:15 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-19 02:23:27 |
| From worker node | Hostname | dunegli-8107701-0-fnpc18002.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-18 22:20:44 |
| Input files | monte-carlo-011268-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (14542s) |
| CPU time | 3h (14113s = 97%) |
| Max RSS bytes | 4207026176 (4012 MiB) |
| Outputting started | 2025-12-19 02:23:07 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11268/1/001/reco_stage1.root
|
| Finished | 2025-12-19 02:23:27 |
| Saved logs | justin-logs:269135.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
awDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 98997 traces, 0 summary
Retagger: tagging trace set: gauss with 74338 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 74338 traces tagged "gauss"
FrameSaver: q=2.54486e+06 n=1300309 tag=gauss
wclsFrameSaver: saving 98997 traces tagged "wiener"
FrameSaver: q=2.68835e+06 n=1137709 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 13577 XUs and 22817 XVs -> 130 XUVs
C:0 T:1 28353 XUs and 41062 XVs -> 2696 XUVs
C:0 T:2 85399 XUs and 83276 XVs -> 3684 XUVs
C:0 T:3 45212 XUs and 36362 XVs -> 191 XUVs
C:0 T:4 6624 XUs and 9060 XVs -> 64 XUVs
C:0 T:5 29069 XUs and 29578 XVs -> 2819 XUVs
C:0 T:6 76664 XUs and 98664 XVs -> 4371 XUVs
C:0 T:7 31652 XUs and 40534 XVs -> 295 XUVs
C:0 T:8 4489 XUs and 4693 XVs -> 29 XUVs
C:0 T:9 29968 XUs and 36657 XVs -> 2846 XUVs
C:0 T:10 20154 XUs and 15031 XVs -> 2420 XUVs
C:0 T:11 99 XUs and 68 XVs -> 7 XUVs
19552 XUVs total
8985 collection wire objects
17565 potential space points
Neighbour search...
576823 tests to find 320174 neighbours
Iterating with no regularization...
Begin: 5.67986e+07
0 4.4578e+07
1 4.38076e+07
2 4.37062e+07
3 4.36787e+07
Now with regularization...
Begin: 3.61767e+07
0 3.6148e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411200985
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411200985
fLifetime: 30000 [us]
19-Dec-2025 02:23:03 UTC Closed output file "reco_stage1.root"
19-Dec-2025 02:23:03 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 279.175 442.055 572.729 458.717 98.1335 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00107802 0.00372239 0.00543898 0.00403183 0.00140232 10
reco:ophit:OpHitFinder 0.266818 0.347669 0.415636 0.36596 0.0464818 10
reco:opflash:OpFlashFinder 0.140049 0.238885 0.293021 0.257449 0.0526748 10
reco:opslicer:OpSlicer 0.60271 0.870954 1.1206 0.866455 0.119143 10
reco:caldata:DataPrepModule 6.10253 6.57604 7.11637 6.57227 0.278829 10
reco:wclsdatasp:WireCellToolkit 37.4276 42.4306 48.1395 41.9087 3.60818 10
reco:gaushit:GausHitFinder 0.970235 1.4193 1.89337 1.46038 0.303216 10
reco:nhitsfilter:NumberOfHitsFilter 0.000431417 0.000595191 0.000799138 0.000585419 0.000112715 10
reco:reco3d:SpacePointSolver 8.19039 16.4904 26.1542 16.8093 5.49757 10
reco:hitpdune:DisambigFromSpacePoints 0.920587 2.13262 3.16282 2.20159 0.717493 10
reco:pandora:StandardPandora 18.5333 46.0006 71.0899 50.8677 18.2665 10
reco:pandoraWriter:StandardPandora 0.352679 0.609349 1.13985 0.575744 0.197138 10
reco:pandoraTrack:LArPandoraTrackCreation 2.35624 6.05405 8.49035 6.25964 1.94636 10
reco:pandoraShower:LArPandoraShowerCreation 2.66795 6.58328 10.2979 5.96797 2.58276 10
reco:pandoracalo:Calorimetry 1.16888 3.01929 4.15552 3.10329 1.03676 10
reco:pandoracalonosce:Calorimetry 1.01941 2.73498 3.94895 2.78765 1.0005 10
reco:pandorapid:Chi2ParticleID 0.00489707 0.00888684 0.0112867 0.00966624 0.00195381 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0411838 0.0624426 0.0836908 0.0640454 0.0150387 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00487109 0.00795169 0.0107203 0.00777874 0.00170044 10
reco:pandoraShowercalo:ShowerCalorimetry 2.07708 6.38952 10.7596 5.81239 2.84478 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.20434 6.01452 9.45394 5.56211 2.57595 10
reco:emtrkmichelid:EmTrackMichelId 156.226 230.63 294.467 241.924 45.9598 10
reco:crttag:SingleCRTMatchingProducer 0.0142073 0.0195598 0.0255635 0.0197614 0.00363742 10
reco:crtreco:TwoCRTMatchingProducer 0.00768505 0.0116692 0.0177727 0.0114399 0.00283519 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.726533 1.22478 1.4808 1.26135 0.230838 10
reco:pandora2Track:LArPandoraTrackCreation 9.06591 18.8497 27.8487 18.3415 6.15515 10
reco:pandora2calo:Calorimetry 3.75418 8.74593 13.0917 9.0071 3.07393 10
reco:pandora2calonosce:Calorimetry 3.62005 8.35348 12.3268 8.39266 2.9659 10
reco:pandora2pid:Chi2ParticleID 0.0150438 0.0234443 0.0305284 0.0234606 0.00509512 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0544917 0.0831774 0.108228 0.0831749 0.0183113 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0141742 0.0219106 0.0281286 0.0222288 0.00402533 10
reco:pandora2Shower:LArPandoraShowerCreation 3.16743 7.1123 10.3798 7.34068 2.24009 10
reco:pandora2Showercalo:ShowerCalorimetry 3.13239 7.4396 11.0368 8.05325 2.57408 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.98753 6.64743 10.1228 6.94623 2.16613 10
[art]:TriggerResults:TriggerResultInserter 5.2871e-05 6.44157e-05 0.00012858 5.7271e-05 2.17076e-05 10
end_path:out1:RootOutput 1.0057e-05 1.46669e-05 3.0521e-05 1.2572e-05 5.57005e-06 10
end_path:out1:RootOutput(write) 2.79121 4.7611 6.12813 4.9779 1.05217 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5015.41 MB
Peak resident set size usage (VmHWM): 4207.03 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.25 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10175904
-rw-r--r-- 1 dunegli fnalgrid 2392560698 Dec 19 01:06 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2267131601 Dec 19 01:01 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2072139741 Dec 19 02:23 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1840883689 Dec 18 22:45 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1773460235 Dec 18 22:28 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 73328440 Dec 19 02:19 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242778 Dec 19 02:23 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 19 02:23 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 19 02:23 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 19 02:23 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 19 01:06 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 18 22:45 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 19 02:23 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 18 22:20 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 19 02:23 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 19 01:14 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 19 01:06 debugprod.log
