Jobsub ID 237720.1@dunegpschedd01.fnal.gov
| Jobsub ID | 237720.1@dunegpschedd01.fnal.gov |
| Workflow ID | 9275 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-10-22 21:28:56 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-10-23 01:58:37 |
| From worker node | Hostname | dunegli-7312580-0-fnpc8001.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-22 21:29:41 |
| Input files | monte-carlo-009275-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (16103s) |
| CPU time | 4h (14973s = 92%) |
| Max RSS bytes | 4355833856 (4154 MiB) |
| Outputting started | 2025-10-23 01:58:05 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09275/1/001/reco_stage1.root
|
| Finished | 2025-10-23 01:58:37 |
| Saved logs | justin-logs:237720.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 124976 traces, 0 summary
Retagger: tagging trace set: gauss with 95845 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95845 traces tagged "gauss"
FrameSaver: q=3.46479e+06 n=1699478 tag=gauss
wclsFrameSaver: saving 124976 traces tagged "wiener"
FrameSaver: q=3.67217e+06 n=1504601 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 41762 XUs and 49398 XVs -> 948 XUVs
C:0 T:1 165151 XUs and 110366 XVs -> 17777 XUVs
C:0 T:2 79257 XUs and 96282 XVs -> 4804 XUVs
C:0 T:3 33308 XUs and 32907 XVs -> 110 XUVs
C:0 T:4 13117 XUs and 12337 XVs -> 178 XUVs
C:0 T:5 84274 XUs and 62325 XVs -> 8462 XUVs
C:0 T:6 72682 XUs and 75827 XVs -> 2553 XUVs
C:0 T:7 29394 XUs and 30029 XVs -> 247 XUVs
C:0 T:8 8870 XUs and 5317 XVs -> 61 XUVs
C:0 T:9 50845 XUs and 43958 XVs -> 3430 XUVs
C:0 T:10 29998 XUs and 25939 XVs -> 3323 XUVs
C:0 T:11 141 XUs and 72 XVs -> 7 XUVs
41900 XUVs total
11664 collection wire objects
37800 potential space points
Neighbour search...
4992172 tests to find 2304666 neighbours
Iterating with no regularization...
Begin: 1.03139e+08
0 8.28659e+07
1 8.1499e+07
2 8.12895e+07
3 8.1229e+07
Now with regularization...
Begin: 6.79125e+07
0 6.78043e+07
1 6.77623e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410053942
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410053942
fLifetime: 30000 [us]
23-Oct-2025 01:58:02 UTC Closed output file "reco_stage1.root"
23-Oct-2025 01:58:02 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 370.358 522.92 661.817 501.975 81.9478 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00100883 0.00391596 0.00565898 0.00439041 0.00151763 10
reco:ophit:OpHitFinder 0.267567 0.311486 0.361287 0.305942 0.0262998 10
reco:opflash:OpFlashFinder 0.170497 0.226021 0.291605 0.2209 0.0353868 10
reco:opslicer:OpSlicer 0.686148 0.766503 0.875435 0.746634 0.0564985 10
reco:caldata:DataPrepModule 6.26214 6.60194 8.08433 6.4033 0.528639 10
reco:wclsdatasp:WireCellToolkit 48.3323 60.4789 75.4564 60.7527 6.71367 10
reco:gaushit:GausHitFinder 1.30162 1.72743 2.02388 1.75826 0.212155 10
reco:nhitsfilter:NumberOfHitsFilter 0.00049811 0.000756013 0.00111406 0.00074898 0.000147199 10
reco:reco3d:SpacePointSolver 13.2932 18.6874 26.0587 18.1874 3.80114 10
reco:hitpdune:DisambigFromSpacePoints 1.96636 3.01413 3.73822 3.01439 0.550506 10
reco:pandora:StandardPandora 36.2195 60.3865 96.7994 63.0255 18.3915 10
reco:pandoraWriter:StandardPandora 0.435313 0.574454 0.658813 0.58747 0.0626417 10
reco:pandoraTrack:LArPandoraTrackCreation 5.67876 9.72468 14.5381 9.08782 2.33642 10
reco:pandoraShower:LArPandoraShowerCreation 4.91524 9.82514 16.8935 9.19572 3.11759 10
reco:pandoracalo:Calorimetry 2.52107 4.65565 6.87301 4.34991 1.12902 10
reco:pandoracalonosce:Calorimetry 2.30695 4.32324 6.64223 4.04007 1.12973 10
reco:pandorapid:Chi2ParticleID 0.00633041 0.00803002 0.00941596 0.00810951 0.00108696 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.068005 0.088664 0.104703 0.0862707 0.0109358 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00620617 0.00772606 0.0095445 0.00753175 0.00106864 10
reco:pandoraShowercalo:ShowerCalorimetry 4.08419 9.30133 15.0618 9.53047 2.736 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.91853 9.0363 14.1411 9.28194 2.6606 10
reco:emtrkmichelid:EmTrackMichelId 181.729 227.535 268.347 223.853 25.314 10
reco:crttag:SingleCRTMatchingProducer 0.0138082 0.0242036 0.0343064 0.024985 0.00592327 10
reco:crtreco:TwoCRTMatchingProducer 0.00940796 0.0193493 0.0316312 0.0175375 0.00692545 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.60748 2.13867 2.73014 2.09765 0.329209 10
reco:pandora2Track:LArPandoraTrackCreation 13.5287 30.915 51.27 28.2675 10.6817 10
reco:pandora2calo:Calorimetry 5.4093 13.7091 24.6411 12.1933 5.16747 10
reco:pandora2calonosce:Calorimetry 4.94797 13.1 23.5729 12.0215 4.90254 10
reco:pandora2pid:Chi2ParticleID 0.0150033 0.0193499 0.0241425 0.0185886 0.00296042 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0829774 0.112196 0.143778 0.109837 0.0165129 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0150887 0.0193335 0.0235155 0.0189689 0.00280371 10
reco:pandora2Shower:LArPandoraShowerCreation 4.81793 9.91042 17.8529 9.2144 3.53297 10
reco:pandora2Showercalo:ShowerCalorimetry 4.79502 11.623 21.0165 10.4213 4.23193 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.26575 10.5547 18.7411 9.80231 3.76849 10
[art]:TriggerResults:TriggerResultInserter 4.1875e-05 5.93228e-05 0.000134207 5.03565e-05 2.63923e-05 10
end_path:out1:RootOutput 7.236e-06 9.8351e-06 1.7059e-05 8.9305e-06 2.59019e-06 10
end_path:out1:RootOutput(write) 2.5671 3.3437 3.97311 3.24026 0.436532 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5167.69 MB
Peak resident set size usage (VmHWM): 4355.83 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.27 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11158500
-rw-r--r-- 1 dunegli fnalgrid 2588009842 Oct 23 00:22 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2461871086 Oct 23 00:16 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2295871019 Oct 23 01:58 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2038131790 Oct 22 21:52 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1961468513 Oct 22 21:35 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 80326860 Oct 23 01:51 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243189 Oct 23 01:58 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Oct 23 01:58 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Oct 23 01:58 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Oct 23 01:58 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 23 00:23 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 22 21:52 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 23 01:58 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Oct 22 21:29 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Oct 23 01:58 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 23 00:33 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 23 00:23 debugprod.log
