Jobsub ID 267897.1@dunegpschedd02.fnal.gov
| Jobsub ID | 267897.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11690 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-10 17:45:48 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce01 |
| Last heartbeat | 2026-01-10 20:59:25 |
| From worker node | Hostname | wn2208240.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-10 17:46:40 |
| Input files | monte-carlo-011690-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11475s) |
| CPU time | 3h (11056s = 96%) |
| Max RSS bytes | 4324978688 (4124 MiB) |
| Outputting started | 2026-01-10 20:57:56 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11690/1/001/reco_stage1.root
|
| Finished | 2026-01-10 20:59:25 |
| Saved logs | justin-logs:267897.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
dcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 128375 traces, 0 summary
Retagger: tagging trace set: gauss with 102117 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 102117 traces tagged "gauss"
FrameSaver: q=3.56512e+06 n=1868551 tag=gauss
wclsFrameSaver: saving 128375 traces tagged "wiener"
FrameSaver: q=3.75505e+06 n=1676615 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 34450 XUs and 34625 XVs -> 480 XUVs
C:0 T:1 65091 XUs and 63385 XVs -> 3195 XUVs
C:0 T:2 74565 XUs and 74906 XVs -> 4871 XUVs
C:0 T:3 37169 XUs and 28903 XVs -> 297 XUVs
C:0 T:4 22353 XUs and 20356 XVs -> 173 XUVs
C:0 T:5 102379 XUs and 77984 XVs -> 5905 XUVs
C:0 T:6 153103 XUs and 207434 XVs -> 23686 XUVs
C:0 T:7 50316 XUs and 52717 XVs -> 987 XUVs
C:0 T:8 6958 XUs and 5402 XVs -> 87 XUVs
C:0 T:9 39630 XUs and 38605 XVs -> 3169 XUVs
C:0 T:10 25886 XUs and 42955 XVs -> 6088 XUVs
C:0 T:11 196 XUs and 97 XVs -> 12 XUVs
48950 XUVs total
11713 collection wire objects
45696 potential space points
Neighbour search...
10689758 tests to find 4278488 neighbours
Iterating with no regularization...
Begin: 8.20796e+07
0 7.15009e+07
1 7.08149e+07
2 7.07318e+07
3 7.07116e+07
Now with regularization...
Begin: 6.12954e+07
0 6.12735e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411660123
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411660123
fLifetime: 30000 [us]
10-Jan-2026 20:57:53 GMT Closed output file "reco_stage1.root"
10-Jan-2026 20:57:53 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 365.733 479.512 612.856 476.779 77.3054 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00156589 0.00639692 0.00934886 0.00746276 0.00250299 10
reco:ophit:OpHitFinder 0.336852 0.385229 0.419793 0.385733 0.0299998 10
reco:opflash:OpFlashFinder 0.20505 0.227681 0.27144 0.228199 0.0192338 10
reco:opslicer:OpSlicer 0.745935 0.945922 1.18087 0.913627 0.131236 10
reco:caldata:DataPrepModule 6.86724 7.46604 7.8837 7.57234 0.317172 10
reco:wclsdatasp:WireCellToolkit 39.5462 42.3302 44.8902 42.6718 1.70957 10
reco:gaushit:GausHitFinder 1.41817 1.76663 2.12536 1.77806 0.237265 10
reco:nhitsfilter:NumberOfHitsFilter 0.000602051 0.000728965 0.000885763 0.000726685 7.82314e-05 10
reco:reco3d:SpacePointSolver 14.5972 23.6919 38.968 19.2622 8.66512 10
reco:hitpdune:DisambigFromSpacePoints 1.54272 2.26528 3.11805 2.20916 0.52495 10
reco:pandora:StandardPandora 33.7898 50.7652 87.6382 43.5658 16.5815 10
reco:pandoraWriter:StandardPandora 0.538845 0.654961 0.781974 0.659442 0.0863704 10
reco:pandoraTrack:LArPandoraTrackCreation 4.75284 7.07202 9.88365 7.16056 1.67974 10
reco:pandoraShower:LArPandoraShowerCreation 3.91799 8.19163 13.1935 8.62546 2.65932 10
reco:pandoracalo:Calorimetry 2.59269 4.47095 5.80398 4.67426 1.15199 10
reco:pandoracalonosce:Calorimetry 2.37014 3.99456 5.72095 3.72448 1.07383 10
reco:pandorapid:Chi2ParticleID 0.00819236 0.0103065 0.0143774 0.0101404 0.00167674 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0586959 0.0795356 0.0923183 0.0792155 0.00996478 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00768168 0.00898354 0.0108993 0.00878736 0.000870048 10
reco:pandoraShowercalo:ShowerCalorimetry 3.86335 8.03214 12.9907 8.09162 2.75962 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.74185 7.72936 10.6289 8.10298 2.45397 10
reco:emtrkmichelid:EmTrackMichelId 184.288 227.978 271.614 229.193 25.321 10
reco:crttag:SingleCRTMatchingProducer 0.0158372 0.0275388 0.0623607 0.0253003 0.0120714 10
reco:crtreco:TwoCRTMatchingProducer 0.0084589 0.0169448 0.0244802 0.0170997 0.00428532 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.842354 1.00473 1.27965 0.984951 0.132044 10
reco:pandora2Track:LArPandoraTrackCreation 12.4533 23.3568 34.9799 24.6499 6.44775 10
reco:pandora2calo:Calorimetry 7.36919 13.1144 23.2506 13.458 5.1106 10
reco:pandora2calonosce:Calorimetry 6.61508 12.2794 19.212 12.5033 4.57246 10
reco:pandora2pid:Chi2ParticleID 0.0158122 0.0213155 0.0252566 0.0219549 0.00279357 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0776671 0.100883 0.117415 0.100208 0.0111718 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0148215 0.0207057 0.0245279 0.0211958 0.0027159 10
reco:pandora2Shower:LArPandoraShowerCreation 4.69639 7.77462 11.2058 8.01853 1.97014 10
reco:pandora2Showercalo:ShowerCalorimetry 5.734 10.683 15.1299 11.0117 3.70399 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.90384 9.0424 16.2055 8.94447 3.27424 10
[art]:TriggerResults:TriggerResultInserter 6.0955e-05 0.000126682 0.000303761 0.000113779 6.48305e-05 10
end_path:out1:RootOutput 1.099e-05 1.85056e-05 4.1087e-05 1.68315e-05 8.06558e-06 10
end_path:out1:RootOutput(write) 3.24165 3.8185 4.71119 3.67738 0.486924 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5159.64 MB
Peak resident set size usage (VmHWM): 4324.98 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.34 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.70 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10415424
-rw-r--r-- 1 dune01 dune01 2447712682 Jan 10 19:35 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2321647381 Jan 10 19:32 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 2133672978 Jan 10 20:57 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 1878481393 Jan 10 17:59 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1807915987 Jan 10 17:51 g4_stage1.root
-rw-r--r-- 1 dune01 dune01 75332750 Jan 10 20:51 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 242774 Jan 10 20:57 jobscript.log
-rw-r--r-- 1 dune01 dune01 217088 Jan 10 20:57 mem.db
-rw-r--r-- 1 dune01 dune01 62376 Jan 10 20:57 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01 36864 Jan 10 20:57 time.db
-rw-r--r-- 1 dune01 dune01 519 Jan 10 19:35 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Jan 10 17:59 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Jan 10 20:57 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01 52 Jan 10 17:46 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01 7 Jan 10 20:57 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 0 Jan 10 19:41 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01 0 Jan 10 19:35 debugprod.log