Jobsub ID 275209.0@dunegpschedd01.fnal.gov
| Jobsub ID | 275209.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11735 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-11 22:53:21 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce02 |
| Last heartbeat | 2026-01-12 02:53:43 |
| From worker node | Hostname | wn2206251.tier2.hep.manchester.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-11 22:55:20 |
| Input files | monte-carlo-011735-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (14225s) |
| CPU time | 3h (13981s = 98%) |
| Max RSS bytes | 4429344768 (4224 MiB) |
| Outputting started | 2026-01-12 02:52:26 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11735/1/001/reco_stage1.root
|
| Finished | 2026-01-12 02:53:43 |
| Saved logs | justin-logs:275209.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
alFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 130549 traces, 0 summary
Retagger: tagging trace set: gauss with 100311 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 100311 traces tagged "gauss"
FrameSaver: q=3.41681e+06 n=1773725 tag=gauss
wclsFrameSaver: saving 130549 traces tagged "wiener"
FrameSaver: q=3.62023e+06 n=1581016 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 33506 XUs and 27733 XVs -> 525 XUVs
C:0 T:1 126119 XUs and 75097 XVs -> 17480 XUVs
C:0 T:2 70756 XUs and 116969 XVs -> 5004 XUVs
C:0 T:3 33394 XUs and 34541 XVs -> 188 XUVs
C:0 T:4 14924 XUs and 12628 XVs -> 239 XUVs
C:0 T:5 173313 XUs and 68520 XVs -> 22679 XUVs
C:0 T:6 96590 XUs and 126486 XVs -> 6809 XUVs
C:0 T:7 41454 XUs and 51917 XVs -> 512 XUVs
C:0 T:8 8717 XUs and 7220 XVs -> 60 XUVs
C:0 T:9 52053 XUs and 54840 XVs -> 5508 XUVs
C:0 T:10 26910 XUs and 21823 XVs -> 2763 XUVs
C:0 T:11 82 XUs and 91 XVs -> 13 XUVs
61780 XUVs total
10992 collection wire objects
57098 potential space points
Neighbour search...
11924320 tests to find 5131410 neighbours
Iterating with no regularization...
Begin: 6.55915e+07
0 5.39867e+07
1 5.33015e+07
2 5.31857e+07
3 5.3149e+07
Now with regularization...
Begin: 4.44093e+07
0 4.4361e+07
1 4.43224e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411684510
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411684510
fLifetime: 30000 [us]
12-Jan-2026 02:52:24 GMT Closed output file "reco_stage1.root"
12-Jan-2026 02:52:24 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 359.422 421.952 538.912 410.783 49.1336 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000892462 0.00358365 0.00527527 0.00382074 0.00135986 10
reco:ophit:OpHitFinder 0.275695 0.311863 0.357596 0.306337 0.0245057 10
reco:opflash:OpFlashFinder 0.211199 0.260112 0.304926 0.253131 0.0334908 10
reco:opslicer:OpSlicer 0.612998 0.732019 0.824369 0.724145 0.0698734 10
reco:caldata:DataPrepModule 6.19396 6.35439 6.68758 6.32042 0.132217 10
reco:wclsdatasp:WireCellToolkit 47.8877 51.8703 53.3303 52.6389 1.73384 10
reco:gaushit:GausHitFinder 1.318 1.4999 1.75918 1.48062 0.129908 10
reco:nhitsfilter:NumberOfHitsFilter 0.000616849 0.000726455 0.00102372 0.000692059 0.000108093 10
reco:reco3d:SpacePointSolver 11.6313 16.1694 28.7492 15.0266 4.57557 10
reco:hitpdune:DisambigFromSpacePoints 1.85995 2.45896 3.33605 2.37834 0.400723 10
reco:pandora:StandardPandora 26.0928 39.6194 80.4434 34.9495 14.8636 10
reco:pandoraWriter:StandardPandora 0.452447 0.543641 0.645033 0.535766 0.053606 10
reco:pandoraTrack:LArPandoraTrackCreation 4.2083 5.87268 8.00636 5.84323 1.07934 10
reco:pandoraShower:LArPandoraShowerCreation 4.6026 5.66351 7.38956 5.45121 0.945945 10
reco:pandoracalo:Calorimetry 2.22087 2.95905 3.77705 2.98652 0.472606 10
reco:pandoracalonosce:Calorimetry 1.98119 2.69016 3.48622 2.70506 0.438128 10
reco:pandorapid:Chi2ParticleID 0.00535852 0.00691458 0.0082869 0.00692101 0.000802293 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0602367 0.0752367 0.0844762 0.0770559 0.00705658 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00512096 0.00669224 0.00776608 0.00673362 0.000727667 10
reco:pandoraShowercalo:ShowerCalorimetry 4.70104 5.80884 7.43787 5.68259 0.930885 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.60101 5.67111 7.26625 5.54704 0.899194 10
reco:emtrkmichelid:EmTrackMichelId 180.764 212.813 256.354 207.876 20.7333 10
reco:crttag:SingleCRTMatchingProducer 0.0184532 0.0241388 0.0320955 0.0237592 0.00374042 10
reco:crtreco:TwoCRTMatchingProducer 0.0104165 0.0129488 0.014923 0.0129053 0.00147062 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.17459 1.45384 1.75891 1.39883 0.182922 10
reco:pandora2Track:LArPandoraTrackCreation 14.9736 18.5443 23.2337 18.0955 2.88484 10
reco:pandora2calo:Calorimetry 6.72649 8.35963 10.2566 8.35471 1.22775 10
reco:pandora2calonosce:Calorimetry 6.40937 7.96279 9.75407 7.94362 1.16678 10
reco:pandora2pid:Chi2ParticleID 0.0136588 0.0168396 0.0197871 0.0166303 0.00188443 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0755419 0.0941981 0.110524 0.0949968 0.00957851 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0134115 0.016749 0.0199372 0.0166323 0.00192513 10
reco:pandora2Shower:LArPandoraShowerCreation 5.43826 6.46547 8.24553 6.35738 0.911238 10
reco:pandora2Showercalo:ShowerCalorimetry 6.09375 7.40084 9.0967 7.38187 1.00259 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.78113 6.90568 8.50869 6.89885 0.890221 10
[art]:TriggerResults:TriggerResultInserter 5.8019e-05 7.31293e-05 0.000136653 6.77655e-05 2.14634e-05 10
end_path:out1:RootOutput 8.1e-06 9.9275e-06 1.618e-05 9.1025e-06 2.21305e-06 10
end_path:out1:RootOutput(write) 2.66771 3.18495 3.9528 3.08133 0.344702 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5233.17 MB
Peak resident set size usage (VmHWM): 4429.34 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.00 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10436708
-rw-r--r-- 1 dune01 dune01 2449644888 Jan 12 01:40 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2323289819 Jan 12 01:37 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 2163222603 Jan 12 02:52 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 1877550544 Jan 11 23:15 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1791584836 Jan 11 23:01 g4_stage1.root
-rw-r--r-- 1 dune01 dune01 81268680 Jan 12 02:47 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 243039 Jan 12 02:52 jobscript.log
-rw-r--r-- 1 dune01 dune01 217088 Jan 12 02:52 mem.db
-rw-r--r-- 1 dune01 dune01 62376 Jan 12 02:52 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01 36864 Jan 12 02:52 time.db
-rw-r--r-- 1 dune01 dune01 519 Jan 12 01:40 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Jan 11 23:15 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Jan 12 02:52 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01 52 Jan 11 22:55 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01 7 Jan 12 02:52 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 0 Jan 12 01:48 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01 0 Jan 12 01:40 debugprod.log