Jobsub ID 242134.1@dunegpschedd02.fnal.gov
| Jobsub ID | 242134.1@dunegpschedd02.fnal.gov |
| Workflow ID | 9993 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-12 12:22:26 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce02 |
| Last heartbeat | 2025-11-12 16:36:57 |
| From worker node | Hostname | wn2208251.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-11-12 12:23:31 |
| Input files | monte-carlo-009993-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11029s) |
| CPU time | 2h (10741s = 97%) |
| Max RSS bytes | 4180631552 (3986 MiB) |
| Outputting started | 2025-11-12 15:27:21 |
| Output files | |
| Finished | 2025-11-12 16:36:57 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
lBasedRawDigitPrepService:prepare: Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 119300 traces, 0 summary
Retagger: tagging trace set: gauss with 89626 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 89626 traces tagged "gauss"
FrameSaver: q=3.18969e+06 n=1576282 tag=gauss
wclsFrameSaver: saving 119300 traces tagged "wiener"
FrameSaver: q=3.37762e+06 n=1395064 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 43636 XUs and 31365 XVs -> 361 XUVs
C:0 T:1 66362 XUs and 53491 XVs -> 3759 XUVs
C:0 T:2 91078 XUs and 167054 XVs -> 14737 XUVs
C:0 T:3 40425 XUs and 57923 XVs -> 1032 XUVs
C:0 T:5 15280 XUs and 16255 XVs -> 1843 XUVs
C:0 T:6 83950 XUs and 97796 XVs -> 7055 XUVs
C:0 T:7 34527 XUs and 33596 XVs -> 356 XUVs
C:0 T:8 7209 XUs and 9710 XVs -> 59 XUVs
C:0 T:9 46452 XUs and 67761 XVs -> 5517 XUVs
C:0 T:10 22641 XUs and 14220 XVs -> 1992 XUVs
C:0 T:11 55 XUs and 33 XVs -> 9 XUVs
36720 XUVs total
9346 collection wire objects
33351 potential space points
Neighbour search...
3355319 tests to find 1777596 neighbours
Iterating with no regularization...
Begin: 6.37959e+07
0 5.48419e+07
1 5.40596e+07
2 5.39441e+07
3 5.39078e+07
Now with regularization...
Begin: 4.50015e+07
0 4.49739e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410468586
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410468586
fLifetime: 30000 [us]
12-Nov-2025 15:27:19 GMT Closed output file "reco_stage1.root"
12-Nov-2025 15:27:19 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 321.672 398.716 476.82 403.033 55.5454 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000849918 0.00383711 0.00638281 0.00359282 0.00174739 10
reco:ophit:OpHitFinder 0.255722 0.310204 0.408693 0.281278 0.0540029 10
reco:opflash:OpFlashFinder 0.10018 0.166773 0.207721 0.170961 0.0307626 10
reco:opslicer:OpSlicer 0.534324 0.744691 1.1316 0.688384 0.193037 10
reco:caldata:DataPrepModule 4.42668 6.22405 7.59171 6.76616 1.31697 10
reco:wclsdatasp:WireCellToolkit 29.0179 34.0576 43.1623 32.4383 4.7468 10
reco:gaushit:GausHitFinder 0.835159 1.16808 1.80834 1.13413 0.2914 10
reco:nhitsfilter:NumberOfHitsFilter 0.000403769 0.000540046 0.000721315 0.000519857 9.62669e-05 10
reco:reco3d:SpacePointSolver 8.26346 21.7728 62.4689 17.6484 14.7474 10
reco:hitpdune:DisambigFromSpacePoints 1.03419 1.68294 2.52984 1.7829 0.443286 10
reco:pandora:StandardPandora 18.6917 31.6139 56.5607 29.401 10.6511 10
reco:pandoraWriter:StandardPandora 0.309906 0.396849 0.633859 0.375388 0.0908837 10
reco:pandoraTrack:LArPandoraTrackCreation 1.96177 3.26814 4.487 3.00518 0.798294 10
reco:pandoraShower:LArPandoraShowerCreation 2.72051 4.06826 6.1574 3.88258 1.15407 10
reco:pandoracalo:Calorimetry 1.18416 2.04642 3.58148 1.94036 0.59373 10
reco:pandoracalonosce:Calorimetry 1.11697 1.92719 3.31023 1.76509 0.540871 10
reco:pandorapid:Chi2ParticleID 0.00322989 0.00463596 0.00810238 0.0042361 0.00132035 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0341214 0.0481423 0.0839609 0.0448083 0.0133742 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00362166 0.00449776 0.00781914 0.00413825 0.00116143 10
reco:pandoraShowercalo:ShowerCalorimetry 2.96917 4.8592 8.88275 4.28072 1.76209 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.89965 4.93369 8.79878 4.26909 1.93815 10
reco:emtrkmichelid:EmTrackMichelId 190.829 223.984 262.406 219.801 22.5828 10
reco:crttag:SingleCRTMatchingProducer 0.0123653 0.0174124 0.0267409 0.0170947 0.00427393 10
reco:crtreco:TwoCRTMatchingProducer 0.00840004 0.0117889 0.0140485 0.0118523 0.00191038 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.753456 1.03703 1.32575 1.00433 0.164215 10
reco:pandora2Track:LArPandoraTrackCreation 10.831 16.1113 23.94 16.3443 4.30338 10
reco:pandora2calo:Calorimetry 5.23965 8.37143 11.9353 8.77494 2.08675 10
reco:pandora2calonosce:Calorimetry 5.23839 7.66048 10.6169 7.49211 1.84724 10
reco:pandora2pid:Chi2ParticleID 0.00904913 0.0170452 0.0233309 0.0184191 0.0046581 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0537356 0.0899566 0.118774 0.0942528 0.0237 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00924218 0.0172316 0.0239489 0.0179404 0.00452468 10
reco:pandora2Shower:LArPandoraShowerCreation 3.70769 5.51838 7.737 5.28814 1.41933 10
reco:pandora2Showercalo:ShowerCalorimetry 4.82721 6.95022 9.62012 6.62377 1.62706 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.88055 6.12263 8.89068 5.44469 1.56283 10
[art]:TriggerResults:TriggerResultInserter 4.1068e-05 8.29376e-05 0.000244559 6.4997e-05 5.55959e-05 10
end_path:out1:RootOutput 8.646e-06 1.4317e-05 2.5838e-05 1.38565e-05 4.66766e-06 10
end_path:out1:RootOutput(write) 2.25109 3.39135 4.7218 3.19625 0.869728 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5008.49 MB
Peak resident set size usage (VmHWM): 4180.63 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.28 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.94 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10050724
-rw-r--r-- 1 dune01 dune01 2361532335 Nov 12 14:18 detsim_stage2.root
-rw-r--r-- 1 dune01 dune01 2248311316 Nov 12 14:16 detsim_stage1.root
-rw-r--r-- 1 dune01 dune01 2063678613 Nov 12 15:27 reco_stage1.root
-rw-r--r-- 1 dune01 dune01 1792876128 Nov 12 12:37 g4_stage2.root
-rw-r--r-- 1 dune01 dune01 1746426328 Nov 12 12:29 g4_stage1.root
-rw-r--r-- 1 dune01 dune01 78492940 Nov 12 15:23 Pandora_Events.pndr
-rw-r--r-- 1 dune01 dune01 242893 Nov 12 15:27 jobscript.log
-rw-r--r-- 1 dune01 dune01 217088 Nov 12 15:27 mem.db
-rw-r--r-- 1 dune01 dune01 62376 Nov 12 15:27 Pandora_Geometry.xml
-rw-r--r-- 1 dune01 dune01 36864 Nov 12 15:27 time.db
-rw-r--r-- 1 dune01 dune01 519 Nov 12 14:18 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Nov 12 12:37 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune01 dune01 519 Nov 12 15:27 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune01 dune01 52 Nov 12 12:23 all-input-dids.txt
-rw-r--r-- 1 dune01 dune01 7 Nov 12 15:27 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 0 Nov 12 14:25 ProtoDUNE.log
-rw-r--r-- 1 dune01 dune01 0 Nov 12 14:19 debugprod.log
