Jobsub ID 263932.1@dunegpschedd02.fnal.gov
| Jobsub ID | 263932.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11313 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-23 08:25:34 |
| Site | UK_Durham |
| Entry | DUNE_UK_SGridDurham_ce3 |
| Last heartbeat | 2025-12-23 11:10:23 |
| From worker node | Hostname | n259.dur.scotgrid.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-12-23 08:26:27 |
| Input files | monte-carlo-011313-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (9813s) |
| CPU time | 2h (9600s = 97%) |
| Max RSS bytes | 4366835712 (4164 MiB) |
| Outputting started | 2025-12-23 11:10:02 |
| Output files | |
| Finished | 2025-12-23 11:10:23 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
lSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 111240 traces, 0 summary
Retagger: tagging trace set: gauss with 81580 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 81580 traces tagged "gauss"
FrameSaver: q=2.8237e+06 n=1379902 tag=gauss
wclsFrameSaver: saving 111240 traces tagged "wiener"
FrameSaver: q=3.00946e+06 n=1201355 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35793 XUs and 23756 XVs -> 475 XUVs
C:0 T:1 117575 XUs and 63805 XVs -> 12010 XUVs
C:0 T:2 113062 XUs and 79636 XVs -> 5309 XUVs
C:0 T:3 52355 XUs and 33130 XVs -> 250 XUVs
C:0 T:4 10126 XUs and 6313 XVs -> 167 XUVs
C:0 T:5 75577 XUs and 24749 XVs -> 9607 XUVs
C:0 T:6 84177 XUs and 57495 XVs -> 3844 XUVs
C:0 T:7 33973 XUs and 25518 XVs -> 205 XUVs
C:0 T:8 4987 XUs and 3595 XVs -> 37 XUVs
C:0 T:9 32377 XUs and 26955 XVs -> 2795 XUVs
C:0 T:10 23011 XUs and 17282 XVs -> 2810 XUVs
C:0 T:11 666 XUs and 551 XVs -> 69 XUVs
37578 XUVs total
9358 collection wire objects
34337 potential space points
Neighbour search...
4478699 tests to find 2152914 neighbours
Iterating with no regularization...
Begin: 5.59497e+07
0 4.76861e+07
1 4.70788e+07
2 4.69724e+07
3 4.69352e+07
Now with regularization...
Begin: 3.83995e+07
0 3.83568e+07
1 3.83276e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411290240
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411290240
fLifetime: 30000 [us]
23-Dec-2025 11:09:55 GMT Closed output file "reco_stage1.root"
23-Dec-2025 11:09:55 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 223.416 298.657 429.136 300.737 58.8856 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000759019 0.00382506 0.00755101 0.00395529 0.00195813 10
reco:ophit:OpHitFinder 0.244026 0.455184 2.07776 0.276105 0.541424 10
reco:opflash:OpFlashFinder 0.162443 0.204644 0.251517 0.206849 0.0312378 10
reco:opslicer:OpSlicer 0.454028 0.539877 0.648396 0.554277 0.0586215 10
reco:caldata:DataPrepModule 4.39987 5.04382 9.17256 4.57016 1.3821 10
reco:wclsdatasp:WireCellToolkit 29.4279 31.7381 37.6969 31.3465 2.18439 10
reco:gaushit:GausHitFinder 0.832374 0.983845 1.12139 1.01396 0.0927666 10
reco:nhitsfilter:NumberOfHitsFilter 0.000391572 0.000621923 0.000940965 0.00061171 0.000173402 10
reco:reco3d:SpacePointSolver 9.00691 18.6471 42.8455 14.4726 10.5785 10
reco:hitpdune:DisambigFromSpacePoints 0.900285 1.35202 1.69126 1.4349 0.242112 10
reco:pandora:StandardPandora 12.1573 31.4259 69.0752 26.8798 15.841 10
reco:pandoraWriter:StandardPandora 0.32935 0.392638 0.492548 0.385342 0.0517742 10
reco:pandoraTrack:LArPandoraTrackCreation 2.22471 3.84656 7.16349 3.70718 1.37032 10
reco:pandoraShower:LArPandoraShowerCreation 2.0941 3.87735 7.00491 3.66359 1.3798 10
reco:pandoracalo:Calorimetry 1.40766 2.17978 3.67823 2.24455 0.633859 10
reco:pandoracalonosce:Calorimetry 1.2161 2.01703 3.52787 2.04603 0.627119 10
reco:pandorapid:Chi2ParticleID 0.00392371 0.00529841 0.00713687 0.00498211 0.000899885 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0384245 0.0539727 0.131536 0.0470079 0.0261894 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00373895 0.00485996 0.00537335 0.00499176 0.000446665 10
reco:pandoraShowercalo:ShowerCalorimetry 1.93853 4.01092 7.02943 3.88269 1.4218 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.83953 3.92036 6.67882 3.91377 1.34419 10
reco:emtrkmichelid:EmTrackMichelId 116.018 147.314 180.814 155.221 18.4725 10
reco:crttag:SingleCRTMatchingProducer 0.00963781 0.0137069 0.0239255 0.01278 0.00419027 10
reco:crtreco:TwoCRTMatchingProducer 0.00571435 0.00772452 0.0101313 0.0077007 0.00129319 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.709267 0.88285 1.02719 0.880255 0.116903 10
reco:pandora2Track:LArPandoraTrackCreation 6.15641 11.3514 19.8548 11.1588 3.79726 10
reco:pandora2calo:Calorimetry 3.01993 5.99737 10.3761 6.08904 1.99172 10
reco:pandora2calonosce:Calorimetry 2.93085 5.67088 9.90493 5.699 1.87085 10
reco:pandora2pid:Chi2ParticleID 0.00844931 0.0108704 0.0146157 0.0106013 0.00185263 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0397415 0.0555278 0.0717301 0.056373 0.00843767 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00898065 0.0110685 0.0144134 0.0107657 0.00180949 10
reco:pandora2Shower:LArPandoraShowerCreation 2.46435 4.35421 7.51201 4.34854 1.37028 10
reco:pandora2Showercalo:ShowerCalorimetry 2.53988 4.97322 8.06119 5.19705 1.48971 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.35762 4.52007 7.33257 4.72878 1.32447 10
[art]:TriggerResults:TriggerResultInserter 4.0586e-05 0.000139038 0.000853929 5.5325e-05 0.000239111 10
end_path:out1:RootOutput 8.536e-06 0.000102213 0.000925455 9.899e-06 0.000274423 10
end_path:out1:RootOutput(write) 2.18903 2.66626 3.31557 2.68168 0.334942 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5173.41 MB
Peak resident set size usage (VmHWM): 4366.84 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.88 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10579036
-rw-r--r--. 1 dune004 dune 2473746232 Dec 23 10:18 detsim_stage2.root
-rw-r--r--. 1 dune004 dune 2348865387 Dec 23 10:16 detsim_stage1.root
-rw-r--r--. 1 dune004 dune 2173411876 Dec 23 11:09 reco_stage1.root
-rw-r--r--. 1 dune004 dune 1925479599 Dec 23 08:42 g4_stage2.root
-rw-r--r--. 1 dune004 dune 1833076256 Dec 23 08:32 g4_stage1.root
-rw-r--r--. 1 dune004 dune 77722390 Dec 23 11:07 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune 243387 Dec 23 11:10 jobscript.log
-rw-r--r--. 1 dune004 dune 217088 Dec 23 11:09 mem.db
-rw-r--r--. 1 dune004 dune 62376 Dec 23 11:09 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune 36864 Dec 23 11:09 time.db
-rw-r--r--. 1 dune004 dune 519 Dec 23 10:18 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune 519 Dec 23 08:42 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune 519 Dec 23 11:09 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune004 dune 52 Dec 23 08:26 all-input-dids.txt
-rw-r--r--. 1 dune004 dune 7 Dec 23 11:10 justin-processed-pfns.txt
-rw-r--r--. 1 dune004 dune 0 Dec 23 10:24 ProtoDUNE.log
-rw-r--r--. 1 dune004 dune 0 Dec 23 10:18 debugprod.log
