Jobsub ID 239173.1@dunegpschedd02.fnal.gov
| Jobsub ID | 239173.1@dunegpschedd02.fnal.gov |
| Workflow ID | 9848 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-07 00:00:11 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc02 |
| Last heartbeat | 2025-11-07 04:48:52 |
| From worker node | Hostname | wn-la-22.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-11-07 00:01:07 |
| Input files | monte-carlo-009848-000001
|
| Outputting started | 2025-11-07 04:48:52 |
| Output files | |
| Finished | 2025-11-07 05:13:22 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
alFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 153707 traces, 0 summary
Retagger: tagging trace set: gauss with 117758 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 117758 traces tagged "gauss"
FrameSaver: q=4.17197e+06 n=2143102 tag=gauss
wclsFrameSaver: saving 153707 traces tagged "wiener"
FrameSaver: q=4.42368e+06 n=1909352 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 46846 XUs and 48479 XVs -> 544 XUVs
C:0 T:1 107038 XUs and 110677 XVs -> 7554 XUVs
C:0 T:2 114550 XUs and 123551 XVs -> 5535 XUVs
C:0 T:3 56438 XUs and 50577 XVs -> 237 XUVs
C:0 T:4 19149 XUs and 18215 XVs -> 158 XUVs
C:0 T:5 90244 XUs and 67567 XVs -> 7786 XUVs
C:0 T:6 94201 XUs and 112055 XVs -> 9550 XUVs
C:0 T:7 39264 XUs and 38608 XVs -> 593 XUVs
C:0 T:8 7994 XUs and 9725 XVs -> 100 XUVs
C:0 T:9 72149 XUs and 84696 XVs -> 9787 XUVs
C:0 T:10 41810 XUs and 34728 XVs -> 6048 XUVs
C:0 T:11 107 XUs and 72 XVs -> 8 XUVs
47900 XUVs total
14238 collection wire objects
44176 potential space points
Neighbour search...
5035838 tests to find 2441072 neighbours
Iterating with no regularization...
Begin: 1.12331e+08
0 9.0728e+07
1 8.92163e+07
2 8.90446e+07
3 8.89935e+07
Now with regularization...
Begin: 7.47307e+07
0 7.46439e+07
1 7.45969e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410352527
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410352527
fLifetime: 30000 [us]
07-Nov-2025 05:48:50 CET Closed output file "reco_stage1.root"
07-Nov-2025 05:48:50 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 337.094 482.705 649.816 439.129 104.393 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00140169 0.00595231 0.00993489 0.00622861 0.00272063 10
reco:ophit:OpHitFinder 0.308538 0.419006 0.494746 0.44233 0.0617738 10
reco:opflash:OpFlashFinder 0.202872 0.303814 0.380613 0.310996 0.054144 10
reco:opslicer:OpSlicer 0.609928 0.88412 1.06392 0.925552 0.149138 10
reco:caldata:DataPrepModule 4.84484 6.10964 7.08561 6.43519 0.811373 10
reco:wclsdatasp:WireCellToolkit 40.7074 52.9449 71.3089 49.0987 9.61772 10
reco:gaushit:GausHitFinder 0.951487 1.4225 1.92117 1.37434 0.273664 10
reco:nhitsfilter:NumberOfHitsFilter 0.000431083 0.000861 0.00135204 0.000846609 0.000268016 10
reco:reco3d:SpacePointSolver 9.84853 18.2066 26.6406 17.7197 4.71896 10
reco:hitpdune:DisambigFromSpacePoints 0.942118 1.82216 2.85703 1.66046 0.566749 10
reco:pandora:StandardPandora 20.5363 45.7276 87.7879 35.594 21.5478 10
reco:pandoraWriter:StandardPandora 0.399855 0.556723 0.723755 0.581792 0.096666 10
reco:pandoraTrack:LArPandoraTrackCreation 5.54392 8.7169 11.4102 9.60671 2.38723 10
reco:pandoraShower:LArPandoraShowerCreation 5.44759 10.9898 17.8802 11.7754 4.1184 10
reco:pandoracalo:Calorimetry 3.37973 4.95015 6.49972 5.01381 1.12053 10
reco:pandoracalonosce:Calorimetry 3.04157 4.56763 6.48296 4.88653 1.22723 10
reco:pandorapid:Chi2ParticleID 0.00509227 0.00671515 0.00841237 0.00638139 0.000970919 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0388944 0.0576523 0.0710995 0.0573286 0.00995368 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00499723 0.00657827 0.00787284 0.00666639 0.00082991 10
reco:pandoraShowercalo:ShowerCalorimetry 7.20387 11.06 17.7113 10.5128 3.33892 10
reco:pandoraShowercalonosce:ShowerCalorimetry 5.59299 9.95953 16.4243 9.4538 3.55857 10
reco:emtrkmichelid:EmTrackMichelId 151.202 216.407 275.353 208.623 36.4699 10
reco:crttag:SingleCRTMatchingProducer 0.0111725 0.0218841 0.031739 0.0224615 0.00631362 10
reco:crtreco:TwoCRTMatchingProducer 0.0100119 0.0166218 0.030328 0.0148726 0.0056293 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.711979 1.00058 1.23503 0.994897 0.155166 10
reco:pandora2Track:LArPandoraTrackCreation 15.0948 28.2298 49.5047 25.4499 10.1276 10
reco:pandora2calo:Calorimetry 6.73551 13.7317 22.9697 13.103 5.17876 10
reco:pandora2calonosce:Calorimetry 6.84717 13.0625 21.7989 12.076 4.69497 10
reco:pandora2pid:Chi2ParticleID 0.0106304 0.0148468 0.0199759 0.0140931 0.00305342 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0479527 0.0757711 0.123603 0.0678059 0.0224613 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0105428 0.0147629 0.019788 0.0140754 0.00305954 10
reco:pandora2Shower:LArPandoraShowerCreation 5.47562 9.54252 18.2374 8.52391 3.54596 10
reco:pandora2Showercalo:ShowerCalorimetry 6.30093 10.0541 16.9922 9.15547 3.17864 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.27211 8.21695 14.8504 7.22614 2.74541 10
[art]:TriggerResults:TriggerResultInserter 3.1106e-05 6.20305e-05 0.000186309 5.28535e-05 4.23143e-05 10
end_path:out1:RootOutput 6.78e-06 8.8541e-06 1.6004e-05 8.412e-06 2.4873e-06 10
end_path:out1:RootOutput(write) 2.26253 3.31938 4.57274 3.21504 0.615554 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5302.25 MB
Peak resident set size usage (VmHWM): 4498.63 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.28 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.77 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11173932
-rw-r--r--. 1 dune009 dune 2587745178 Nov 7 04:26 detsim_stage2.root
-rw-r--r--. 1 dune009 dune 2453578506 Nov 7 04:23 detsim_stage1.root
-rw-r--r--. 1 dune009 dune 2301202292 Nov 7 05:48 reco_stage1.root
-rw-r--r--. 1 dune009 dune 2047133678 Nov 7 01:25 g4_stage2.root
-rw-r--r--. 1 dune009 dune 1970598477 Nov 7 01:08 g4_stage1.root
-rw-r--r--. 1 dune009 dune 81234140 Nov 7 05:42 Pandora_Events.pndr
-rw-r--r--. 1 dune009 dune 242818 Nov 7 05:48 jobscript.log
-rw-r--r--. 1 dune009 dune 217088 Nov 7 05:48 mem.db
-rw-r--r--. 1 dune009 dune 62376 Nov 7 05:48 Pandora_Geometry.xml
-rw-r--r--. 1 dune009 dune 36864 Nov 7 05:48 time.db
-rw-r--r--. 1 dune009 dune 519 Nov 7 04:26 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Nov 7 01:25 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Nov 7 05:48 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune009 dune 52 Nov 7 01:01 all-input-dids.txt
-rw-r--r--. 1 dune009 dune 7 Nov 7 05:48 justin-processed-pfns.txt
-rw-r--r--. 1 dune009 dune 0 Nov 7 04:33 ProtoDUNE.log
-rw-r--r--. 1 dune009 dune 0 Nov 7 04:26 debugprod.log
