Jobsub ID 299746.0@dunegpschedd01.fnal.gov
| Jobsub ID | 299746.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12290 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-23 06:43:56 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc03 |
| Last heartbeat | 2026-01-23 10:43:57 |
| From worker node | Hostname | wn-da-25.gina.surf.nl |
| cpuinfo | AMD EPYC 7702P 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-23 06:44:40 |
| Input files | monte-carlo-012290-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (14264s) |
| CPU time | 3h (14130s = 99%) |
| Max RSS bytes | 4322992128 (4122 MiB) |
| Outputting started | 2026-01-23 10:42:25 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12290/1/001/reco_stage1.root
|
| Finished | 2026-01-23 10:43:57 |
| Saved logs | justin-logs:299746.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
alFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 133911 traces, 0 summary
Retagger: tagging trace set: gauss with 99440 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 99440 traces tagged "gauss"
FrameSaver: q=3.44934e+06 n=1731148 tag=gauss
wclsFrameSaver: saving 133911 traces tagged "wiener"
FrameSaver: q=3.65578e+06 n=1518775 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 24346 XUs and 26510 XVs -> 211 XUVs
C:0 T:1 46717 XUs and 48868 XVs -> 2636 XUVs
C:0 T:2 100843 XUs and 89130 XVs -> 4832 XUVs
C:0 T:3 45186 XUs and 34074 XVs -> 359 XUVs
C:0 T:4 11495 XUs and 11496 XVs -> 103 XUVs
C:0 T:5 45585 XUs and 41909 XVs -> 7629 XUVs
C:0 T:6 202835 XUs and 119053 XVs -> 14393 XUVs
C:0 T:7 48702 XUs and 39648 XVs -> 797 XUVs
C:0 T:8 4787 XUs and 6091 XVs -> 121 XUVs
C:0 T:9 30138 XUs and 54654 XVs -> 5001 XUVs
C:0 T:10 63647 XUs and 56357 XVs -> 6271 XUVs
C:0 T:11 178 XUs and 144 XVs -> 14 XUVs
42367 XUVs total
12370 collection wire objects
38687 potential space points
Neighbour search...
3802265 tests to find 2001774 neighbours
Iterating with no regularization...
Begin: 5.88586e+07
0 4.82073e+07
1 4.75577e+07
2 4.74654e+07
3 4.74377e+07
Now with regularization...
Begin: 3.81761e+07
0 3.81335e+07
1 3.81056e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411912404
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411912404
fLifetime: 30000 [us]
23-Jan-2026 11:42:23 CET Closed output file "reco_stage1.root"
23-Jan-2026 11:42:23 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 279.873 447.61 651.672 430.104 94.9441 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000868914 0.00562549 0.0104324 0.00613247 0.00301571 10
reco:ophit:OpHitFinder 0.264433 0.303875 0.338128 0.30548 0.0225218 10
reco:opflash:OpFlashFinder 0.161989 0.203234 0.2437 0.203167 0.0276936 10
reco:opslicer:OpSlicer 0.57883 0.734862 0.890801 0.763354 0.108224 10
reco:caldata:DataPrepModule 4.92786 5.16843 5.32673 5.1668 0.10428 10
reco:wclsdatasp:WireCellToolkit 34.1148 46.2838 52.0712 48.8643 5.83601 10
reco:gaushit:GausHitFinder 1.01107 1.36273 1.72317 1.37106 0.204851 10
reco:nhitsfilter:NumberOfHitsFilter 0.000578782 0.000852215 0.00165041 0.000759059 0.000305988 10
reco:reco3d:SpacePointSolver 5.11129 14.5736 26.2661 14.1788 5.48399 10
reco:hitpdune:DisambigFromSpacePoints 0.977592 1.76935 2.74274 1.77962 0.497457 10
reco:pandora:StandardPandora 22.2619 40.427 84.3951 35.8483 17.4383 10
reco:pandoraWriter:StandardPandora 0.32341 0.486837 0.647054 0.47905 0.0891524 10
reco:pandoraTrack:LArPandoraTrackCreation 2.55132 6.22173 9.82254 5.83798 2.11959 10
reco:pandoraShower:LArPandoraShowerCreation 2.52599 7.50698 13.5938 7.20032 3.25636 10
reco:pandoracalo:Calorimetry 1.26276 3.28937 4.77915 3.40697 1.0654 10
reco:pandoracalonosce:Calorimetry 1.13169 3.06013 4.48128 3.04905 1.01169 10
reco:pandorapid:Chi2ParticleID 0.00567258 0.00657653 0.00783426 0.00660217 0.000600991 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0407978 0.0574759 0.0742583 0.0582409 0.00939033 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00516879 0.00630509 0.00772283 0.00629804 0.000683567 10
reco:pandoraShowercalo:ShowerCalorimetry 2.48375 7.14403 12.3614 7.37596 3.06607 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.43115 6.93449 11.9757 7.01378 2.95678 10
reco:emtrkmichelid:EmTrackMichelId 168.478 236.494 314.525 233.567 38.9515 10
reco:crttag:SingleCRTMatchingProducer 0.00891887 0.0155563 0.0211971 0.016856 0.00391934 10
reco:crtreco:TwoCRTMatchingProducer 0.00823945 0.013496 0.0200382 0.0134155 0.00336082 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.768556 0.989715 1.27174 0.953883 0.147889 10
reco:pandora2Track:LArPandoraTrackCreation 9.2305 20.4947 36.5164 19.5122 6.9335 10
reco:pandora2calo:Calorimetry 3.80887 9.47219 15.9036 9.37283 3.23165 10
reco:pandora2calonosce:Calorimetry 3.47392 9.00864 14.8166 9.02391 3.05166 10
reco:pandora2pid:Chi2ParticleID 0.0131081 0.0162145 0.0222468 0.0153231 0.00268093 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0514478 0.0738 0.0997269 0.0725396 0.0126344 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0131307 0.016219 0.0224233 0.0155473 0.00274636 10
reco:pandora2Shower:LArPandoraShowerCreation 3.22001 7.37417 11.9529 7.47163 2.21688 10
reco:pandora2Showercalo:ShowerCalorimetry 3.03696 7.8125 12.2031 7.84861 2.32729 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.74521 6.81268 10.6778 6.86198 2.11315 10
[art]:TriggerResults:TriggerResultInserter 3.225e-05 4.52279e-05 0.000104238 3.7887e-05 2.0342e-05 10
end_path:out1:RootOutput 6.562e-06 7.7486e-06 1.1531e-05 7.219e-06 1.43135e-06 10
end_path:out1:RootOutput(write) 2.3855 3.29988 4.48516 3.27174 0.555804 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5122.67 MB
Peak resident set size usage (VmHWM): 4322.99 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10450912
-rw-r--r--. 1 dune009 dune 2440233664 Jan 23 10:25 detsim_stage2.root
-rw-r--r--. 1 dune009 dune 2314410212 Jan 23 10:23 detsim_stage1.root
-rw-r--r--. 1 dune009 dune 2157760518 Jan 23 11:42 reco_stage1.root
-rw-r--r--. 1 dune009 dune 1887421248 Jan 23 08:04 g4_stage2.root
-rw-r--r--. 1 dune009 dune 1819010227 Jan 23 07:51 g4_stage1.root
-rw-r--r--. 1 dune009 dune 82278260 Jan 23 11:36 Pandora_Events.pndr
-rw-r--r--. 1 dune009 dune 242900 Jan 23 11:42 jobscript.log
-rw-r--r--. 1 dune009 dune 217088 Jan 23 11:42 mem.db
-rw-r--r--. 1 dune009 dune 62376 Jan 23 11:42 Pandora_Geometry.xml
-rw-r--r--. 1 dune009 dune 36864 Jan 23 11:42 time.db
-rw-r--r--. 1 dune009 dune 519 Jan 23 10:25 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Jan 23 08:04 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Jan 23 11:42 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune009 dune 52 Jan 23 07:44 all-input-dids.txt
-rw-r--r--. 1 dune009 dune 7 Jan 23 11:42 justin-processed-pfns.txt
-rw-r--r--. 1 dune009 dune 0 Jan 23 10:30 ProtoDUNE.log
-rw-r--r--. 1 dune009 dune 0 Jan 23 10:25 debugprod.log
