Jobsub ID 251414.1@dunegpschedd02.fnal.gov
| Jobsub ID | 251414.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10663 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-25 08:34:07 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-25 13:32:21 |
| From worker node | Hostname | dunegli-7730605-0-fnpc18010.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-25 08:35:06 |
| Input files | monte-carlo-010663-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (17790s) |
| CPU time | 4h (17594s = 98%) |
| Max RSS bytes | 4152942592 (3960 MiB) |
| Outputting started | 2025-11-25 13:31:37 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10663/1/001/reco_stage1.root
|
| Finished | 2025-11-25 13:32:21 |
| Saved logs | justin-logs:251414.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
ol adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 129790 traces, 0 summary
Retagger: tagging trace set: gauss with 93804 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 93804 traces tagged "gauss"
FrameSaver: q=3.44936e+06 n=1635821 tag=gauss
wclsFrameSaver: saving 129790 traces tagged "wiener"
FrameSaver: q=3.67884e+06 n=1426798 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 33889 XUs and 30889 XVs -> 432 XUVs
C:0 T:1 60674 XUs and 54563 XVs -> 4898 XUVs
C:0 T:2 57470 XUs and 80822 XVs -> 4203 XUVs
C:0 T:3 27297 XUs and 28909 XVs -> 228 XUVs
C:0 T:4 12918 XUs and 18533 XVs -> 263 XUVs
C:0 T:5 91269 XUs and 112982 XVs -> 16189 XUVs
C:0 T:6 98276 XUs and 119063 XVs -> 7678 XUVs
C:0 T:7 34433 XUs and 43139 XVs -> 388 XUVs
C:0 T:8 7582 XUs and 7857 XVs -> 94 XUVs
C:0 T:9 67381 XUs and 77008 XVs -> 5449 XUVs
C:0 T:10 30963 XUs and 22982 XVs -> 4200 XUVs
C:0 T:11 225 XUs and 113 XVs -> 24 XUVs
44046 XUVs total
12004 collection wire objects
40831 potential space points
Neighbour search...
4967427 tests to find 2356236 neighbours
Iterating with no regularization...
Begin: 8.04346e+07
0 6.3255e+07
1 6.20041e+07
2 6.1799e+07
3 6.17348e+07
4 6.17051e+07
Now with regularization...
Begin: 5.03504e+07
0 5.02918e+07
1 5.0258e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410727060
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410727060
fLifetime: 30000 [us]
25-Nov-2025 13:31:34 UTC Closed output file "reco_stage1.root"
25-Nov-2025 13:31:34 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 331.085 625.172 985.178 618.16 163.451 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00180373 0.005306 0.00773431 0.00549466 0.00179189 10
reco:ophit:OpHitFinder 0.28508 0.41627 0.481205 0.440941 0.0595768 10
reco:opflash:OpFlashFinder 0.148603 0.2283 0.309384 0.226481 0.0445418 10
reco:opslicer:OpSlicer 0.632211 1.10883 1.34035 1.1505 0.206855 10
reco:caldata:DataPrepModule 7.01871 8.78805 10.056 8.78703 0.998251 10
reco:wclsdatasp:WireCellToolkit 39.9497 56.932 68.2945 59.3612 8.64368 10
reco:gaushit:GausHitFinder 0.975819 1.9299 3.09759 2.07923 0.557189 10
reco:nhitsfilter:NumberOfHitsFilter 0.0006782 0.00100576 0.00126906 0.00105297 0.000219113 10
reco:reco3d:SpacePointSolver 8.97349 19.7335 31.2865 18.2845 7.42958 10
reco:hitpdune:DisambigFromSpacePoints 0.935349 2.52288 4.40707 2.65939 0.875278 10
reco:pandora:StandardPandora 22.0766 60.1327 103.65 55.3126 24.8044 10
reco:pandoraWriter:StandardPandora 0.401808 0.754853 1.15835 0.749925 0.196766 10
reco:pandoraTrack:LArPandoraTrackCreation 4.74085 9.12918 15.4626 9.00335 2.71811 10
reco:pandoraShower:LArPandoraShowerCreation 5.15085 11.5858 23.4948 10.8404 5.01277 10
reco:pandoracalo:Calorimetry 2.52225 5.32694 9.69631 5.04111 2.00193 10
reco:pandoracalonosce:Calorimetry 2.38103 5.12819 8.7601 4.83142 1.96535 10
reco:pandorapid:Chi2ParticleID 0.00847162 0.0117234 0.0247398 0.0100947 0.00457039 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0467978 0.101657 0.131036 0.102693 0.0227255 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00563918 0.0100218 0.013091 0.00977579 0.00215113 10
reco:pandoraShowercalo:ShowerCalorimetry 4.73782 12.8917 27.0901 11.2227 6.55446 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.41517 11.9057 28.9147 10.0061 6.86441 10
reco:emtrkmichelid:EmTrackMichelId 175.398 317.013 456.209 314.908 72.4856 10
reco:crttag:SingleCRTMatchingProducer 0.0183313 0.0348457 0.050238 0.036205 0.0079971 10
reco:crtreco:TwoCRTMatchingProducer 0.0145662 0.0256809 0.0477434 0.0232877 0.00877324 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.743964 1.46325 1.81843 1.52547 0.340386 10
reco:pandora2Track:LArPandoraTrackCreation 15.3049 30.5698 56.3831 29.0481 10.6102 10
reco:pandora2calo:Calorimetry 6.6647 14.7597 30.7293 13.2572 6.45543 10
reco:pandora2calonosce:Calorimetry 7.06432 13.799 31.5225 12.4298 6.5131 10
reco:pandora2pid:Chi2ParticleID 0.0167231 0.0245736 0.0363601 0.02306 0.00529271 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0840016 0.117871 0.173557 0.12105 0.0239439 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.015976 0.0236371 0.0349543 0.0226763 0.00499203 10
reco:pandora2Shower:LArPandoraShowerCreation 5.46299 10.8994 20.4065 10.3809 3.71938 10
reco:pandora2Showercalo:ShowerCalorimetry 5.86168 12.2761 27.328 11.4963 5.64272 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.29294 10.7531 24.0255 9.22228 4.92944 10
[art]:TriggerResults:TriggerResultInserter 0.000112873 0.000184685 0.000533828 0.000139704 0.000120202 10
end_path:out1:RootOutput 1.9116e-05 2.18872e-05 2.633e-05 2.1155e-05 2.36203e-06 10
end_path:out1:RootOutput(write) 3.42457 4.53498 6.50802 4.58243 0.87965 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4963.79 MB
Peak resident set size usage (VmHWM): 4152.94 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.43 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.36 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9917244
-rw-r--r-- 1 dunegli fnalgrid 2336897467 Nov 25 11:44 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2222900466 Nov 25 11:40 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1998806389 Nov 25 13:31 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1799109095 Nov 25 08:56 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1727907078 Nov 25 08:41 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 69021830 Nov 25 13:25 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242750 Nov 25 13:31 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 25 13:31 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 25 13:31 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 25 13:31 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 11:44 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 08:56 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 13:31 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 25 08:35 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 25 13:31 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 11:49 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 11:44 debugprod.log
