Jobsub ID 261530.1@dunegpschedd02.fnal.gov
| Jobsub ID | 261530.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11155 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-12 09:47:15 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 14:31:46 |
| From worker node | Hostname | dunegli-7890304-0-fnpc22033.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:36:19 |
| Input files | monte-carlo-011155-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (10498s) |
| CPU time | 2h (10348s = 98%) |
| Max RSS bytes | 4512251904 (4303 MiB) |
| Outputting started | 2025-12-12 14:31:19 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11155/1/001/reco_stage1.root
|
| Finished | 2025-12-12 14:31:46 |
| Saved logs | justin-logs:261530.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ce:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 145973 traces, 0 summary
Retagger: tagging trace set: gauss with 110554 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 110554 traces tagged "gauss"
FrameSaver: q=3.93257e+06 n=1911657 tag=gauss
wclsFrameSaver: saving 145973 traces tagged "wiener"
FrameSaver: q=4.16144e+06 n=1685310 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 22746 XUs and 28128 XVs -> 97 XUVs
C:0 T:1 31214 XUs and 32575 XVs -> 2643 XUVs
C:0 T:2 119820 XUs and 120769 XVs -> 4536 XUVs
C:0 T:3 62957 XUs and 52266 XVs -> 354 XUVs
C:0 T:4 12028 XUs and 16237 XVs -> 81 XUVs
C:0 T:5 46957 XUs and 47402 XVs -> 3889 XUVs
C:0 T:6 109003 XUs and 113172 XVs -> 8197 XUVs
C:0 T:7 46576 XUs and 46002 XVs -> 768 XUVs
C:0 T:8 9375 XUs and 9022 XVs -> 162 XUVs
C:0 T:9 53320 XUs and 60875 XVs -> 4206 XUVs
C:0 T:10 46515 XUs and 36382 XVs -> 7532 XUVs
C:0 T:11 445 XUs and 359 XVs -> 64 XUVs
32529 XUVs total
11359 collection wire objects
29832 potential space points
Neighbour search...
1741586 tests to find 976040 neighbours
Iterating with no regularization...
Begin: 8.09027e+07
0 7.13642e+07
1 7.0642e+07
2 7.05544e+07
3 7.05321e+07
Now with regularization...
Begin: 5.87991e+07
0 5.87871e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411058653
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411058653
fLifetime: 30000 [us]
12-Dec-2025 14:31:15 UTC Closed output file "reco_stage1.root"
12-Dec-2025 14:31:15 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 250.069 376.575 599.064 349.736 103.11 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00140113 0.00584398 0.00950303 0.00618046 0.0024415 10
reco:ophit:OpHitFinder 0.231698 0.25978 0.286221 0.262085 0.019703 10
reco:opflash:OpFlashFinder 0.138712 0.170539 0.212141 0.16552 0.0238565 10
reco:opslicer:OpSlicer 0.423019 0.536079 0.614608 0.556392 0.0616699 10
reco:caldata:DataPrepModule 4.57922 4.68369 4.82901 4.6996 0.0748334 10
reco:wclsdatasp:WireCellToolkit 43.9358 46.5057 49.6242 46.6618 1.52994 10
reco:gaushit:GausHitFinder 0.761798 1.00563 1.3506 0.957302 0.194722 10
reco:nhitsfilter:NumberOfHitsFilter 0.00168773 0.00314786 0.00444052 0.00319861 0.000765589 10
reco:reco3d:SpacePointSolver 8.75018 21.3085 45.2548 17.8818 11.9893 10
reco:hitpdune:DisambigFromSpacePoints 0.957019 1.57087 2.4811 1.46928 0.48275 10
reco:pandora:StandardPandora 17.194 33.1943 86.356 23.7994 20.0673 10
reco:pandoraWriter:StandardPandora 0.561638 0.750926 0.965001 0.718237 0.120313 10
reco:pandoraTrack:LArPandoraTrackCreation 4.62998 11.3342 25.4472 9.40979 6.37146 10
reco:pandoraShower:LArPandoraShowerCreation 2.50484 8.06926 20.2089 6.49855 5.26336 10
reco:pandoracalo:Calorimetry 1.28855 2.97487 5.55724 2.52831 1.36813 10
reco:pandoracalonosce:Calorimetry 1.10987 2.97531 8.34931 2.25332 2.031 10
reco:pandorapid:Chi2ParticleID 0.00426444 0.00574305 0.00836485 0.00526171 0.00121836 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0363921 0.0455736 0.0540875 0.0437053 0.00632348 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00449583 0.00555089 0.00667826 0.00539127 0.000640679 10
reco:pandoraShowercalo:ShowerCalorimetry 1.98608 5.31154 11.4948 4.55773 2.99335 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.9277 5.07026 10.9053 4.37272 2.8164 10
reco:emtrkmichelid:EmTrackMichelId 128.171 170.147 220.411 165.755 30.5042 10
reco:crttag:SingleCRTMatchingProducer 0.0143437 0.0267172 0.0487019 0.0234038 0.00921572 10
reco:crtreco:TwoCRTMatchingProducer 0.00788336 0.0181161 0.0436138 0.0167031 0.00994949 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.599701 0.743717 0.925697 0.703741 0.110818 10
reco:pandora2Track:LArPandoraTrackCreation 12.7557 28.366 55.2849 25.6765 14.5841 10
reco:pandora2calo:Calorimetry 3.22778 7.22733 14.1831 5.85908 3.66877 10
reco:pandora2calonosce:Calorimetry 2.8576 6.53579 13.158 5.35904 3.11601 10
reco:pandora2pid:Chi2ParticleID 0.0101124 0.0126189 0.0175781 0.0114418 0.00261436 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0521556 0.0638644 0.0846637 0.0588043 0.0113135 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00996178 0.0124954 0.0172633 0.0112595 0.00256597 10
reco:pandora2Shower:LArPandoraShowerCreation 2.42969 5.05888 8.90917 3.98502 2.31061 10
reco:pandora2Showercalo:ShowerCalorimetry 2.56842 5.00965 8.12359 4.47212 1.72454 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.34891 4.38335 7.16197 3.94513 1.45932 10
[art]:TriggerResults:TriggerResultInserter 8.0562e-05 0.000106737 0.000242287 9.45635e-05 4.58844e-05 10
end_path:out1:RootOutput 1.6512e-05 2.1042e-05 2.7332e-05 2.06595e-05 3.07053e-06 10
end_path:out1:RootOutput(write) 2.07723 2.85314 3.94237 2.63918 0.615822 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5324.47 MB
Peak resident set size usage (VmHWM): 4512.25 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.31 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.38 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11250648
-rw-r--r-- 1 dunegli fnalgrid 2607423694 Dec 12 13:26 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2472415583 Dec 12 13:23 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2324280995 Dec 12 14:31 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2061242910 Dec 12 11:49 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1972757913 Dec 12 11:40 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 81913610 Dec 12 14:26 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242644 Dec 12 14:31 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 14:31 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 14:31 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 14:31 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 13:26 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 11:49 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 14:31 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:36 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 14:31 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 13:32 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 13:26 debugprod.log
