Jobsub ID 302212.1@dunegpschedd01.fnal.gov
| Jobsub ID | 302212.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12546 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-30 07:26:55 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-30 09:15:55 |
| From worker node | Hostname | dunegli-8327830-0-fnpc23024.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-30 07:27:15 |
| Input files | monte-carlo-012546-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6508s) |
| CPU time | 1h (6446s = 99%) |
| Max RSS bytes | 3967082496 (3783 MiB) |
| Outputting started | 2026-01-30 09:15:43 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12546/1/001/reco_stage1.root
|
| Finished | 2026-01-30 09:15:55 |
| Saved logs | justin-logs:302212.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 122364 traces, 0 summary
Retagger: tagging trace set: gauss with 92619 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 92619 traces tagged "gauss"
FrameSaver: q=3.17443e+06 n=1616183 tag=gauss
wclsFrameSaver: saving 122364 traces tagged "wiener"
FrameSaver: q=3.35496e+06 n=1421909 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 27962 XUs and 25193 XVs -> 438 XUVs
C:0 T:1 67600 XUs and 57963 XVs -> 8006 XUVs
C:0 T:2 49794 XUs and 82088 XVs -> 2481 XUVs
C:0 T:3 27018 XUs and 37004 XVs -> 76 XUVs
C:0 T:4 11815 XUs and 12055 XVs -> 219 XUVs
C:0 T:5 58005 XUs and 50665 XVs -> 8958 XUVs
C:0 T:6 57487 XUs and 68349 XVs -> 2162 XUVs
C:0 T:7 24792 XUs and 27741 XVs -> 181 XUVs
C:0 T:8 9366 XUs and 9388 XVs -> 84 XUVs
C:0 T:9 62420 XUs and 102707 XVs -> 5892 XUVs
C:0 T:10 52783 XUs and 26419 XVs -> 6371 XUVs
C:0 T:11 683 XUs and 892 XVs -> 140 XUVs
35008 XUVs total
10742 collection wire objects
32947 potential space points
Neighbour search...
4523573 tests to find 2062646 neighbours
Iterating with no regularization...
Begin: 7.00544e+07
0 6.06098e+07
1 5.99739e+07
2 5.98926e+07
3 5.987e+07
Now with regularization...
Begin: 5.10639e+07
0 5.10349e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 412053806
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412053806
fLifetime: 30000 [us]
30-Jan-2026 09:15:42 UTC Closed output file "reco_stage1.root"
30-Jan-2026 09:15:42 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 117.82 178.275 217.416 181.319 28.3453 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000641154 0.00271088 0.00378449 0.00323862 0.00104979 10
reco:ophit:OpHitFinder 0.165231 0.190167 0.214435 0.187489 0.0143836 10
reco:opflash:OpFlashFinder 0.085907 0.110451 0.138608 0.106162 0.0176106 10
reco:opslicer:OpSlicer 0.342003 0.405753 0.49553 0.38989 0.0560538 10
reco:caldata:DataPrepModule 3.38062 3.55559 3.76325 3.5708 0.0974384 10
reco:wclsdatasp:WireCellToolkit 23.3004 24.0427 25.0817 23.926 0.508859 10
reco:gaushit:GausHitFinder 0.45415 0.647386 0.784609 0.651834 0.0923888 10
reco:nhitsfilter:NumberOfHitsFilter 0.000234408 0.000360382 0.000478092 0.000367733 6.62489e-05 10
reco:reco3d:SpacePointSolver 3.2299 7.91842 10.3564 8.39228 2.07339 10
reco:hitpdune:DisambigFromSpacePoints 0.384342 0.799606 1.08245 0.813817 0.211146 10
reco:pandora:StandardPandora 7.30294 14.1871 23.1837 13.6302 3.97807 10
reco:pandoraWriter:StandardPandora 0.14312 0.234915 0.29252 0.240579 0.0385004 10
reco:pandoraTrack:LArPandoraTrackCreation 0.813059 1.69769 2.71118 1.66125 0.513624 10
reco:pandoraShower:LArPandoraShowerCreation 0.874209 1.83038 2.73313 1.85362 0.538719 10
reco:pandoracalo:Calorimetry 0.502103 1.01412 1.58093 0.975547 0.293989 10
reco:pandoracalonosce:Calorimetry 0.441638 0.925395 1.47178 0.901338 0.27729 10
reco:pandorapid:Chi2ParticleID 0.00242167 0.00321473 0.00419572 0.00317799 0.000541676 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0196511 0.0288752 0.0339379 0.0297873 0.00391827 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00235039 0.0030447 0.0037126 0.00306169 0.000407501 10
reco:pandoraShowercalo:ShowerCalorimetry 0.91127 1.93918 2.89895 2.00103 0.622447 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.877125 1.89 2.96227 1.93745 0.633113 10
reco:emtrkmichelid:EmTrackMichelId 64.6185 96.9086 118.343 99.0513 14.4829 10
reco:crttag:SingleCRTMatchingProducer 0.00604177 0.00978624 0.0141403 0.01054 0.00287904 10
reco:crtreco:TwoCRTMatchingProducer 0.00331756 0.00473418 0.00613895 0.00488232 0.000814073 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.361894 0.519009 0.714911 0.513155 0.0921968 10
reco:pandora2Track:LArPandoraTrackCreation 2.52967 5.35122 7.83712 5.22952 1.58834 10
reco:pandora2calo:Calorimetry 1.34423 2.82887 4.10878 2.83447 0.875335 10
reco:pandora2calonosce:Calorimetry 1.25966 2.66975 3.92331 2.68459 0.834285 10
reco:pandora2pid:Chi2ParticleID 0.0056675 0.00700604 0.0087807 0.00656581 0.00101206 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0240894 0.0356157 0.0447352 0.0360943 0.00569298 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00527827 0.00688765 0.00870205 0.00669375 0.00099942 10
reco:pandora2Shower:LArPandoraShowerCreation 0.987232 2.03477 2.93406 2.03008 0.57456 10
reco:pandora2Showercalo:ShowerCalorimetry 1.17029 2.46013 3.61748 2.53116 0.766228 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.08306 2.26579 3.28079 2.33872 0.696163 10
[art]:TriggerResults:TriggerResultInserter 3.112e-05 4.30322e-05 0.000106463 3.7056e-05 2.14895e-05 10
end_path:out1:RootOutput 5.25e-06 9.9081e-06 1.548e-05 9.874e-06 2.41341e-06 10
end_path:out1:RootOutput(write) 1.08529 1.67254 2.14008 1.64577 0.283998 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4787.76 MB
Peak resident set size usage (VmHWM): 3967.08 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9226896
-rw-r--r-- 1 dunegli fnalgrid 2194229908 Jan 30 08:44 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2086731892 Jan 30 08:43 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1839266218 Jan 30 09:15 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1667998031 Jan 30 07:36 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1594987812 Jan 30 07:30 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 64430320 Jan 30 09:13 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242939 Jan 30 09:15 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 30 09:15 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 30 09:15 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 30 09:15 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 30 08:44 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 30 07:36 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 30 09:15 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 30 07:27 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 30 09:15 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 30 08:47 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 30 08:44 debugprod.log
