Jobsub ID 271180.1@dunegpschedd01.fnal.gov
| Jobsub ID | 271180.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11460 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-01 07:48:57 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-01 14:13:29 |
| From worker node | Hostname | dunegli-8210107-0-fnpc18008.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-01 08:13:52 |
| Input files | monte-carlo-011460-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (21523s) |
| CPU time | 5h (20069s = 93%) |
| Max RSS bytes | 4228825088 (4032 MiB) |
| Outputting started | 2026-01-01 14:12:36 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11460/1/001/reco_stage1.root
|
| Finished | 2026-01-01 14:13:29 |
| Saved logs | justin-logs:271180.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
dsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 146823 traces, 0 summary
Retagger: tagging trace set: gauss with 112768 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 112768 traces tagged "gauss"
FrameSaver: q=3.91218e+06 n=2057976 tag=gauss
wclsFrameSaver: saving 146823 traces tagged "wiener"
FrameSaver: q=4.15863e+06 n=1843420 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 34214 XUs and 43929 XVs -> 325 XUVs
C:0 T:1 75678 XUs and 87172 XVs -> 10710 XUVs
C:0 T:2 58375 XUs and 77860 XVs -> 5205 XUVs
C:0 T:3 26454 XUs and 32625 XVs -> 87 XUVs
C:0 T:4 18135 XUs and 24067 XVs -> 329 XUVs
C:0 T:5 98718 XUs and 113067 XVs -> 10028 XUVs
C:0 T:6 89662 XUs and 87277 XVs -> 2907 XUVs
C:0 T:7 38603 XUs and 34087 XVs -> 304 XUVs
C:0 T:8 10073 XUs and 9882 XVs -> 135 XUVs
C:0 T:9 68502 XUs and 94097 XVs -> 5919 XUVs
C:0 T:10 111297 XUs and 35811 XVs -> 7502 XUVs
C:0 T:11 228 XUs and 142 XVs -> 22 XUVs
43473 XUVs total
14412 collection wire objects
40714 potential space points
Neighbour search...
3438992 tests to find 1767174 neighbours
Iterating with no regularization...
Begin: 7.71374e+07
0 5.95464e+07
1 5.84983e+07
2 5.83274e+07
3 5.82708e+07
Now with regularization...
Begin: 4.73004e+07
0 4.72304e+07
1 4.71953e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411470669
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411470669
fLifetime: 30000 [us]
01-Jan-2026 14:12:29 UTC Closed output file "reco_stage1.root"
01-Jan-2026 14:12:29 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 342.917 670.058 798.97 731.579 134.324 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00198415 0.00524723 0.00809542 0.00544131 0.00216048 10
reco:ophit:OpHitFinder 0.318462 0.430414 0.612792 0.383515 0.101287 10
reco:opflash:OpFlashFinder 0.210569 0.267578 0.388707 0.252153 0.0523847 10
reco:opslicer:OpSlicer 0.852904 1.15073 1.90406 1.07501 0.295357 10
reco:caldata:DataPrepModule 7.12836 8.37763 9.9402 8.12385 0.906646 10
reco:wclsdatasp:WireCellToolkit 44.3463 51.5686 65.8902 49.4295 6.27929 10
reco:gaushit:GausHitFinder 1.20592 2.03363 2.63931 2.02533 0.384752 10
reco:nhitsfilter:NumberOfHitsFilter 0.000423454 0.000844938 0.00124494 0.000803325 0.000239362 10
reco:reco3d:SpacePointSolver 10.6901 22.3954 31.8102 22.5256 6.61011 10
reco:hitpdune:DisambigFromSpacePoints 1.489 3.22872 4.51931 3.38954 0.905635 10
reco:pandora:StandardPandora 29.0351 81.5896 156.687 80.3305 32.2798 10
reco:pandoraWriter:StandardPandora 0.410079 1.18675 3.2034 0.819166 0.79397 10
reco:pandoraTrack:LArPandoraTrackCreation 3.58374 9.60577 12.6382 9.91869 2.79205 10
reco:pandoraShower:LArPandoraShowerCreation 4.00138 12.2486 20.1206 12.7226 4.24459 10
reco:pandoracalo:Calorimetry 1.78092 5.46474 7.3445 5.68855 1.49366 10
reco:pandoracalonosce:Calorimetry 1.55498 5.1236 6.54597 5.51789 1.37404 10
reco:pandorapid:Chi2ParticleID 0.00602285 0.012398 0.0151123 0.0129852 0.00257834 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.048744 0.101747 0.135894 0.106552 0.0254887 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00611944 0.0116154 0.0156934 0.0118553 0.00245814 10
reco:pandoraShowercalo:ShowerCalorimetry 3.27353 13.3808 18.6512 14.5019 4.1843 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.68359 12.6235 21.1962 14.2629 4.85027 10
reco:emtrkmichelid:EmTrackMichelId 192.233 328.335 386.694 351.965 54.8692 10
reco:crttag:SingleCRTMatchingProducer 0.0170933 0.0262712 0.038314 0.025963 0.00636382 10
reco:crtreco:TwoCRTMatchingProducer 0.0125073 0.0212027 0.0338457 0.0200901 0.006013 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.03278 1.55373 1.9343 1.61455 0.241873 10
reco:pandora2Track:LArPandoraTrackCreation 10.9633 31.8292 40.291 35.9626 9.3026 10
reco:pandora2calo:Calorimetry 4.76949 16.8776 22.1246 18.956 5.12602 10
reco:pandora2calonosce:Calorimetry 4.65898 16.2607 20.3927 18.6595 5.04449 10
reco:pandora2pid:Chi2ParticleID 0.0157234 0.0325138 0.0449048 0.0318387 0.00844798 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.085685 0.136805 0.179116 0.142081 0.0327697 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0175111 0.0332991 0.0422802 0.0353386 0.00767399 10
reco:pandora2Shower:LArPandoraShowerCreation 4.40784 11.6685 15.552 12.6728 3.26957 10
reco:pandora2Showercalo:ShowerCalorimetry 4.18413 14.4458 20.3122 16.2736 4.86037 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.04724 12.2591 16.1057 13.9691 3.82306 10
[art]:TriggerResults:TriggerResultInserter 8.3531e-05 0.000125939 0.000240258 0.000106265 4.77646e-05 10
end_path:out1:RootOutput 1.2781e-05 1.5973e-05 2.3886e-05 1.4038e-05 4.10451e-06 10
end_path:out1:RootOutput(write) 3.48388 5.57628 8.35439 5.42748 1.43061 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5045.84 MB
Peak resident set size usage (VmHWM): 4228.83 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.31 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.96 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10385192
-rw-r--r-- 1 dunegli fnalgrid 2438041803 Jan 1 12:13 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2312800721 Jan 1 11:55 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2156508334 Jan 1 14:12 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1860110287 Jan 1 08:50 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1783373982 Jan 1 08:24 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 82965320 Jan 1 14:03 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243057 Jan 1 14:12 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 1 14:12 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 1 14:12 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 1 14:12 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 12:13 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 08:50 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 14:12 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 1 08:13 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 1 14:12 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 12:24 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 12:13 debugprod.log
