Jobsub ID 271216.0@dunegpschedd01.fnal.gov
| Jobsub ID | 271216.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11465 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-01 16:11:23 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2026-01-01 19:14:54 |
| From worker node | Hostname | dunegli-49724-0-cmswn2357.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-01 16:26:03 |
| Input files | monte-carlo-011465-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (10117s) |
| CPU time | 2h (10001s = 98%) |
| Max RSS bytes | 3939418112 (3756 MiB) |
| Outputting started | 2026-01-01 19:14:41 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11465/1/001/reco_stage1.root
|
| Finished | 2026-01-01 19:14:54 |
| Saved logs | justin-logs:271216.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 109442 traces, 0 summary
Retagger: tagging trace set: gauss with 82393 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 82393 traces tagged "gauss"
FrameSaver: q=2.95375e+06 n=1469210 tag=gauss
wclsFrameSaver: saving 109442 traces tagged "wiener"
FrameSaver: q=3.14442e+06 n=1304523 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 19211 XUs and 16384 XVs -> 162 XUVs
C:0 T:1 25523 XUs and 27972 XVs -> 3094 XUVs
C:0 T:2 52668 XUs and 71650 XVs -> 3626 XUVs
C:0 T:3 27733 XUs and 34331 XVs -> 207 XUVs
C:0 T:4 11633 XUs and 13935 XVs -> 124 XUVs
C:0 T:5 42964 XUs and 46469 XVs -> 7151 XUVs
C:0 T:6 103105 XUs and 178044 XVs -> 9411 XUVs
C:0 T:7 38449 XUs and 55179 XVs -> 485 XUVs
C:0 T:8 7204 XUs and 8037 XVs -> 114 XUVs
C:0 T:9 58870 XUs and 93216 XVs -> 11371 XUVs
C:0 T:10 25294 XUs and 63917 XVs -> 6561 XUVs
C:0 T:11 86 XUs and 44 XVs -> 14 XUVs
42320 XUVs total
9686 collection wire objects
39702 potential space points
Neighbour search...
6362588 tests to find 2842760 neighbours
Iterating with no regularization...
Begin: 5.86952e+07
0 4.76766e+07
1 4.69454e+07
2 4.68131e+07
3 4.67699e+07
Now with regularization...
Begin: 3.79647e+07
0 3.79171e+07
1 3.78852e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411477757
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411477757
fLifetime: 30000 [us]
01-Jan-2026 19:14:40 UTC Closed output file "reco_stage1.root"
01-Jan-2026 19:14:40 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 247.036 311.976 396.553 299.997 50.3028 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000883663 0.00272593 0.00444575 0.00286655 0.00100429 10
reco:ophit:OpHitFinder 0.203248 0.230255 0.266733 0.230175 0.0193875 10
reco:opflash:OpFlashFinder 0.121972 0.139103 0.169236 0.133052 0.0155837 10
reco:opslicer:OpSlicer 0.503482 0.570339 0.699703 0.546378 0.0650177 10
reco:caldata:DataPrepModule 5.16202 5.40778 5.87793 5.26982 0.267487 10
reco:wclsdatasp:WireCellToolkit 43.8315 50.702 59.9317 51.169 5.40705 10
reco:gaushit:GausHitFinder 0.985839 1.22445 1.50069 1.20914 0.187725 10
reco:nhitsfilter:NumberOfHitsFilter 0.000242992 0.000370905 0.000536314 0.000378971 8.97724e-05 10
reco:reco3d:SpacePointSolver 6.54843 12.5852 22.0356 12.3955 5.47453 10
reco:hitpdune:DisambigFromSpacePoints 1.20179 1.83652 2.6827 1.83647 0.43622 10
reco:pandora:StandardPandora 16.3956 29.081 49.0932 26.7919 11.0399 10
reco:pandoraWriter:StandardPandora 0.276103 0.3584 0.496629 0.344176 0.0655618 10
reco:pandoraTrack:LArPandoraTrackCreation 2.26248 3.38657 5.16096 3.15073 0.981074 10
reco:pandoraShower:LArPandoraShowerCreation 1.88926 3.22677 4.76401 3.11099 1.06063 10
reco:pandoracalo:Calorimetry 1.22438 1.85718 2.72947 1.71399 0.500102 10
reco:pandoracalonosce:Calorimetry 1.06884 1.67014 2.69371 1.5651 0.504502 10
reco:pandorapid:Chi2ParticleID 0.0045699 0.0053132 0.00641161 0.00509918 0.000665158 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0507667 0.0611637 0.0801386 0.0577501 0.0087044 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00437269 0.00495708 0.0061915 0.00467272 0.000564036 10
reco:pandoraShowercalo:ShowerCalorimetry 1.81678 3.46574 5.6028 3.32836 1.32224 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.76894 3.38492 5.52962 3.23007 1.28744 10
reco:emtrkmichelid:EmTrackMichelId 127.579 155.867 192.624 151.889 21.1761 10
reco:crttag:SingleCRTMatchingProducer 0.0124806 0.0161097 0.0220524 0.0155542 0.00320082 10
reco:crtreco:TwoCRTMatchingProducer 0.00742622 0.00996856 0.0133388 0.00967191 0.00175052 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.25944 1.62712 1.93508 1.66213 0.227567 10
reco:pandora2Track:LArPandoraTrackCreation 6.56499 10.544 14.183 10.6933 3.00951 10
reco:pandora2calo:Calorimetry 2.95977 5.06639 7.02619 5.32719 1.53154 10
reco:pandora2calonosce:Calorimetry 2.77845 4.73598 6.69096 4.66815 1.49288 10
reco:pandora2pid:Chi2ParticleID 0.0105815 0.0128904 0.0156621 0.0122624 0.0017704 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0610583 0.075401 0.0947139 0.0716683 0.010457 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0101047 0.0125584 0.0153256 0.0119349 0.00171543 10
reco:pandora2Shower:LArPandoraShowerCreation 2.37601 3.80971 5.15095 3.77695 1.10236 10
reco:pandora2Showercalo:ShowerCalorimetry 2.59383 4.44491 6.3683 4.49464 1.39876 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.39106 4.24079 5.99413 4.34259 1.36032 10
[art]:TriggerResults:TriggerResultInserter 3.6266e-05 5.17141e-05 0.000122699 4.3581e-05 2.42884e-05 10
end_path:out1:RootOutput 5.829e-06 9.9449e-06 1.5322e-05 9.681e-06 2.2642e-06 10
end_path:out1:RootOutput(write) 1.80526 2.24478 2.78039 2.22616 0.326541 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4754.67 MB
Peak resident set size usage (VmHWM): 3939.42 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.46 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9016176
-rw-r--r-- 1 dunegli fnalgrid 2164285028 Jan 1 18:20 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2056049867 Jan 1 18:18 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1812759900 Jan 1 19:14 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1605375396 Jan 1 16:41 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1528228369 Jan 1 16:31 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 65249930 Jan 1 19:11 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242822 Jan 1 19:14 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 1 19:14 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 1 19:14 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 1 19:14 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 18:20 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 16:41 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 19:14 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 1 16:26 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 1 19:14 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 18:26 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 18:20 debugprod.log
