Jobsub ID 276085.1@dunegpschedd02.fnal.gov
| Jobsub ID | 276085.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12091 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-19 08:26:46 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2026-01-19 12:58:17 |
| From worker node | Hostname | mh-7763-14.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-19 08:27:50 |
| Input files | monte-carlo-012091-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (16170s) |
| CPU time | 4h (15882s = 98%) |
| Max RSS bytes | 4289478656 (4090 MiB) |
| Outputting started | 2026-01-19 12:57:20 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12091/1/001/reco_stage1.root
|
| Finished | 2026-01-19 12:58:17 |
| Saved logs | justin-logs:276085.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
re: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 113560 traces, 0 summary
Retagger: tagging trace set: gauss with 86933 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 86933 traces tagged "gauss"
FrameSaver: q=3.13583e+06 n=1550367 tag=gauss
wclsFrameSaver: saving 113560 traces tagged "wiener"
FrameSaver: q=3.32855e+06 n=1389614 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 13106 XUs and 18996 XVs -> 222 XUVs
C:0 T:1 24911 XUs and 34581 XVs -> 3279 XUVs
C:0 T:2 63971 XUs and 88321 XVs -> 3728 XUVs
C:0 T:3 34042 XUs and 41345 XVs -> 429 XUVs
C:0 T:4 6145 XUs and 4861 XVs -> 19 XUVs
C:0 T:5 16421 XUs and 10232 XVs -> 1293 XUVs
C:0 T:6 142271 XUs and 203950 XVs -> 10804 XUVs
C:0 T:7 54748 XUs and 70697 XVs -> 687 XUVs
C:0 T:8 7088 XUs and 9323 XVs -> 130 XUVs
C:0 T:9 47307 XUs and 91603 XVs -> 7864 XUVs
C:0 T:10 31880 XUs and 24010 XVs -> 3051 XUVs
C:0 T:11 349 XUs and 348 XVs -> 47 XUVs
31553 XUVs total
9219 collection wire objects
28920 potential space points
Neighbour search...
2247442 tests to find 1179256 neighbours
Iterating with no regularization...
Begin: 6.76501e+07
0 5.87685e+07
1 5.79822e+07
2 5.78683e+07
3 5.78336e+07
Now with regularization...
Begin: 4.83191e+07
0 4.82912e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411833361
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411833361
fLifetime: 30000 [us]
19-Jan-2026 04:57:18 PST Closed output file "reco_stage1.root"
19-Jan-2026 04:57:18 PST Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 337.257 454.794 583.441 449.691 79.3873 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00128988 0.00398749 0.00581974 0.00444377 0.00160889 10
reco:ophit:OpHitFinder 0.360759 0.417728 0.46818 0.412661 0.0330758 10
reco:opflash:OpFlashFinder 0.179967 0.238404 0.303712 0.238254 0.0414883 10
reco:opslicer:OpSlicer 0.611034 0.888569 1.19397 0.904457 0.165868 10
reco:caldata:DataPrepModule 5.88845 7.22906 8.43521 7.51565 0.803889 10
reco:wclsdatasp:WireCellToolkit 38.9498 41.2301 45.0645 41.1098 1.83371 10
reco:gaushit:GausHitFinder 1.33521 1.80594 2.20307 1.88279 0.274217 10
reco:nhitsfilter:NumberOfHitsFilter 0.000367116 0.000724421 0.000979298 0.000692873 0.000165868 10
reco:reco3d:SpacePointSolver 11.2539 31.0431 81.7901 24.9675 18.3013 10
reco:hitpdune:DisambigFromSpacePoints 1.24065 2.47001 3.16046 2.79165 0.668431 10
reco:pandora:StandardPandora 27.458 47.0914 67.023 42.1348 14.0173 10
reco:pandoraWriter:StandardPandora 0.395715 0.590757 0.719992 0.587962 0.0960984 10
reco:pandoraTrack:LArPandoraTrackCreation 3.31948 5.04869 7.13886 4.6988 1.1074 10
reco:pandoraShower:LArPandoraShowerCreation 3.26897 5.36678 7.72868 4.91559 1.33207 10
reco:pandoracalo:Calorimetry 1.59339 2.86609 3.7418 2.79519 0.668738 10
reco:pandoracalonosce:Calorimetry 1.26455 2.72127 3.54819 2.86304 0.696383 10
reco:pandorapid:Chi2ParticleID 0.00400078 0.00814586 0.0116593 0.00857222 0.00209653 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.041487 0.0780966 0.0986715 0.0860878 0.0191283 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00377821 0.00782127 0.0102054 0.00828886 0.00188814 10
reco:pandoraShowercalo:ShowerCalorimetry 3.0989 5.74551 7.61293 5.47061 1.42241 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.67716 5.75197 7.43352 5.72843 1.33152 10
reco:emtrkmichelid:EmTrackMichelId 189.943 235.686 288.399 232.874 34.5226 10
reco:crttag:SingleCRTMatchingProducer 0.0100596 0.0178729 0.0275973 0.0172875 0.00566373 10
reco:crtreco:TwoCRTMatchingProducer 0.00616519 0.0104888 0.0144892 0.0111169 0.00241167 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.669133 1.0669 1.38218 1.08021 0.20598 10
reco:pandora2Track:LArPandoraTrackCreation 8.94921 16.8565 25.244 18.0856 4.8101 10
reco:pandora2calo:Calorimetry 5.54758 8.64926 11.7485 8.97474 2.06281 10
reco:pandora2calonosce:Calorimetry 4.53662 8.22343 12.187 8.94505 2.40415 10
reco:pandora2pid:Chi2ParticleID 0.0114813 0.0197247 0.024655 0.0212244 0.0046369 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0516068 0.0960836 0.125155 0.100686 0.0231975 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0105961 0.0183765 0.0245691 0.0191307 0.00529411 10
reco:pandora2Shower:LArPandoraShowerCreation 3.88702 5.738 8.00882 5.31394 1.37028 10
reco:pandora2Showercalo:ShowerCalorimetry 4.99766 7.33775 10.5798 7.39486 1.80096 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.97458 6.76847 8.94282 7.61252 1.65174 10
[art]:TriggerResults:TriggerResultInserter 4.9729e-05 7.6572e-05 0.000149169 7.0924e-05 2.55336e-05 10
end_path:out1:RootOutput 1.227e-05 1.497e-05 1.84e-05 1.523e-05 2.02707e-06 10
end_path:out1:RootOutput(write) 2.37568 3.57882 4.48967 3.87002 0.761745 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5129.57 MB
Peak resident set size usage (VmHWM): 4289.48 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.34 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.59 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10621104
-rw-r--r--. 1 cuser cuser 2475981664 Jan 19 03:38 detsim_stage2.root
-rw-r--r--. 1 cuser cuser 2346912583 Jan 19 03:35 detsim_stage1.root
-rw-r--r--. 1 cuser cuser 2187434533 Jan 19 04:57 reco_stage1.root
-rw-r--r--. 1 cuser cuser 1931344310 Jan 19 00:54 g4_stage2.root
-rw-r--r--. 1 cuser cuser 1852759369 Jan 19 00:37 g4_stage1.root
-rw-r--r--. 1 cuser cuser 80955620 Jan 19 04:53 Pandora_Events.pndr
-rw-r--r--. 1 cuser cuser 243075 Jan 19 04:57 jobscript.log
-rw-r--r--. 1 cuser cuser 217088 Jan 19 04:57 mem.db
-rw-r--r--. 1 cuser cuser 62376 Jan 19 04:57 Pandora_Geometry.xml
-rw-r--r--. 1 cuser cuser 36864 Jan 19 04:57 time.db
-rw-r--r--. 1 cuser cuser 519 Jan 19 03:38 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 cuser cuser 519 Jan 19 00:54 g4_protoDUNE_hist.root
-rw-r--r--. 1 cuser cuser 519 Jan 19 04:57 protoDUNE_reco1_hist.root
-rw-r--r--. 1 cuser cuser 52 Jan 19 00:27 all-input-dids.txt
-rw-r--r--. 1 cuser cuser 7 Jan 19 04:57 justin-processed-pfns.txt
-rw-r--r--. 1 cuser cuser 0 Jan 19 03:47 ProtoDUNE.log
-rw-r--r--. 1 cuser cuser 0 Jan 19 03:38 debugprod.log
