Jobsub ID 238692.1@dunegpschedd01.fnal.gov
| Jobsub ID | 238692.1@dunegpschedd01.fnal.gov |
| Workflow ID | 9363 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-10-26 21:35:09 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw7 |
| Last heartbeat | 2025-10-27 02:05:24 |
| From worker node | Hostname | mh-7763-15.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-26 21:48:07 |
| Input files | monte-carlo-009363-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15378s) |
| CPU time | 4h (15087s = 98%) |
| Max RSS bytes | 4407087104 (4202 MiB) |
| Outputting started | 2025-10-27 02:04:26 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09363/1/001/reco_stage1.root
|
| Finished | 2025-10-27 02:05:24 |
| Saved logs | justin-logs:238692.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
valZKe
ToolBasedRawDigitPrepService:prepare: Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 125887 traces, 0 summary
Retagger: tagging trace set: gauss with 95205 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95205 traces tagged "gauss"
FrameSaver: q=3.29783e+06 n=1642956 tag=gauss
wclsFrameSaver: saving 125887 traces tagged "wiener"
FrameSaver: q=3.5004e+06 n=1441924 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 21204 XUs and 26687 XVs -> 498 XUVs
C:0 T:1 64391 XUs and 63391 XVs -> 8806 XUVs
C:0 T:2 141064 XUs and 305023 XVs -> 29108 XUVs
C:0 T:3 47532 XUs and 59918 XVs -> 934 XUVs
C:0 T:4 8271 XUs and 11467 XVs -> 118 XUVs
C:0 T:5 31153 XUs and 31219 XVs -> 3787 XUVs
C:0 T:6 84401 XUs and 168053 XVs -> 18219 XUVs
C:0 T:7 25694 XUs and 39792 XVs -> 547 XUVs
C:0 T:8 9106 XUs and 11442 XVs -> 150 XUVs
C:0 T:9 51681 XUs and 78046 XVs -> 4239 XUVs
C:0 T:10 36026 XUs and 26650 XVs -> 6694 XUVs
73100 XUVs total
11339 collection wire objects
65872 potential space points
Neighbour search...
16191250 tests to find 6675334 neighbours
Iterating with no regularization...
Begin: 8.87565e+07
0 6.91649e+07
1 6.82908e+07
2 6.81363e+07
3 6.8081e+07
Now with regularization...
Begin: 5.72664e+07
0 5.72069e+07
1 5.71519e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410134480
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410134480
fLifetime: 30000 [us]
26-Oct-2025 19:04:24 PDT Closed output file "reco_stage1.root"
26-Oct-2025 19:04:24 PDT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 336.984 444.065 520.232 475.88 62.9653 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00116234 0.0044695 0.00996848 0.00450598 0.00237719 10
reco:ophit:OpHitFinder 0.291186 0.347013 0.439016 0.341532 0.0378479 10
reco:opflash:OpFlashFinder 0.182681 0.258395 0.325047 0.253804 0.0404639 10
reco:opslicer:OpSlicer 0.639381 0.75226 0.981558 0.736589 0.0985592 10
reco:caldata:DataPrepModule 4.70483 5.41603 7.56027 5.01689 0.869878 10
reco:wclsdatasp:WireCellToolkit 32.5204 36.2812 42.1107 36.2764 2.63085 10
reco:gaushit:GausHitFinder 0.907757 1.78724 2.38902 1.88462 0.416046 10
reco:nhitsfilter:NumberOfHitsFilter 0.000435924 0.000755138 0.000945658 0.00079619 0.00016549 10
reco:reco3d:SpacePointSolver 15.3601 22.7835 30.033 22.6603 4.42279 10
reco:hitpdune:DisambigFromSpacePoints 1.61329 2.25639 3.18605 2.13469 0.504227 10
reco:pandora:StandardPandora 23.4626 51.4429 79.6938 52.5333 16.7306 10
reco:pandoraWriter:StandardPandora 0.344874 0.62436 0.795305 0.704902 0.157601 10
reco:pandoraTrack:LArPandoraTrackCreation 3.11227 5.93829 8.50205 6.11184 1.75861 10
reco:pandoraShower:LArPandoraShowerCreation 3.79619 6.56057 9.01784 7.03767 1.81199 10
reco:pandoracalo:Calorimetry 1.66087 3.0153 5.1472 3.01287 0.939142 10
reco:pandoracalonosce:Calorimetry 1.48902 3.00924 3.94491 3.27017 0.820946 10
reco:pandorapid:Chi2ParticleID 0.00427044 0.00708365 0.010264 0.00665968 0.00178033 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0406543 0.069167 0.103226 0.0690226 0.0208756 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00382645 0.00678457 0.0101773 0.00622226 0.00204146 10
reco:pandoraShowercalo:ShowerCalorimetry 3.28941 7.76525 11.3662 7.86194 2.47804 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.99667 7.65329 11.4404 8.54884 2.19964 10
reco:emtrkmichelid:EmTrackMichelId 180.128 224.861 259.495 230.805 22.9581 10
reco:crttag:SingleCRTMatchingProducer 0.0147095 0.0178304 0.0225309 0.0174552 0.00263807 10
reco:crtreco:TwoCRTMatchingProducer 0.00740876 0.0104274 0.0134457 0.0105609 0.00178921 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.887351 1.10701 1.34664 1.09429 0.145405 10
reco:pandora2Track:LArPandoraTrackCreation 9.0257 19.5824 26.583 22.2644 5.80436 10
reco:pandora2calo:Calorimetry 6.59327 9.54994 13.1307 9.84668 2.15992 10
reco:pandora2calonosce:Calorimetry 5.05846 8.99767 11.7322 9.32162 2.12552 10
reco:pandora2pid:Chi2ParticleID 0.010352 0.0179868 0.0303769 0.0153568 0.0061263 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.051687 0.0844388 0.126934 0.0740309 0.023496 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0104647 0.0177295 0.0292441 0.0151832 0.00586624 10
reco:pandora2Shower:LArPandoraShowerCreation 3.21219 5.76889 7.99229 5.76604 1.45679 10
reco:pandora2Showercalo:ShowerCalorimetry 4.4959 7.65551 9.98396 8.34676 1.65788 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.92017 6.76985 9.98022 6.6787 1.79512 10
[art]:TriggerResults:TriggerResultInserter 5.2169e-05 7.5542e-05 0.000147548 6.8659e-05 2.73449e-05 10
end_path:out1:RootOutput 1.116e-05 1.40518e-05 2.116e-05 1.3545e-05 2.75129e-06 10
end_path:out1:RootOutput(write) 2.50951 3.49408 4.7109 3.20576 0.674074 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5281.51 MB
Peak resident set size usage (VmHWM): 4407.09 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.43 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11579500
-rw-r--r-- 1 cuser cuser 2673040614 Oct 26 17:48 detsim_stage2.root
-rw-r--r-- 1 cuser cuser 2528164659 Oct 26 17:45 detsim_stage1.root
-rw-r--r-- 1 cuser cuser 2419816683 Oct 26 19:04 reco_stage1.root
-rw-r--r-- 1 cuser cuser 2121527082 Oct 26 15:12 g4_stage2.root
-rw-r--r-- 1 cuser cuser 2024720742 Oct 26 14:57 g4_stage1.root
-rw-r--r-- 1 cuser cuser 89527590 Oct 26 19:00 Pandora_Events.pndr
-rw-r--r-- 1 cuser cuser 243211 Oct 26 19:04 jobscript.log
-rw-r--r-- 1 cuser cuser 217088 Oct 26 19:04 mem.db
-rw-r--r-- 1 cuser cuser 62376 Oct 26 19:04 Pandora_Geometry.xml
-rw-r--r-- 1 cuser cuser 36864 Oct 26 19:04 time.db
-rw-r--r-- 1 cuser cuser 519 Oct 26 17:48 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 cuser cuser 519 Oct 26 15:12 g4_protoDUNE_hist.root
-rw-r--r-- 1 cuser cuser 519 Oct 26 19:04 protoDUNE_reco1_hist.root
-rw-r--r-- 1 cuser cuser 52 Oct 26 14:48 all-input-dids.txt
-rw-r--r-- 1 cuser cuser 7 Oct 26 19:04 justin-processed-pfns.txt
-rw-r--r-- 1 cuser cuser 0 Oct 26 17:54 ProtoDUNE.log
-rw-r--r-- 1 cuser cuser 0 Oct 26 17:48 debugprod.log
