Jobsub ID 243310.1@dunegpschedd01.fnal.gov
| Jobsub ID | 243310.1@dunegpschedd01.fnal.gov |
| Workflow ID | 9607 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-05 04:30:56 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce15-multicore |
| Last heartbeat | 2025-11-05 08:43:22 |
| From worker node | Hostname | hnode51.pic.es |
| cpuinfo | AMD EPYC 7402P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-05 04:32:37 |
| Input files | monte-carlo-009607-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (14971s) |
| CPU time | 4h (14404s = 96%) |
| Max RSS bytes | 4564729856 (4353 MiB) |
| Outputting started | 2025-11-05 08:42:09 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09607/1/001/reco_stage1.root
|
| Finished | 2025-11-05 08:43:22 |
| Saved logs | justin-logs:243310.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
dcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 150417 traces, 0 summary
Retagger: tagging trace set: gauss with 115185 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 115185 traces tagged "gauss"
FrameSaver: q=3.99517e+06 n=2088224 tag=gauss
wclsFrameSaver: saving 150417 traces tagged "wiener"
FrameSaver: q=4.23592e+06 n=1870281 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 39069 XUs and 26287 XVs -> 278 XUVs
C:0 T:1 53514 XUs and 43062 XVs -> 3005 XUVs
C:0 T:2 61693 XUs and 107327 XVs -> 3543 XUVs
C:0 T:3 28353 XUs and 39952 XVs -> 234 XUVs
C:0 T:4 8368 XUs and 9200 XVs -> 71 XUVs
C:0 T:5 39057 XUs and 46653 XVs -> 7835 XUVs
C:0 T:6 120935 XUs and 143152 XVs -> 14319 XUVs
C:0 T:7 46073 XUs and 51141 XVs -> 1255 XUVs
C:0 T:8 9235 XUs and 12049 XVs -> 179 XUVs
C:0 T:9 73186 XUs and 116564 XVs -> 7692 XUVs
C:0 T:10 122949 XUs and 102631 XVs -> 8484 XUVs
C:0 T:11 974 XUs and 813 XVs -> 83 XUVs
46978 XUVs total
14639 collection wire objects
40896 potential space points
Neighbour search...
3760730 tests to find 1916508 neighbours
Iterating with no regularization...
Begin: 7.22077e+07
0 5.90041e+07
1 5.80601e+07
2 5.79251e+07
3 5.78865e+07
Now with regularization...
Begin: 4.73014e+07
0 4.72512e+07
1 4.72203e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410321223
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410321223
fLifetime: 30000 [us]
05-Nov-2025 09:42:07 CET Closed output file "reco_stage1.root"
05-Nov-2025 09:42:07 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 235.62 505.176 701.645 478.115 132.701 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00113933 0.00355297 0.00523296 0.00405954 0.00141606 10
reco:ophit:OpHitFinder 0.213288 0.333343 0.408127 0.360862 0.0621296 10
reco:opflash:OpFlashFinder 0.131407 0.223514 0.275889 0.22888 0.038997 10
reco:opslicer:OpSlicer 0.426638 0.956998 1.37485 0.9485 0.286089 10
reco:caldata:DataPrepModule 4.1776 5.49906 7.01559 5.4762 0.865903 10
reco:wclsdatasp:WireCellToolkit 31.6538 38.2491 42.5861 39.0214 3.63238 10
reco:gaushit:GausHitFinder 0.731389 1.54026 2.31804 1.51387 0.412615 10
reco:nhitsfilter:NumberOfHitsFilter 0.000396603 0.000703115 0.00102621 0.000675641 0.000163957 10
reco:reco3d:SpacePointSolver 5.98006 17.5404 32.0504 18.6855 7.9498 10
reco:hitpdune:DisambigFromSpacePoints 0.682657 2.39719 3.57576 2.57786 0.895039 10
reco:pandora:StandardPandora 11.6729 57.3591 109.835 44.7957 29.7705 10
reco:pandoraWriter:StandardPandora 0.25503 0.572201 0.79944 0.61042 0.157201 10
reco:pandoraTrack:LArPandoraTrackCreation 1.79233 6.68499 11.6747 6.34157 2.62131 10
reco:pandoraShower:LArPandoraShowerCreation 1.43179 7.50991 15.2578 6.59627 3.79995 10
reco:pandoracalo:Calorimetry 0.925676 3.35923 5.95369 3.12291 1.32865 10
reco:pandoracalonosce:Calorimetry 0.817624 2.95849 5.62173 2.858 1.29246 10
reco:pandorapid:Chi2ParticleID 0.00404033 0.00753032 0.0117158 0.00786631 0.00218122 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0329137 0.0675697 0.102892 0.0665757 0.0240691 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00374445 0.007311 0.0118768 0.00717566 0.00228288 10
reco:pandoraShowercalo:ShowerCalorimetry 1.86303 6.95685 13.706 6.54521 3.46877 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.87003 6.57988 13.5913 5.54215 3.3209 10
reco:emtrkmichelid:EmTrackMichelId 151.999 285.043 365.565 279.159 58.7058 10
reco:crttag:SingleCRTMatchingProducer 0.0090214 0.0143899 0.022443 0.0127945 0.0039214 10
reco:crtreco:TwoCRTMatchingProducer 0.00717081 0.0112351 0.0161982 0.0109417 0.00243807 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.620481 0.937078 1.30074 0.89529 0.209548 10
reco:pandora2Track:LArPandoraTrackCreation 6.04277 19.5047 30.4634 18.8055 6.70514 10
reco:pandora2calo:Calorimetry 2.35254 8.89128 17.0976 8.87329 3.62193 10
reco:pandora2calonosce:Calorimetry 2.24167 7.94198 15.8619 7.36378 3.36134 10
reco:pandora2pid:Chi2ParticleID 0.00873763 0.0170167 0.0266378 0.0163079 0.00456794 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0399644 0.0742579 0.136447 0.064842 0.0254601 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00857303 0.0172061 0.0266645 0.0157031 0.00491439 10
reco:pandora2Shower:LArPandoraShowerCreation 1.93884 7.02206 11.7855 6.74285 2.58769 10
reco:pandora2Showercalo:ShowerCalorimetry 1.92116 7.23499 12.1482 6.96395 2.89709 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.79672 6.05916 11.1804 5.88862 2.30188 10
[art]:TriggerResults:TriggerResultInserter 2.3161e-05 3.96883e-05 0.000144545 2.58305e-05 3.52792e-05 10
end_path:out1:RootOutput 4.69e-06 5.909e-06 1.126e-05 5.085e-06 1.88574e-06 10
end_path:out1:RootOutput(write) 1.87768 3.46155 4.80898 3.58807 0.745376 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5378.38 MB
Peak resident set size usage (VmHWM): 4564.73 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.51 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11657720
-rw-r--r-- 1 dune001 dune 2692841967 Nov 5 08:14 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2558888082 Nov 5 08:11 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2420649402 Nov 5 09:42 reco_stage1.root
-rw-r--r-- 1 dune001 dune 2132774520 Nov 5 05:57 g4_stage2.root
-rw-r--r-- 1 dune001 dune 2046281664 Nov 5 05:42 g4_stage1.root
-rw-r--r-- 1 dune001 dune 85438560 Nov 5 09:36 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 243166 Nov 5 09:42 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Nov 5 09:42 mem.db
-rw-r--r-- 1 dune001 dune 62376 Nov 5 09:42 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Nov 5 09:42 time.db
-rw-r--r-- 1 dune001 dune 519 Nov 5 08:14 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Nov 5 05:57 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Nov 5 09:42 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Nov 5 05:32 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Nov 5 09:42 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Nov 5 08:24 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Nov 5 08:14 debugprod.log
