Jobsub ID 244866.1@dunegpschedd02.fnal.gov
| Jobsub ID | 244866.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10193 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-14 18:39:14 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 20:41:29 |
| From worker node | Hostname | dunegli-7599221-0-fnpc23024.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 18:40:06 |
| Input files | monte-carlo-010193-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7266s) |
| CPU time | 1h (7166s = 98%) |
| Max RSS bytes | 4233334784 (4037 MiB) |
| Outputting started | 2025-11-14 20:41:12 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10193/1/001/reco_stage1.root
|
| Finished | 2025-11-14 20:41:29 |
| Saved logs | justin-logs:244866.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
leKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 168428 traces, 0 summary
Retagger: tagging trace set: gauss with 123840 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 123840 traces tagged "gauss"
FrameSaver: q=4.46967e+06 n=2135168 tag=gauss
wclsFrameSaver: saving 168428 traces tagged "wiener"
FrameSaver: q=4.77667e+06 n=1870973 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 40411 XUs and 44165 XVs -> 471 XUVs
C:0 T:1 100901 XUs and 100831 XVs -> 6733 XUVs
C:0 T:2 106685 XUs and 230444 XVs -> 16000 XUVs
C:0 T:3 36659 XUs and 58278 XVs -> 261 XUVs
C:0 T:4 11216 XUs and 18166 XVs -> 145 XUVs
C:0 T:5 66490 XUs and 62729 XVs -> 8555 XUVs
C:0 T:6 137702 XUs and 156303 XVs -> 7136 XUVs
C:0 T:7 41927 XUs and 37886 XVs -> 645 XUVs
C:0 T:8 5605 XUs and 7434 XVs -> 29 XUVs
C:0 T:9 29617 XUs and 50719 XVs -> 2783 XUVs
C:0 T:10 76539 XUs and 46837 XVs -> 7025 XUVs
C:0 T:11 229 XUs and 139 XVs -> 30 XUVs
49813 XUVs total
16674 collection wire objects
45127 potential space points
Neighbour search...
5150773 tests to find 2224398 neighbours
Iterating with no regularization...
Begin: 1.30146e+08
0 9.24653e+07
1 8.96597e+07
2 8.92468e+07
3 8.9114e+07
4 8.90499e+07
Now with regularization...
Begin: 7.17327e+07
0 7.16059e+07
1 7.15501e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410511990
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410511990
fLifetime: 30000 [us]
14-Nov-2025 20:41:11 UTC Closed output file "reco_stage1.root"
14-Nov-2025 20:41:11 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 171.84 205.22 291.439 192.812 33.8921 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000662114 0.00269934 0.00479741 0.00245341 0.00122689 10
reco:ophit:OpHitFinder 0.17466 0.224958 0.302766 0.221166 0.0330364 10
reco:opflash:OpFlashFinder 0.102066 0.129128 0.166917 0.127063 0.0201379 10
reco:opslicer:OpSlicer 0.347457 0.42701 0.507163 0.439455 0.050733 10
reco:caldata:DataPrepModule 3.60446 3.73412 3.8617 3.71912 0.0919016 10
reco:wclsdatasp:WireCellToolkit 22.7361 23.5231 24.0935 23.6508 0.468457 10
reco:gaushit:GausHitFinder 0.614595 0.729913 0.930805 0.693502 0.102483 10
reco:nhitsfilter:NumberOfHitsFilter 0.000249557 0.000309361 0.000403771 0.000297779 4.64121e-05 10
reco:reco3d:SpacePointSolver 5.70309 8.35142 11.2027 8.23219 1.67007 10
reco:hitpdune:DisambigFromSpacePoints 0.730216 1.02583 1.48116 1.02555 0.220335 10
reco:pandora:StandardPandora 9.86711 19.8404 47.5703 16.7518 9.97586 10
reco:pandoraWriter:StandardPandora 0.216284 0.26558 0.34134 0.264431 0.0396485 10
reco:pandoraTrack:LArPandoraTrackCreation 1.59167 2.00096 3.16269 1.8109 0.465082 10
reco:pandoraShower:LArPandoraShowerCreation 1.70061 2.21747 3.67243 2.02573 0.59545 10
reco:pandoracalo:Calorimetry 1.00924 1.24139 1.86848 1.12423 0.257199 10
reco:pandoracalonosce:Calorimetry 0.92122 1.14487 1.73407 1.03569 0.244519 10
reco:pandorapid:Chi2ParticleID 0.00296526 0.00341097 0.00413113 0.00336766 0.000346036 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0274634 0.0319211 0.039625 0.0307485 0.00355018 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00250916 0.00310961 0.00402902 0.00308341 0.000411847 10
reco:pandoraShowercalo:ShowerCalorimetry 1.67615 2.51893 4.09585 2.33132 0.696031 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.67084 2.46002 4.00032 2.261 0.672087 10
reco:emtrkmichelid:EmTrackMichelId 95.5228 110.886 143.334 107.939 14.3245 10
reco:crttag:SingleCRTMatchingProducer 0.00658511 0.0106921 0.0298171 0.00831689 0.00656792 10
reco:crtreco:TwoCRTMatchingProducer 0.00415579 0.00485858 0.00591737 0.00486807 0.000642571 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.439171 0.568457 0.773599 0.576278 0.0948345 10
reco:pandora2Track:LArPandoraTrackCreation 4.98924 6.45913 10.7998 5.69537 1.76783 10
reco:pandora2calo:Calorimetry 2.54258 3.56935 5.76294 3.20978 0.924721 10
reco:pandora2calonosce:Calorimetry 2.3833 3.38989 5.42215 3.06099 0.870585 10
reco:pandora2pid:Chi2ParticleID 0.0061978 0.00794885 0.0112666 0.00749311 0.00131402 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0343788 0.04214 0.0669484 0.0380176 0.00996106 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00609871 0.00763749 0.0103207 0.00725706 0.00112426 10
reco:pandora2Shower:LArPandoraShowerCreation 1.91734 2.41213 3.9502 2.13468 0.627983 10
reco:pandora2Showercalo:ShowerCalorimetry 2.23472 3.1501 5.11829 2.8328 0.830476 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.09401 2.89887 4.73087 2.61035 0.765675 10
[art]:TriggerResults:TriggerResultInserter 2.9135e-05 3.98921e-05 8.7637e-05 3.49265e-05 1.64477e-05 10
end_path:out1:RootOutput 5.992e-06 7.2428e-06 1.1091e-05 6.552e-06 1.42794e-06 10
end_path:out1:RootOutput(write) 1.64335 1.88168 2.4977 1.79386 0.251959 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5046.39 MB
Peak resident set size usage (VmHWM): 4233.33 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10168896
-rw-r--r-- 1 dunegli fnalgrid 2392983543 Nov 14 20:05 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2278624008 Nov 14 20:04 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2070854273 Nov 14 20:41 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1836901059 Nov 14 18:50 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1759995037 Nov 14 18:43 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 72957410 Nov 14 20:37 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242595 Nov 14 20:41 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 20:41 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 20:41 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 20:41 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 20:05 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 18:50 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 20:41 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 18:40 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 20:41 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 20:08 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 20:05 debugprod.log
