Jobsub ID 233253.0@dunegpschedd02.fnal.gov
| Jobsub ID | 233253.0@dunegpschedd02.fnal.gov |
| Workflow ID | 9381 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-10-27 14:33:05 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-10-27 16:41:22 |
| From worker node | Hostname | dunegli-7542002-0-fnpc22033.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-27 14:35:00 |
| Input files | monte-carlo-009381-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7569s) |
| CPU time | 2h (7480s = 98%) |
| Max RSS bytes | 4179308544 (3985 MiB) |
| Outputting started | 2025-10-27 16:41:09 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09381/1/001/reco_stage1.root
|
| Finished | 2025-10-27 16:41:22 |
| Saved logs | justin-logs:233253.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 124865 traces, 0 summary
Retagger: tagging trace set: gauss with 95032 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95032 traces tagged "gauss"
FrameSaver: q=3.41308e+06 n=1722735 tag=gauss
wclsFrameSaver: saving 124865 traces tagged "wiener"
FrameSaver: q=3.59373e+06 n=1532478 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 26345 XUs and 25052 XVs -> 214 XUVs
C:0 T:1 40952 XUs and 40068 XVs -> 2084 XUVs
C:0 T:2 147665 XUs and 162706 XVs -> 11525 XUVs
C:0 T:3 57767 XUs and 55365 XVs -> 555 XUVs
C:0 T:4 8901 XUs and 9489 XVs -> 59 XUVs
C:0 T:5 30973 XUs and 50880 XVs -> 6294 XUVs
C:0 T:6 124768 XUs and 143555 XVs -> 9689 XUVs
C:0 T:7 47101 XUs and 54948 XVs -> 630 XUVs
C:0 T:8 7512 XUs and 8377 XVs -> 120 XUVs
C:0 T:9 50657 XUs and 77288 XVs -> 5513 XUVs
C:0 T:10 32406 XUs and 23028 XVs -> 5097 XUVs
C:0 T:11 130 XUs and 142 XVs -> 17 XUVs
41797 XUVs total
11480 collection wire objects
38754 potential space points
Neighbour search...
5170536 tests to find 2478756 neighbours
Iterating with no regularization...
Begin: 6.13134e+07
0 5.25098e+07
1 5.17997e+07
2 5.16813e+07
3 5.16452e+07
Now with regularization...
Begin: 4.21291e+07
0 4.20888e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410148662
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410148662
fLifetime: 30000 [us]
27-Oct-2025 16:41:08 UTC Closed output file "reco_stage1.root"
27-Oct-2025 16:41:08 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 175.205 219.812 300.698 198.763 43.1285 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000824785 0.00316111 0.00502267 0.00338075 0.00121161 10
reco:ophit:OpHitFinder 0.192859 0.217909 0.278562 0.211322 0.0238088 10
reco:opflash:OpFlashFinder 0.0969202 0.135153 0.195437 0.122868 0.030718 10
reco:opslicer:OpSlicer 0.343276 0.444926 0.568447 0.42676 0.0735761 10
reco:caldata:DataPrepModule 3.47094 3.55277 3.71898 3.51197 0.0800055 10
reco:wclsdatasp:WireCellToolkit 22.8937 24.0849 25.7671 24.042 0.742863 10
reco:gaushit:GausHitFinder 0.626668 0.76253 1.06115 0.741581 0.12491 10
reco:nhitsfilter:NumberOfHitsFilter 0.000310896 0.00046073 0.000733052 0.000444849 0.00012389 10
reco:reco3d:SpacePointSolver 6.18242 11.049 17.4353 10.0497 3.59747 10
reco:hitpdune:DisambigFromSpacePoints 0.685781 1.06978 1.66903 0.910525 0.31299 10
reco:pandora:StandardPandora 13.4682 21.5933 36.7702 17.2468 8.27625 10
reco:pandoraWriter:StandardPandora 0.224972 0.28936 0.415884 0.269686 0.0658174 10
reco:pandoraTrack:LArPandoraTrackCreation 1.59894 2.52886 4.22552 2.25859 0.915672 10
reco:pandoraShower:LArPandoraShowerCreation 1.69544 2.59362 5.51851 1.95143 1.15497 10
reco:pandoracalo:Calorimetry 0.953001 1.43724 2.21819 1.37533 0.406574 10
reco:pandoracalonosce:Calorimetry 0.878131 1.37898 2.34645 1.25913 0.458758 10
reco:pandorapid:Chi2ParticleID 0.00264875 0.00366823 0.00514979 0.00350945 0.000728905 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0277911 0.0331038 0.0400874 0.0325832 0.00403401 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00249713 0.00330873 0.00401897 0.00333156 0.000513537 10
reco:pandoraShowercalo:ShowerCalorimetry 1.73532 3.01869 5.62651 2.42699 1.1972 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.68457 2.94035 5.05022 2.19132 1.18483 10
reco:emtrkmichelid:EmTrackMichelId 94.2619 113.843 142.23 106.095 16.7926 10
reco:crttag:SingleCRTMatchingProducer 0.00566304 0.0101245 0.0202977 0.00899122 0.00439294 10
reco:crtreco:TwoCRTMatchingProducer 0.0039233 0.00566305 0.00807562 0.00538194 0.00145058 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.400825 0.55589 0.702841 0.547488 0.0852187 10
reco:pandora2Track:LArPandoraTrackCreation 4.97453 8.14887 15.2778 7.34484 3.26602 10
reco:pandora2calo:Calorimetry 2.51453 4.20528 7.55094 3.58247 1.54027 10
reco:pandora2calonosce:Calorimetry 2.38887 4.00476 7.04541 3.4417 1.44293 10
reco:pandora2pid:Chi2ParticleID 0.00640169 0.00809295 0.0110367 0.00767211 0.00148461 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0323331 0.0409653 0.0528927 0.0392909 0.00690098 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00635389 0.00793952 0.0106495 0.00756877 0.00139173 10
reco:pandora2Shower:LArPandoraShowerCreation 1.95126 2.93289 5.17965 2.3472 1.11714 10
reco:pandora2Showercalo:ShowerCalorimetry 2.22583 3.59936 6.19944 3.25181 1.16233 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.03639 3.27117 5.28181 2.90975 0.989715 10
[art]:TriggerResults:TriggerResultInserter 3.1831e-05 4.50619e-05 0.000110618 3.87425e-05 2.21264e-05 10
end_path:out1:RootOutput 5.01e-06 8.6191e-06 1.4226e-05 8.401e-06 2.4711e-06 10
end_path:out1:RootOutput(write) 1.55589 1.95128 2.52341 1.86153 0.333318 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4990.2 MB
Peak resident set size usage (VmHWM): 4179.31 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10100028
-rw-r--r-- 1 dunegli fnalgrid 2380832494 Oct 27 16:03 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2259815276 Oct 27 16:01 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2077602671 Oct 27 16:41 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1809785865 Oct 27 14:45 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1736263310 Oct 27 14:38 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 77516360 Oct 27 16:38 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242963 Oct 27 16:41 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Oct 27 16:41 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Oct 27 16:41 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Oct 27 16:41 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 27 16:03 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 27 14:45 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 27 16:41 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Oct 27 14:35 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Oct 27 16:41 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 27 16:06 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 27 16:03 debugprod.log
