Jobsub ID 244081.0@dunegpschedd02.fnal.gov
| Jobsub ID | 244081.0@dunegpschedd02.fnal.gov |
| Workflow ID | 10181 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-14 10:12:22 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 13:54:03 |
| From worker node | Hostname | dunegli-7751854-0-fnpc23014.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 11:56:03 |
| Input files | monte-carlo-010181-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (7060s) |
| CPU time | 1h (6825s = 96%) |
| Max RSS bytes | 4132708352 (3941 MiB) |
| Outputting started | 2025-11-14 13:53:44 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10181/1/001/reco_stage1.root
|
| Finished | 2025-11-14 13:54:03 |
| Saved logs | justin-logs:244081.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
ol pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 130703 traces, 0 summary
Retagger: tagging trace set: gauss with 99720 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 99720 traces tagged "gauss"
FrameSaver: q=3.47641e+06 n=1810823 tag=gauss
wclsFrameSaver: saving 130703 traces tagged "wiener"
FrameSaver: q=3.67329e+06 n=1603842 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 31156 XUs and 29818 XVs -> 268 XUVs
C:0 T:1 58766 XUs and 56152 XVs -> 3552 XUVs
C:0 T:2 131540 XUs and 179699 XVs -> 7482 XUVs
C:0 T:3 53747 XUs and 66840 XVs -> 503 XUVs
C:0 T:4 11540 XUs and 10715 XVs -> 79 XUVs
C:0 T:5 37396 XUs and 26913 XVs -> 2393 XUVs
C:0 T:6 173521 XUs and 165184 XVs -> 15518 XUVs
C:0 T:7 37531 XUs and 49819 XVs -> 559 XUVs
C:0 T:8 8205 XUs and 6798 XVs -> 94 XUVs
C:0 T:9 46310 XUs and 49354 XVs -> 3440 XUVs
C:0 T:10 39024 XUs and 46514 XVs -> 6422 XUVs
C:0 T:11 239 XUs and 211 XVs -> 59 XUVs
40369 XUVs total
12395 collection wire objects
36937 potential space points
Neighbour search...
4825559 tests to find 2106466 neighbours
Iterating with no regularization...
Begin: 7.23478e+07
0 6.10883e+07
1 6.02128e+07
2 6.00821e+07
3 6.00411e+07
Now with regularization...
Begin: 5.07768e+07
0 5.07258e+07
1 5.07023e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410507082
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410507082
fLifetime: 30000 [us]
14-Nov-2025 13:53:43 UTC Closed output file "reco_stage1.root"
14-Nov-2025 13:53:43 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 160.942 206.774 247.391 209.545 28.101 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000612754 0.00287388 0.004692 0.00299331 0.00129338 10
reco:ophit:OpHitFinder 0.177083 0.217171 0.264258 0.216481 0.0246208 10
reco:opflash:OpFlashFinder 0.0955362 0.121697 0.151268 0.124366 0.0156562 10
reco:opslicer:OpSlicer 0.326758 0.423118 0.458016 0.436359 0.0384046 10
reco:caldata:DataPrepModule 3.59329 3.88571 4.16772 3.85983 0.208581 10
reco:wclsdatasp:WireCellToolkit 22.7931 24.4671 26.1812 24.5756 1.04377 10
reco:gaushit:GausHitFinder 0.510548 0.790018 1.3513 0.751964 0.216374 10
reco:nhitsfilter:NumberOfHitsFilter 0.000255489 0.00035313 0.00051123 0.000314022 8.62997e-05 10
reco:reco3d:SpacePointSolver 5.29943 9.39795 14.8364 8.73368 3.30912 10
reco:hitpdune:DisambigFromSpacePoints 0.567103 0.939069 1.28694 0.925513 0.19815 10
reco:pandora:StandardPandora 11.4984 18.0145 26.6403 17.5469 4.57826 10
reco:pandoraWriter:StandardPandora 0.182921 0.262901 0.3214 0.266159 0.0453379 10
reco:pandoraTrack:LArPandoraTrackCreation 1.43726 1.95483 2.66623 1.87037 0.319239 10
reco:pandoraShower:LArPandoraShowerCreation 1.23812 2.08503 2.86577 2.08564 0.485404 10
reco:pandoracalo:Calorimetry 0.832634 1.18603 1.59793 1.18109 0.205636 10
reco:pandoracalonosce:Calorimetry 0.755452 1.09196 1.48062 1.08096 0.193004 10
reco:pandorapid:Chi2ParticleID 0.00277629 0.00345855 0.00401332 0.00348221 0.000328524 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.025492 0.0309296 0.0393393 0.0311977 0.00427962 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00268619 0.00311856 0.00354061 0.00319794 0.000256089 10
reco:pandoraShowercalo:ShowerCalorimetry 1.25012 2.35937 3.31626 2.50001 0.632963 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.22414 2.29672 3.22889 2.43768 0.617279 10
reco:emtrkmichelid:EmTrackMichelId 86.5381 113.825 132.982 114.114 14.5799 10
reco:crttag:SingleCRTMatchingProducer 0.00544985 0.0108309 0.0201551 0.00871537 0.0042101 10
reco:crtreco:TwoCRTMatchingProducer 0.00376946 0.00515993 0.00692434 0.00529637 0.000878091 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.527301 0.626581 0.756259 0.597876 0.0763849 10
reco:pandora2Track:LArPandoraTrackCreation 4.22124 6.23319 8.20066 6.12145 1.40079 10
reco:pandora2calo:Calorimetry 2.16576 3.37625 4.42316 3.55537 0.793178 10
reco:pandora2calonosce:Calorimetry 2.0441 3.20242 4.19436 3.39313 0.752145 10
reco:pandora2pid:Chi2ParticleID 0.00662163 0.00801989 0.00962901 0.00794498 0.000807121 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0314026 0.0396959 0.0459769 0.0402757 0.00451684 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00667244 0.00787 0.00923886 0.00769167 0.000931577 10
reco:pandora2Shower:LArPandoraShowerCreation 1.62676 2.26816 2.93006 2.30503 0.448274 10
reco:pandora2Showercalo:ShowerCalorimetry 1.89009 2.95689 3.88104 3.12525 0.704405 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.75633 2.71246 3.49295 2.83549 0.642281 10
[art]:TriggerResults:TriggerResultInserter 3.2543e-05 6.14376e-05 9.8588e-05 5.62575e-05 2.47291e-05 10
end_path:out1:RootOutput 7.916e-06 1.25462e-05 2.7844e-05 1.02645e-05 5.99234e-06 10
end_path:out1:RootOutput(write) 1.48171 1.91004 2.25804 1.96393 0.22905 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4940.15 MB
Peak resident set size usage (VmHWM): 4132.71 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9389540
-rw-r--r-- 1 dunegli fnalgrid 2236375880 Nov 14 13:17 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2123975711 Nov 14 13:16 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1906583993 Nov 14 13:53 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1672199628 Nov 14 12:05 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1604058688 Nov 14 11:59 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 71078830 Nov 14 13:50 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243168 Nov 14 13:53 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 13:53 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 13:53 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 13:53 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 13:17 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 12:05 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 13:53 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 11:56 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 13:53 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 13:21 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 13:18 debugprod.log
