Jobsub ID 242281.1@dunegpschedd01.fnal.gov
| Jobsub ID | 242281.1@dunegpschedd01.fnal.gov |
| Workflow ID | 9546 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-03 10:56:45 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-03 14:12:31 |
| From worker node | Hostname | dunegli-7469323-0-fnpc19113.fnal.gov |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-03 10:58:28 |
| Input files | monte-carlo-009546-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11630s) |
| CPU time | 3h (11128s = 95%) |
| Max RSS bytes | 4548386816 (4337 MiB) |
| Outputting started | 2025-11-03 14:12:18 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09546/1/001/reco_stage1.root
|
| Finished | 2025-11-03 14:12:31 |
| Saved logs | justin-logs:242281.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 149902 traces, 0 summary
Retagger: tagging trace set: gauss with 113698 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 113698 traces tagged "gauss"
FrameSaver: q=4.11868e+06 n=2104194 tag=gauss
wclsFrameSaver: saving 149902 traces tagged "wiener"
FrameSaver: q=4.36859e+06 n=1888645 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 60567 XUs and 61616 XVs -> 782 XUVs
C:0 T:1 117070 XUs and 131125 XVs -> 7635 XUVs
C:0 T:2 204526 XUs and 185814 XVs -> 15616 XUVs
C:0 T:3 86863 XUs and 73033 XVs -> 1508 XUVs
C:0 T:4 8653 XUs and 12004 XVs -> 72 XUVs
C:0 T:5 27564 XUs and 32995 XVs -> 2697 XUVs
C:0 T:6 169504 XUs and 142305 XVs -> 6794 XUVs
C:0 T:7 69578 XUs and 53022 XVs -> 711 XUVs
C:0 T:8 5867 XUs and 7608 XVs -> 48 XUVs
C:0 T:9 30145 XUs and 43806 XVs -> 2190 XUVs
C:0 T:10 33774 XUs and 23893 XVs -> 4913 XUVs
C:0 T:11 78 XUs and 38 XVs -> 9 XUVs
42975 XUVs total
13128 collection wire objects
36865 potential space points
Neighbour search...
2497119 tests to find 1250914 neighbours
Iterating with no regularization...
Begin: 7.49288e+07
0 6.12814e+07
1 6.02662e+07
2 6.01195e+07
3 6.00754e+07
Now with regularization...
Begin: 4.83865e+07
0 4.83451e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410286414
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410286414
fLifetime: 30000 [us]
03-Nov-2025 14:12:16 UTC Closed output file "reco_stage1.root"
03-Nov-2025 14:12:16 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 231.041 345.498 396.413 363.555 51.8273 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00162372 0.00329143 0.00502592 0.00322678 0.00116709 10
reco:ophit:OpHitFinder 0.230952 0.283086 0.331628 0.283365 0.0266468 10
reco:opflash:OpFlashFinder 0.146959 0.208079 0.273795 0.20105 0.0312986 10
reco:opslicer:OpSlicer 0.444741 0.670425 0.883749 0.69062 0.109336 10
reco:caldata:DataPrepModule 4.2012 4.37156 4.63655 4.34722 0.121058 10
reco:wclsdatasp:WireCellToolkit 28.3481 31.9326 33.672 32.5189 1.75262 10
reco:gaushit:GausHitFinder 0.762563 1.06561 1.26665 1.09119 0.154083 10
reco:nhitsfilter:NumberOfHitsFilter 0.000425264 0.00058429 0.000790248 0.000558485 0.000118768 10
reco:reco3d:SpacePointSolver 6.33553 14.5421 24.801 13.3999 5.04826 10
reco:hitpdune:DisambigFromSpacePoints 0.847327 1.58537 2.07457 1.74431 0.339398 10
reco:pandora:StandardPandora 19.9343 41.6048 62.3829 40.2037 13.029 10
reco:pandoraWriter:StandardPandora 0.309211 0.446324 0.503417 0.475892 0.0591479 10
reco:pandoraTrack:LArPandoraTrackCreation 2.35837 4.88956 7.79932 4.6264 1.57823 10
reco:pandoraShower:LArPandoraShowerCreation 1.98826 4.97098 7.96908 4.94972 1.6576 10
reco:pandoracalo:Calorimetry 1.10805 2.45892 4.05393 2.25592 0.881219 10
reco:pandoracalonosce:Calorimetry 1.01636 2.26704 3.79293 2.05492 0.804627 10
reco:pandorapid:Chi2ParticleID 0.00439085 0.00588491 0.00866897 0.00579507 0.00112964 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.037674 0.0479091 0.0538601 0.0497132 0.00500082 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00413037 0.00569211 0.00730456 0.0056825 0.000826885 10
reco:pandoraShowercalo:ShowerCalorimetry 1.86142 4.56349 6.86116 4.63876 1.41157 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.78424 4.49785 6.81709 4.38617 1.47443 10
reco:emtrkmichelid:EmTrackMichelId 133.57 181.741 205.759 189.71 22.1796 10
reco:crttag:SingleCRTMatchingProducer 0.00988433 0.0120509 0.0168488 0.0108452 0.00227629 10
reco:crtreco:TwoCRTMatchingProducer 0.00525435 0.00768444 0.00912393 0.00803189 0.00107985 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.615774 0.811199 0.961877 0.804881 0.111249 10
reco:pandora2Track:LArPandoraTrackCreation 6.53862 13.4656 19.8875 13.295 3.53677 10
reco:pandora2calo:Calorimetry 2.81069 5.83892 7.89002 5.9559 1.38485 10
reco:pandora2calonosce:Calorimetry 2.62875 5.46615 7.49261 5.79232 1.31406 10
reco:pandora2pid:Chi2ParticleID 0.0104276 0.0143346 0.0179404 0.0141018 0.00212113 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0445996 0.0620532 0.0717895 0.0644649 0.00804003 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0101971 0.014095 0.0170423 0.0139313 0.0020346 10
reco:pandora2Shower:LArPandoraShowerCreation 2.41888 4.84409 6.6157 5.14732 1.2047 10
reco:pandora2Showercalo:ShowerCalorimetry 2.46933 5.02878 6.91885 5.27977 1.19941 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.29874 4.46727 5.98972 4.72424 1.04478 10
[art]:TriggerResults:TriggerResultInserter 3.6311e-05 5.27064e-05 0.000119071 4.64e-05 2.25728e-05 10
end_path:out1:RootOutput 9.67e-06 1.12551e-05 1.719e-05 1.01705e-05 2.5029e-06 10
end_path:out1:RootOutput(write) 2.0594 3.17886 6.36975 3.06724 1.12391 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5358.98 MB
Peak resident set size usage (VmHWM): 4548.39 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.70 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11495460
-rw-r--r-- 1 dunegli fnalgrid 2654306062 Nov 3 13:11 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2515759882 Nov 3 13:09 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2369674211 Nov 3 14:12 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2124432709 Nov 3 11:18 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2023651233 Nov 3 11:03 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 82896460 Nov 3 14:07 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242923 Nov 3 14:12 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 3 14:12 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 3 14:12 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 3 14:12 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 13:11 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 11:18 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 14:12 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 3 10:58 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 3 14:12 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 13:18 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 13:12 debugprod.log
