Jobsub ID 250464.1@dunegpschedd02.fnal.gov
| Jobsub ID | 250464.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10583 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-24 10:42:01 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-24 14:25:32 |
| From worker node | Hostname | dunegli-7869973-0-fnpc18006.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-24 10:43:06 |
| Input files | monte-carlo-010583-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13307s) |
| CPU time | 3h (13175s = 99%) |
| Max RSS bytes | 4226883584 (4031 MiB) |
| Outputting started | 2025-11-24 14:24:53 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10583/1/001/reco_stage1.root
|
| Finished | 2025-11-24 14:25:32 |
| Saved logs | justin-logs:250464.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
epService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 136140 traces, 0 summary
Retagger: tagging trace set: gauss with 108173 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 108173 traces tagged "gauss"
FrameSaver: q=3.78165e+06 n=1975976 tag=gauss
wclsFrameSaver: saving 136140 traces tagged "wiener"
FrameSaver: q=3.96583e+06 n=1774545 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 30959 XUs and 28060 XVs -> 191 XUVs
C:0 T:1 56386 XUs and 47979 XVs -> 2646 XUVs
C:0 T:2 69953 XUs and 91154 XVs -> 2655 XUVs
C:0 T:3 39608 XUs and 41795 XVs -> 350 XUVs
C:0 T:4 14274 XUs and 13348 XVs -> 130 XUVs
C:0 T:5 53754 XUs and 38675 XVs -> 4985 XUVs
C:0 T:6 64644 XUs and 91127 XVs -> 2504 XUVs
C:0 T:7 30516 XUs and 40907 XVs -> 290 XUVs
C:0 T:8 8836 XUs and 8065 XVs -> 64 XUVs
C:0 T:9 53524 XUs and 67271 XVs -> 5338 XUVs
C:0 T:10 69477 XUs and 60686 XVs -> 4804 XUVs
C:0 T:11 479 XUs and 402 XVs -> 25 XUVs
23982 XUVs total
11336 collection wire objects
22380 potential space points
Neighbour search...
579388 tests to find 321024 neighbours
Iterating with no regularization...
Begin: 7.51608e+07
0 6.62178e+07
1 6.56329e+07
2 6.55609e+07
3 6.55444e+07
Now with regularization...
Begin: 5.54234e+07
0 5.541e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410708695
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410708695
fLifetime: 30000 [us]
24-Nov-2025 14:24:47 UTC Closed output file "reco_stage1.root"
24-Nov-2025 14:24:47 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 251.773 443.267 659.765 451.059 130.057 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00131163 0.00407885 0.00579583 0.0043019 0.00156718 10
reco:ophit:OpHitFinder 0.264382 0.324689 0.461739 0.304335 0.0584393 10
reco:opflash:OpFlashFinder 0.157164 0.182258 0.282869 0.171411 0.0356472 10
reco:opslicer:OpSlicer 0.653051 0.848025 1.33257 0.748284 0.209205 10
reco:caldata:DataPrepModule 5.61115 7.15234 9.29016 6.55772 1.4039 10
reco:wclsdatasp:WireCellToolkit 32.4981 45.8048 58.347 46.6512 8.07277 10
reco:gaushit:GausHitFinder 0.826729 1.30585 1.7358 1.32037 0.348869 10
reco:nhitsfilter:NumberOfHitsFilter 0.000630629 0.000783897 0.000993745 0.0007816 0.00011636 10
reco:reco3d:SpacePointSolver 6.02192 15.6184 26.3817 13.8463 7.12613 10
reco:hitpdune:DisambigFromSpacePoints 0.879155 1.62133 2.34917 1.60003 0.536271 10
reco:pandora:StandardPandora 15.1773 35.5263 56.4133 35.0037 15.0256 10
reco:pandoraWriter:StandardPandora 0.356007 0.539393 0.676776 0.550308 0.118108 10
reco:pandoraTrack:LArPandoraTrackCreation 3.22428 6.63326 10.2322 6.14108 2.32738 10
reco:pandoraShower:LArPandoraShowerCreation 3.84796 8.50659 15.7061 7.04943 4.3231 10
reco:pandoracalo:Calorimetry 1.59252 3.56151 6.84909 3.15013 1.58868 10
reco:pandoracalonosce:Calorimetry 1.41225 3.33649 6.39512 2.86575 1.55401 10
reco:pandorapid:Chi2ParticleID 0.00541905 0.00745664 0.0114177 0.00671057 0.00198234 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.042277 0.0685853 0.135471 0.0595752 0.0277786 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00466719 0.00702879 0.011891 0.00642186 0.00212426 10
reco:pandoraShowercalo:ShowerCalorimetry 3.23486 8.05422 16.6235 6.39686 4.75434 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.00361 7.64855 14.4744 6.14984 4.23683 10
reco:emtrkmichelid:EmTrackMichelId 130.892 216.493 333.33 221.374 57.5666 10
reco:crttag:SingleCRTMatchingProducer 0.016772 0.0259811 0.0386319 0.0235045 0.00672285 10
reco:crtreco:TwoCRTMatchingProducer 0.010721 0.0205777 0.0289791 0.0196664 0.00588963 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.778989 1.11399 1.46257 1.19948 0.23947 10
reco:pandora2Track:LArPandoraTrackCreation 9.95927 24.2953 42.6683 19.5778 11.8269 10
reco:pandora2calo:Calorimetry 4.2392 11.3851 22.3987 8.69802 6.05333 10
reco:pandora2calonosce:Calorimetry 4.14984 10.9531 21.2291 8.98075 5.68484 10
reco:pandora2pid:Chi2ParticleID 0.0115148 0.0187119 0.0269461 0.0198641 0.00418045 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0549298 0.0953034 0.158938 0.0930457 0.0301473 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0113717 0.0188213 0.0301345 0.0188118 0.00497036 10
reco:pandora2Shower:LArPandoraShowerCreation 3.95562 9.36865 15.5545 8.11269 4.0134 10
reco:pandora2Showercalo:ShowerCalorimetry 3.48067 9.88593 19.7372 8.06627 5.30885 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.98103 8.93268 18.3574 7.28348 4.87987 10
[art]:TriggerResults:TriggerResultInserter 6.5393e-05 8.78118e-05 0.000134534 8.27965e-05 2.284e-05 10
end_path:out1:RootOutput 1.2293e-05 1.46357e-05 1.6862e-05 1.45575e-05 1.43444e-06 10
end_path:out1:RootOutput(write) 2.43519 3.68635 5.36063 3.87347 0.872583 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5033.7 MB
Peak resident set size usage (VmHWM): 4226.88 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.30 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.51 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9311408
-rw-r--r-- 1 dunegli fnalgrid 2211768126 Nov 24 13:08 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2101932057 Nov 24 13:06 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1861745112 Nov 24 14:24 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1680057728 Nov 24 11:02 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1612783285 Nov 24 10:48 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 65980550 Nov 24 14:15 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242821 Nov 24 14:24 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 24 14:24 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 24 14:24 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 24 14:24 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 13:08 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 11:02 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 14:24 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 24 10:43 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 24 14:24 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 24 13:12 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 24 13:08 debugprod.log
