Jobsub ID 254562.1@dunegpschedd01.fnal.gov
| Jobsub ID | 254562.1@dunegpschedd01.fnal.gov |
| Workflow ID | 10413 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-20 18:58:44 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-20 21:20:34 |
| From worker node | Hostname | dunegli-7831237-0-fnpc23040.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-20 19:19:50 |
| Input files | monte-carlo-010413-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6923s) |
| CPU time | 1h (6866s = 99%) |
| Max RSS bytes | 4066660352 (3878 MiB) |
| Outputting started | 2025-11-20 21:15:14 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10413/1/001/reco_stage1.root
|
| Finished | 2025-11-20 21:20:31 |
| Saved logs | justin-logs:254562.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
r
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 88702 traces, 0 summary
Retagger: tagging trace set: gauss with 67516 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 67516 traces tagged "gauss"
FrameSaver: q=2.28734e+06 n=1161474 tag=gauss
wclsFrameSaver: saving 88702 traces tagged "wiener"
FrameSaver: q=2.42008e+06 n=1023673 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 16567 XUs and 15120 XVs -> 75 XUVs
C:0 T:1 27153 XUs and 25575 XVs -> 1599 XUVs
C:0 T:2 52826 XUs and 51296 XVs -> 3125 XUVs
C:0 T:3 26621 XUs and 24265 XVs -> 101 XUVs
C:0 T:4 5263 XUs and 5160 XVs -> 28 XUVs
C:0 T:5 16053 XUs and 12048 XVs -> 1958 XUVs
C:0 T:6 66400 XUs and 51064 XVs -> 2165 XUVs
C:0 T:7 29414 XUs and 20984 XVs -> 177 XUVs
C:0 T:8 10850 XUs and 7688 XVs -> 117 XUVs
C:0 T:9 60910 XUs and 60848 XVs -> 4283 XUVs
C:0 T:10 21707 XUs and 12609 XVs -> 1926 XUVs
C:0 T:11 18 XUs and 19 XVs -> 5 XUVs
15559 XUVs total
7301 collection wire objects
14412 potential space points
Neighbour search...
517688 tests to find 297098 neighbours
Iterating with no regularization...
Begin: 5.11711e+07
0 4.57597e+07
1 4.53982e+07
2 4.53542e+07
Now with regularization...
Begin: 3.84312e+07
0 3.84144e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410635049
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410635049
fLifetime: 30000 [us]
20-Nov-2025 21:15:13 UTC Closed output file "reco_stage1.root"
20-Nov-2025 21:15:13 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 130.885 193.541 278.035 187.062 40.8732 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000797656 0.00278252 0.00382193 0.00312594 0.000983233 10
reco:ophit:OpHitFinder 0.155742 0.202868 0.232355 0.205786 0.0252692 10
reco:opflash:OpFlashFinder 0.0779035 0.124601 0.171277 0.128249 0.0271019 10
reco:opslicer:OpSlicer 0.300614 0.43563 0.559872 0.442085 0.0837086 10
reco:caldata:DataPrepModule 3.32717 3.5603 3.78436 3.55698 0.142776 10
reco:wclsdatasp:WireCellToolkit 22.0107 24.0769 26.6102 24.0965 1.50089 10
reco:gaushit:GausHitFinder 0.490957 0.686244 0.939686 0.678749 0.118841 10
reco:nhitsfilter:NumberOfHitsFilter 0.000216705 0.000477974 0.00111947 0.000366721 0.00025932 10
reco:reco3d:SpacePointSolver 3.30566 8.2826 12.2263 7.57432 2.94994 10
reco:hitpdune:DisambigFromSpacePoints 0.510642 0.897547 1.55094 0.83725 0.279464 10
reco:pandora:StandardPandora 8.7436 16.0861 28.1754 14.4971 5.96289 10
reco:pandoraWriter:StandardPandora 0.1469 0.259345 0.407205 0.246278 0.0709236 10
reco:pandoraTrack:LArPandoraTrackCreation 1.25267 1.94892 3.20788 1.63282 0.619621 10
reco:pandoraShower:LArPandoraShowerCreation 0.910054 2.0036 3.57181 1.93068 0.769641 10
reco:pandoracalo:Calorimetry 0.700534 1.11077 1.75754 0.979139 0.335634 10
reco:pandoracalonosce:Calorimetry 0.634146 1.01499 1.63098 0.892709 0.31754 10
reco:pandorapid:Chi2ParticleID 0.00258474 0.00336652 0.00470437 0.00313399 0.00068542 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0226726 0.0310759 0.0416081 0.0299188 0.00493262 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00251282 0.00303521 0.00390336 0.00297953 0.000418041 10
reco:pandoraShowercalo:ShowerCalorimetry 0.946604 2.23 4.04994 2.20079 0.908232 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.928134 2.19101 3.99587 2.2281 0.896368 10
reco:emtrkmichelid:EmTrackMichelId 74.9086 105.756 146.365 103.516 19.4613 10
reco:crttag:SingleCRTMatchingProducer 0.00544132 0.008244 0.0137746 0.00736925 0.00270274 10
reco:crtreco:TwoCRTMatchingProducer 0.00333911 0.00465526 0.00612754 0.00464701 0.000845654 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.39224 0.540897 0.680512 0.51578 0.0819853 10
reco:pandora2Track:LArPandoraTrackCreation 3.04944 6.31934 12.374 5.89823 2.57891 10
reco:pandora2calo:Calorimetry 1.54456 3.25588 6.38336 3.1305 1.37116 10
reco:pandora2calonosce:Calorimetry 1.45467 3.06289 5.59685 2.99248 1.20014 10
reco:pandora2pid:Chi2ParticleID 0.00539422 0.00762255 0.0115774 0.00764104 0.00168337 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0274538 0.0375544 0.0527202 0.0371118 0.0070922 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00526419 0.00736413 0.0101586 0.00748799 0.00141141 10
reco:pandora2Shower:LArPandoraShowerCreation 1.13371 2.20926 3.71376 2.10043 0.734883 10
reco:pandora2Showercalo:ShowerCalorimetry 1.36266 2.80022 4.89704 2.72891 1.04857 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.26299 2.57939 4.43088 2.507 0.955604 10
[art]:TriggerResults:TriggerResultInserter 2.9636e-05 4.05574e-05 0.000100362 3.3589e-05 2.00884e-05 10
end_path:out1:RootOutput 7.163e-06 9.1402e-06 1.3836e-05 8.7765e-06 1.82477e-06 10
end_path:out1:RootOutput(write) 1.17427 1.73966 2.45857 1.6999 0.341707 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4872.57 MB
Peak resident set size usage (VmHWM): 4066.66 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9553540
-rw-r--r-- 1 dunegli fnalgrid 2259376845 Nov 20 20:41 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2143536301 Nov 20 20:40 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1923784754 Nov 20 21:15 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1730939868 Nov 20 19:30 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1654784272 Nov 20 19:23 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 69783910 Nov 20 21:13 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242877 Nov 20 21:15 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 20 21:15 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 20 21:15 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 20 21:15 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 20 20:41 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 20 19:30 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 20 21:15 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 20 19:19 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 20 21:15 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 20 20:44 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 20 20:41 debugprod.log
