Jobsub ID 265391.0@dunegpschedd02.fnal.gov
| Jobsub ID | 265391.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11455 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-01 07:48:56 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-01 13:49:22 |
| From worker node | Hostname | dunegli-8210107-0-fnpc18008.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-01 08:14:49 |
| Input files | monte-carlo-011455-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (20042s) |
| CPU time | 5h (18775s = 93%) |
| Max RSS bytes | 4231438336 (4035 MiB) |
| Outputting started | 2026-01-01 13:48:51 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11455/1/001/reco_stage1.root
|
| Finished | 2026-01-01 13:49:22 |
| Saved logs | justin-logs:265391.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 130467 traces, 0 summary
Retagger: tagging trace set: gauss with 100304 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 100304 traces tagged "gauss"
FrameSaver: q=3.52201e+06 n=1768167 tag=gauss
wclsFrameSaver: saving 130467 traces tagged "wiener"
FrameSaver: q=3.73562e+06 n=1578348 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 40686 XUs and 39930 XVs -> 370 XUVs
C:0 T:1 84436 XUs and 76097 XVs -> 5456 XUVs
C:0 T:2 110336 XUs and 124360 XVs -> 4474 XUVs
C:0 T:3 60465 XUs and 52699 XVs -> 465 XUVs
C:0 T:4 13314 XUs and 17322 XVs -> 234 XUVs
C:0 T:5 66017 XUs and 66255 XVs -> 4504 XUVs
C:0 T:6 101881 XUs and 151834 XVs -> 7770 XUVs
C:0 T:7 39599 XUs and 39860 XVs -> 416 XUVs
C:0 T:8 7434 XUs and 6692 XVs -> 107 XUVs
C:0 T:9 41879 XUs and 50030 XVs -> 4578 XUVs
C:0 T:10 14743 XUs and 30567 XVs -> 3944 XUVs
C:0 T:11 191 XUs and 216 XVs -> 46 XUVs
32364 XUVs total
10381 collection wire objects
29478 potential space points
Neighbour search...
1740658 tests to find 923368 neighbours
Iterating with no regularization...
Begin: 7.94504e+07
0 6.67691e+07
1 6.58774e+07
2 6.57369e+07
3 6.56917e+07
Now with regularization...
Begin: 5.49048e+07
0 5.48781e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411470730
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411470730
fLifetime: 30000 [us]
01-Jan-2026 13:48:47 UTC Closed output file "reco_stage1.root"
01-Jan-2026 13:48:47 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 357.503 545.317 873.733 514.55 145.718 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00208773 0.00467088 0.00768593 0.00507914 0.00183305 10
reco:ophit:OpHitFinder 0.3113 0.375776 0.512073 0.356995 0.0635947 10
reco:opflash:OpFlashFinder 0.183939 0.244806 0.307598 0.236607 0.0373953 10
reco:opslicer:OpSlicer 0.775902 0.957939 1.58609 0.847828 0.249623 10
reco:caldata:DataPrepModule 6.69651 7.83903 10.1416 7.33597 1.21929 10
reco:wclsdatasp:WireCellToolkit 41.2661 50.5701 65.9591 48.2993 7.99317 10
reco:gaushit:GausHitFinder 0.966607 1.7372 3.13163 1.57424 0.569359 10
reco:nhitsfilter:NumberOfHitsFilter 0.000432743 0.000695476 0.000991202 0.000655435 0.000153389 10
reco:reco3d:SpacePointSolver 8.84012 17.9193 29.434 14.8346 6.91413 10
reco:hitpdune:DisambigFromSpacePoints 1.58863 2.37355 4.16543 2.13437 0.785892 10
reco:pandora:StandardPandora 23.6732 55.6269 114.141 47.0405 27.3656 10
reco:pandoraWriter:StandardPandora 0.528446 1.15004 2.04641 0.930571 0.60015 10
reco:pandoraTrack:LArPandoraTrackCreation 4.61581 7.44337 12.7731 6.5182 2.2616 10
reco:pandoraShower:LArPandoraShowerCreation 4.19733 8.21977 13.6224 7.16143 2.57494 10
reco:pandoracalo:Calorimetry 2.66088 3.98116 7.44739 3.44861 1.40574 10
reco:pandoracalonosce:Calorimetry 2.29844 3.71376 6.81284 3.39306 1.30257 10
reco:pandorapid:Chi2ParticleID 0.00654834 0.0102469 0.0153728 0.0093656 0.00233642 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0609456 0.0847251 0.126038 0.0757612 0.0222023 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00718042 0.00975672 0.0150237 0.0091603 0.00213824 10
reco:pandoraShowercalo:ShowerCalorimetry 3.62373 8.61106 15.5199 7.85425 3.15727 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.09702 8.06042 13.9697 7.15339 3.20759 10
reco:emtrkmichelid:EmTrackMichelId 203.127 283.707 441.688 256.424 73.4342 10
reco:crttag:SingleCRTMatchingProducer 0.015654 0.0259284 0.0411963 0.0238972 0.00740698 10
reco:crtreco:TwoCRTMatchingProducer 0.0138833 0.0182926 0.024192 0.0169998 0.00348561 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.05782 1.37704 1.6314 1.39845 0.171011 10
reco:pandora2Track:LArPandoraTrackCreation 14.0357 23.9918 36.678 22.3669 6.99114 10
reco:pandora2calo:Calorimetry 5.27134 12.191 21.187 11.14 4.5499 10
reco:pandora2calonosce:Calorimetry 4.99032 11.5362 18.9414 10.7512 3.9553 10
reco:pandora2pid:Chi2ParticleID 0.0174476 0.0275635 0.0389539 0.0282685 0.00726846 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.059222 0.113152 0.172599 0.107582 0.0376927 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0186584 0.0267193 0.0387041 0.0252282 0.00716529 10
reco:pandora2Shower:LArPandoraShowerCreation 4.85756 8.71483 12.612 8.38545 2.38036 10
reco:pandora2Showercalo:ShowerCalorimetry 4.02973 9.80471 16.9299 9.28212 3.25217 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.48372 9.4266 14.3044 8.86791 2.77644 10
[art]:TriggerResults:TriggerResultInserter 7.0611e-05 0.00015278 0.000243401 0.000157075 5.02847e-05 10
end_path:out1:RootOutput 1.4248e-05 2.50316e-05 4.9169e-05 2.42355e-05 9.11523e-06 10
end_path:out1:RootOutput(write) 2.6509 5.25961 8.78157 4.70592 1.77106 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5046.63 MB
Peak resident set size usage (VmHWM): 4231.44 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.29 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.71 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10012256
-rw-r--r-- 1 dunegli fnalgrid 2364441962 Jan 1 12:13 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2244466212 Jan 1 11:57 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2036914678 Jan 1 13:48 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1799039371 Jan 1 08:44 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1735324686 Jan 1 08:24 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 71733000 Jan 1 13:39 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242741 Jan 1 13:48 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 1 13:48 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 1 13:48 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 1 13:48 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 12:13 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 08:44 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 13:48 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 1 08:14 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 1 13:48 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 12:20 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 12:13 debugprod.log
