Jobsub ID 271177.1@dunegpschedd01.fnal.gov
| Jobsub ID | 271177.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11456 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-01 07:48:56 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-01 12:52:31 |
| From worker node | Hostname | dunegli-8053767-0-fnpc17129.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-01 08:12:40 |
| Input files | monte-carlo-011456-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (16775s) |
| CPU time | 4h (16006s = 95%) |
| Max RSS bytes | 4435357696 (4229 MiB) |
| Outputting started | 2026-01-01 12:52:16 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11456/1/001/reco_stage1.root
|
| Finished | 2026-01-01 12:52:31 |
| Saved logs | justin-logs:271177.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
lSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 139360 traces, 0 summary
Retagger: tagging trace set: gauss with 105509 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 105509 traces tagged "gauss"
FrameSaver: q=3.87737e+06 n=1950465 tag=gauss
wclsFrameSaver: saving 139360 traces tagged "wiener"
FrameSaver: q=4.10035e+06 n=1752952 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:1 66372 XUs and 66714 XVs -> 8602 XUVs
C:0 T:2 148169 XUs and 114662 XVs -> 7557 XUVs
C:0 T:3 45883 XUs and 43853 XVs -> 259 XUVs
C:0 T:4 10063 XUs and 13546 XVs -> 175 XUVs
C:0 T:5 35829 XUs and 39619 XVs -> 2951 XUVs
C:0 T:6 131683 XUs and 170511 XVs -> 5810 XUVs
C:0 T:7 59074 XUs and 64131 XVs -> 683 XUVs
C:0 T:8 5813 XUs and 7955 XVs -> 114 XUVs
C:0 T:9 48168 XUs and 68732 XVs -> 7947 XUVs
C:0 T:10 33056 XUs and 39252 XVs -> 4384 XUVs
C:0 T:11 347 XUs and 332 XVs -> 44 XUVs
38526 XUVs total
12746 collection wire objects
35740 potential space points
Neighbour search...
3281936 tests to find 1642962 neighbours
Iterating with no regularization...
Begin: 8.42342e+07
0 6.89967e+07
1 6.81172e+07
2 6.80036e+07
3 6.79712e+07
Now with regularization...
Begin: 5.72933e+07
0 5.72572e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411470719
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411470719
fLifetime: 30000 [us]
01-Jan-2026 12:51:35 UTC Closed output file "reco_stage1.root"
01-Jan-2026 12:51:35 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 358.814 544.948 759.123 543.362 107.493 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00166423 0.0378226 0.305382 0.00484291 0.0898375 10
reco:ophit:OpHitFinder 0.267098 0.301458 0.331523 0.30103 0.0183263 10
reco:opflash:OpFlashFinder 0.172819 0.231378 0.283925 0.232859 0.0290477 10
reco:opslicer:OpSlicer 0.608401 0.738148 0.826071 0.776222 0.0835158 10
reco:caldata:DataPrepModule 5.74088 6.11416 7.08234 5.99303 0.396972 10
reco:wclsdatasp:WireCellToolkit 50.26 52.7062 54.0145 52.8847 1.21652 10
reco:gaushit:GausHitFinder 1.28841 1.72084 2.11577 1.71285 0.204507 10
reco:nhitsfilter:NumberOfHitsFilter 0.000686873 0.000867742 0.00108362 0.000846643 0.000114728 10
reco:reco3d:SpacePointSolver 8.45396 19.2638 31.7021 18.0107 6.47305 10
reco:hitpdune:DisambigFromSpacePoints 1.4533 2.90889 4.55872 2.83899 0.813954 10
reco:pandora:StandardPandora 26.6273 53.6635 89.7294 48.2196 19.2138 10
reco:pandoraWriter:StandardPandora 0.430964 0.612532 0.78787 0.623805 0.0927949 10
reco:pandoraTrack:LArPandoraTrackCreation 7.86008 11.5482 15.4043 12.4014 2.25807 10
reco:pandoraShower:LArPandoraShowerCreation 8.76072 16.0394 27.5353 16.0942 4.91087 10
reco:pandoracalo:Calorimetry 2.85187 5.1079 7.16096 5.27149 1.14749 10
reco:pandoracalonosce:Calorimetry 2.68932 4.91541 6.90775 5.04133 1.07905 10
reco:pandorapid:Chi2ParticleID 0.00506993 0.00676212 0.00894422 0.00674988 0.00100868 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0583098 0.0853419 0.123401 0.0831757 0.0163796 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00501085 0.00628986 0.00723693 0.0063505 0.000664418 10
reco:pandoraShowercalo:ShowerCalorimetry 5.47902 14.0332 25.1489 13.2363 5.23145 10
reco:pandoraShowercalonosce:ShowerCalorimetry 5.11797 13.5837 22.2814 13.3516 4.38124 10
reco:emtrkmichelid:EmTrackMichelId 169.101 225.022 285.997 226.79 32.7122 10
reco:crttag:SingleCRTMatchingProducer 0.0223525 0.0342367 0.0475731 0.0324891 0.0072545 10
reco:crtreco:TwoCRTMatchingProducer 0.0175507 0.0284593 0.0398988 0.027203 0.00608597 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.98438 1.40911 1.90238 1.38968 0.228876 10
reco:pandora2Track:LArPandoraTrackCreation 20.9986 41.0638 67.0667 39.9853 12.0139 10
reco:pandora2calo:Calorimetry 7.80198 16.5443 28.6323 16.4662 5.50458 10
reco:pandora2calonosce:Calorimetry 6.72846 15.9945 25.7248 15.8261 5.05851 10
reco:pandora2pid:Chi2ParticleID 0.0125071 0.0160507 0.0195567 0.0162139 0.0023127 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0757945 0.10286 0.135824 0.0977665 0.0169581 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0129763 0.0157571 0.0191629 0.0158853 0.00200685 10
reco:pandora2Shower:LArPandoraShowerCreation 6.43487 11.6783 21.0959 10.4801 4.54 10
reco:pandora2Showercalo:ShowerCalorimetry 6.47001 13.044 19.8488 11.9619 3.9257 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.35874 11.4868 19.8788 10.4405 4.08313 10
[art]:TriggerResults:TriggerResultInserter 4.9466e-05 7.45815e-05 0.000197589 6.04145e-05 4.15944e-05 10
end_path:out1:RootOutput 8.724e-06 1.28127e-05 2.5644e-05 1.12445e-05 4.72718e-06 10
end_path:out1:RootOutput(write) 2.37667 4.68337 10.7317 3.53755 2.46239 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5250.43 MB
Peak resident set size usage (VmHWM): 4435.36 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.73 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10850468
-rw-r--r-- 1 dunegli fnalgrid 2527110508 Jan 1 11:17 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2400140726 Jan 1 11:13 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2259516131 Jan 1 12:51 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1959775451 Jan 1 08:40 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1877487930 Jan 1 08:21 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 86218900 Jan 1 12:46 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242946 Jan 1 12:52 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 1 12:52 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 1 12:52 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 1 12:51 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 11:17 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 08:40 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 12:52 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 1 08:12 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 1 12:52 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 11:26 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 11:17 debugprod.log
