Jobsub ID 265424.0@dunegpschedd02.fnal.gov
| Jobsub ID | 265424.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11463 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-01 16:11:23 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2026-01-01 19:54:19 |
| From worker node | Hostname | dunegli-49724-0-cmswn2357.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-01 16:26:51 |
| Input files | monte-carlo-011463-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12433s) |
| CPU time | 3h (12351s = 99%) |
| Max RSS bytes | 4331692032 (4131 MiB) |
| Outputting started | 2026-01-01 19:54:04 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11463/1/001/reco_stage1.root
|
| Finished | 2026-01-01 19:54:19 |
| Saved logs | justin-logs:265424.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ing tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 120791 traces, 0 summary
Retagger: tagging trace set: gauss with 94531 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 94531 traces tagged "gauss"
FrameSaver: q=3.3637e+06 n=1736071 tag=gauss
wclsFrameSaver: saving 120791 traces tagged "wiener"
FrameSaver: q=3.56216e+06 n=1558490 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 37940 XUs and 32791 XVs -> 1263 XUVs
C:0 T:1 78390 XUs and 64681 XVs -> 7304 XUVs
C:0 T:2 184196 XUs and 160186 XVs -> 10459 XUVs
C:0 T:3 67791 XUs and 56265 XVs -> 654 XUVs
C:0 T:4 11978 XUs and 13509 XVs -> 119 XUVs
C:0 T:5 57816 XUs and 42450 XVs -> 5645 XUVs
C:0 T:6 94978 XUs and 84907 XVs -> 2874 XUVs
C:0 T:7 42203 XUs and 32945 XVs -> 285 XUVs
C:0 T:8 7816 XUs and 8226 XVs -> 107 XUVs
C:0 T:9 47962 XUs and 59836 XVs -> 4975 XUVs
C:0 T:10 37147 XUs and 19762 XVs -> 3057 XUVs
C:0 T:11 30 XUs and 8 XVs -> 4 XUVs
36746 XUVs total
11254 collection wire objects
31663 potential space points
Neighbour search...
2133933 tests to find 1024370 neighbours
Iterating with no regularization...
Begin: 8.48685e+07
0 6.98781e+07
1 6.86302e+07
2 6.8397e+07
3 6.83195e+07
4 6.828e+07
Now with regularization...
Begin: 5.79026e+07
0 5.78557e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411477781
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411477781
fLifetime: 30000 [us]
01-Jan-2026 19:54:03 UTC Closed output file "reco_stage1.root"
01-Jan-2026 19:54:03 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 300.257 428.65 702.265 393.025 115.037 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000851206 0.00365272 0.00655214 0.00405201 0.00169705 10
reco:ophit:OpHitFinder 0.212551 0.272546 0.336361 0.273471 0.0327563 10
reco:opflash:OpFlashFinder 0.123942 0.19164 0.241545 0.192618 0.0311905 10
reco:opslicer:OpSlicer 0.522288 0.675304 0.840524 0.673106 0.102925 10
reco:caldata:DataPrepModule 5.25806 5.8443 6.19574 5.89028 0.250117 10
reco:wclsdatasp:WireCellToolkit 45.3933 58.0931 63.5476 61.1022 6.45294 10
reco:gaushit:GausHitFinder 1.08326 1.45995 1.77395 1.45487 0.229982 10
reco:nhitsfilter:NumberOfHitsFilter 0.000371662 0.000564848 0.000805315 0.000586983 0.000132986 10
reco:reco3d:SpacePointSolver 8.55603 18.4455 46.1378 15.2351 10.3275 10
reco:hitpdune:DisambigFromSpacePoints 1.46969 2.41439 3.24967 2.39538 0.538426 10
reco:pandora:StandardPandora 20.3166 67.9672 259.317 44.4782 66.9673 10
reco:pandoraWriter:StandardPandora 0.357894 0.478228 0.651003 0.458978 0.0895229 10
reco:pandoraTrack:LArPandoraTrackCreation 3.03917 5.60308 10.1176 5.26533 1.91374 10
reco:pandoraShower:LArPandoraShowerCreation 2.59493 4.86147 8.32201 4.61615 1.69282 10
reco:pandoracalo:Calorimetry 1.69074 2.87091 4.74727 2.73213 0.85489 10
reco:pandoracalonosce:Calorimetry 1.43642 2.59018 4.46007 2.45928 0.827155 10
reco:pandorapid:Chi2ParticleID 0.00486754 0.00746783 0.0124916 0.00663641 0.00207514 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0628123 0.0732286 0.0803257 0.0746504 0.00572919 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00495179 0.00670851 0.00952275 0.00650913 0.00115059 10
reco:pandoraShowercalo:ShowerCalorimetry 2.64502 5.15924 8.51159 4.90171 1.79078 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.57342 5.04883 8.30332 4.8589 1.74932 10
reco:emtrkmichelid:EmTrackMichelId 150.365 192.465 227.341 188.725 25.9248 10
reco:crttag:SingleCRTMatchingProducer 0.0144483 0.0178476 0.0218254 0.0179955 0.00235329 10
reco:crtreco:TwoCRTMatchingProducer 0.00828771 0.0107603 0.0159776 0.0103125 0.00226574 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.66031 1.92641 2.1759 1.94506 0.16031 10
reco:pandora2Track:LArPandoraTrackCreation 8.46427 16.3135 27.3886 15.4752 5.57901 10
reco:pandora2calo:Calorimetry 3.95102 7.68334 12.3571 7.70082 2.541 10
reco:pandora2calonosce:Calorimetry 3.6697 7.16295 11.6947 6.92951 2.38137 10
reco:pandora2pid:Chi2ParticleID 0.0115082 0.0165332 0.024807 0.0157271 0.00358945 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.074765 0.0926011 0.106587 0.0898496 0.0116129 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0110997 0.0163371 0.0243884 0.0154103 0.00364817 10
reco:pandora2Shower:LArPandoraShowerCreation 2.99214 5.43275 8.56634 5.35207 1.68276 10
reco:pandora2Showercalo:ShowerCalorimetry 3.47109 6.5536 10.1616 6.5779 2.00645 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.22386 6.04286 9.24771 6.16158 1.81534 10
[art]:TriggerResults:TriggerResultInserter 3.9806e-05 6.46658e-05 0.000140667 5.73905e-05 2.67309e-05 10
end_path:out1:RootOutput 9.723e-06 1.37231e-05 2.6954e-05 1.0962e-05 6.00118e-06 10
end_path:out1:RootOutput(write) 2.16036 2.76236 3.31945 2.65049 0.380948 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5149.35 MB
Peak resident set size usage (VmHWM): 4331.69 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.73 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10206700
-rw-r--r-- 1 dunegli fnalgrid 2409464261 Jan 1 18:40 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2287753042 Jan 1 18:38 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2095202789 Jan 1 19:54 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1824705779 Jan 1 16:44 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1758436852 Jan 1 16:31 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 75481360 Jan 1 19:49 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243355 Jan 1 19:54 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 1 19:54 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 1 19:54 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 1 19:54 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 18:40 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 16:44 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 19:54 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 1 16:26 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 1 19:54 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 18:46 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 18:40 debugprod.log
