Jobsub ID 256481.0@dunegpschedd01.fnal.gov
| Jobsub ID | 256481.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10619 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-24 20:39:32 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2025-11-25 01:46:41 |
| From worker node | Hostname | dunegli-48327-0-cmswn2431.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-24 21:12:55 |
| Input files | monte-carlo-010619-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (16402s) |
| CPU time | 3h (13933s = 84%) |
| Max RSS bytes | 3976863744 (3792 MiB) |
| Outputting started | 2025-11-25 01:46:18 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10619/1/001/reco_stage1.root
|
| Finished | 2025-11-25 01:46:41 |
| Saved logs | justin-logs:256481.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
ice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 152191 traces, 0 summary
Retagger: tagging trace set: gauss with 115012 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 115012 traces tagged "gauss"
FrameSaver: q=4.02756e+06 n=2048454 tag=gauss
wclsFrameSaver: saving 152191 traces tagged "wiener"
FrameSaver: q=4.2733e+06 n=1814714 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 40545 XUs and 41294 XVs -> 408 XUVs
C:0 T:1 78901 XUs and 74422 XVs -> 5348 XUVs
C:0 T:2 245764 XUs and 133883 XVs -> 10692 XUVs
C:0 T:3 69376 XUs and 46418 XVs -> 573 XUVs
C:0 T:4 17326 XUs and 16633 XVs -> 173 XUVs
C:0 T:5 76082 XUs and 60723 XVs -> 6779 XUVs
C:0 T:6 95160 XUs and 90669 XVs -> 3442 XUVs
C:0 T:7 30861 XUs and 35883 XVs -> 179 XUVs
C:0 T:8 10266 XUs and 10702 XVs -> 120 XUVs
C:0 T:9 74117 XUs and 91848 XVs -> 7150 XUVs
C:0 T:10 29744 XUs and 23645 XVs -> 2639 XUVs
C:0 T:11 96 XUs and 84 XVs -> 17 XUVs
37520 XUVs total
13912 collection wire objects
33607 potential space points
Neighbour search...
1795075 tests to find 941376 neighbours
Iterating with no regularization...
Begin: 8.9697e+07
0 6.88503e+07
1 6.77526e+07
2 6.76032e+07
3 6.75609e+07
Now with regularization...
Begin: 5.64291e+07
0 5.63972e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410717109
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410717109
fLifetime: 30000 [us]
25-Nov-2025 01:46:15 UTC Closed output file "reco_stage1.root"
25-Nov-2025 01:46:15 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 301.993 451.948 644.101 446.862 103.624 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00196858 0.00455051 0.00848523 0.00443856 0.00197163 10
reco:ophit:OpHitFinder 0.250432 0.329493 0.395892 0.332409 0.0451447 10
reco:opflash:OpFlashFinder 0.110511 0.201839 0.286757 0.200794 0.0531673 10
reco:opslicer:OpSlicer 0.61492 0.833781 1.08362 0.869612 0.1323 10
reco:caldata:DataPrepModule 6.34534 6.53197 6.72557 6.51694 0.125001 10
reco:wclsdatasp:WireCellToolkit 39.2337 45.3646 48.1801 47.1395 3.24767 10
reco:gaushit:GausHitFinder 0.926544 1.41501 1.84401 1.31864 0.281742 10
reco:nhitsfilter:NumberOfHitsFilter 0.000624207 0.000889884 0.00108132 0.000906833 0.000130475 10
reco:reco3d:SpacePointSolver 8.64474 16.3604 26.9213 17.0281 5.87919 10
reco:hitpdune:DisambigFromSpacePoints 0.989062 1.85019 3.53555 1.62328 0.747122 10
reco:pandora:StandardPandora 24.4588 44.3839 82.7564 41.5443 15.6085 10
reco:pandoraWriter:StandardPandora 0.511123 0.645603 0.840594 0.629954 0.103461 10
reco:pandoraTrack:LArPandoraTrackCreation 5.72568 8.51162 12.5204 8.03562 2.09582 10
reco:pandoraShower:LArPandoraShowerCreation 5.43253 10.5191 17.5759 10.0045 3.78096 10
reco:pandoracalo:Calorimetry 2.59703 4.43683 6.98405 3.97834 1.3159 10
reco:pandoracalonosce:Calorimetry 2.37507 4.15155 6.56321 3.75465 1.25403 10
reco:pandorapid:Chi2ParticleID 0.00596559 0.00751899 0.00888381 0.00741623 0.000958983 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.051629 0.0634994 0.0775879 0.0609395 0.00787469 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00549245 0.00707526 0.00808036 0.00710004 0.000862688 10
reco:pandoraShowercalo:ShowerCalorimetry 4.97194 9.83711 17.3651 9.1813 4.16898 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.44986 9.51256 16.9406 8.73798 4.15967 10
reco:emtrkmichelid:EmTrackMichelId 142.504 200.624 263.508 196.66 35.7635 10
reco:crttag:SingleCRTMatchingProducer 0.0202248 0.0281388 0.0354983 0.0298099 0.00567019 10
reco:crtreco:TwoCRTMatchingProducer 0.0148812 0.0216859 0.0326521 0.0207931 0.00520262 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.854705 1.09068 1.54575 1.00797 0.244548 10
reco:pandora2Track:LArPandoraTrackCreation 12.1371 26.6984 40.7822 26.606 8.75083 10
reco:pandora2calo:Calorimetry 5.0856 12.6872 21.0199 12.3004 5.01903 10
reco:pandora2calonosce:Calorimetry 5.00968 11.9463 19.7855 11.8596 4.84509 10
reco:pandora2pid:Chi2ParticleID 0.0114071 0.0175003 0.0228329 0.0180672 0.00316132 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0608426 0.0806105 0.101976 0.080594 0.0129175 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0111322 0.0167732 0.0216161 0.0168875 0.00287437 10
reco:pandora2Shower:LArPandoraShowerCreation 5.24564 10.1111 15.1621 10.0879 3.13293 10
reco:pandora2Showercalo:ShowerCalorimetry 4.39447 10.5931 17.2972 10.3541 4.0603 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.26576 9.20444 15.477 9.29203 3.47226 10
[art]:TriggerResults:TriggerResultInserter 6.1621e-05 9.60035e-05 0.000218695 8.14275e-05 4.34059e-05 10
end_path:out1:RootOutput 1.348e-05 1.75736e-05 2.4471e-05 1.76605e-05 2.92856e-06 10
end_path:out1:RootOutput(write) 2.65413 3.61665 4.71417 3.48934 0.62634 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4809.26 MB
Peak resident set size usage (VmHWM): 3976.86 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.26 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9509344
-rw-r--r-- 1 dunegli fnalgrid 2257404706 Nov 25 00:28 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2138587619 Nov 25 00:25 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1930958673 Nov 25 01:46 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1708206404 Nov 24 22:01 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1629740654 Nov 24 21:32 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 72038470 Nov 25 01:38 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242655 Nov 25 01:46 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 25 01:46 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 25 01:46 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 25 01:46 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 00:28 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 22:01 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 01:46 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 24 21:12 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 25 01:46 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 00:33 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 00:28 debugprod.log
