Jobsub ID 263229.0@dunegpschedd02.fnal.gov
| Jobsub ID | 263229.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11244 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-18 10:38:44 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2025-12-18 13:51:17 |
| From worker node | Hostname | dunegli-49199-0-cmswn2413.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-18 10:39:36 |
| Input files | monte-carlo-011244-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11482s) |
| CPU time | 3h (11363s = 98%) |
| Max RSS bytes | 4284039168 (4085 MiB) |
| Outputting started | 2025-12-18 13:50:59 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11244/1/001/reco_stage1.root
|
| Finished | 2025-12-18 13:51:17 |
| Saved logs | justin-logs:263229.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
asedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 154955 traces, 0 summary
Retagger: tagging trace set: gauss with 117269 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 117269 traces tagged "gauss"
FrameSaver: q=4.07594e+06 n=2094531 tag=gauss
wclsFrameSaver: saving 154955 traces tagged "wiener"
FrameSaver: q=4.34072e+06 n=1851645 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 48085 XUs and 64135 XVs -> 1050 XUVs
C:0 T:1 129259 XUs and 161469 XVs -> 11479 XUVs
C:0 T:2 128018 XUs and 114577 XVs -> 5835 XUVs
C:0 T:3 54587 XUs and 41440 XVs -> 653 XUVs
C:0 T:4 12948 XUs and 12160 XVs -> 165 XUVs
C:0 T:5 51131 XUs and 38133 XVs -> 5404 XUVs
C:0 T:6 180427 XUs and 131147 XVs -> 7702 XUVs
C:0 T:7 53442 XUs and 47847 XVs -> 442 XUVs
C:0 T:8 9603 XUs and 7564 XVs -> 114 XUVs
C:0 T:9 60556 XUs and 62763 XVs -> 4873 XUVs
C:0 T:10 68546 XUs and 44136 XVs -> 6178 XUVs
C:0 T:11 150 XUs and 103 XVs -> 20 XUVs
43915 XUVs total
15773 collection wire objects
38997 potential space points
Neighbour search...
2616265 tests to find 1233066 neighbours
Iterating with no regularization...
Begin: 1.11616e+08
0 6.318e+07
1 5.97438e+07
2 5.93334e+07
3 5.92068e+07
4 5.91498e+07
Now with regularization...
Begin: 4.49222e+07
0 4.47618e+07
1 4.47045e+07
2 4.46741e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411191437
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411191437
fLifetime: 30000 [us]
18-Dec-2025 13:50:57 UTC Closed output file "reco_stage1.root"
18-Dec-2025 13:50:57 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 224.516 353.67 441.084 374.405 68.4369 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000792114 0.00303704 0.00406203 0.00331683 0.000956952 10
reco:ophit:OpHitFinder 0.238988 0.281121 0.31384 0.277447 0.0195866 10
reco:opflash:OpFlashFinder 0.134765 0.179158 0.214302 0.174018 0.0239179 10
reco:opslicer:OpSlicer 0.530393 0.688509 0.815215 0.687619 0.0796685 10
reco:caldata:DataPrepModule 5.16644 5.32701 5.63718 5.32477 0.125569 10
reco:wclsdatasp:WireCellToolkit 31.083 34.55 37.293 35.5671 2.11316 10
reco:gaushit:GausHitFinder 0.874923 1.29267 1.51432 1.34555 0.221626 10
reco:nhitsfilter:NumberOfHitsFilter 0.000393642 0.000545045 0.000726234 0.000544379 8.55492e-05 10
reco:reco3d:SpacePointSolver 6.41617 16.2526 27.4024 17.0181 5.32613 10
reco:hitpdune:DisambigFromSpacePoints 0.900058 1.70458 2.27846 1.76303 0.452357 10
reco:pandora:StandardPandora 16.4554 40.3932 68.4015 41.8305 14.6882 10
reco:pandoraWriter:StandardPandora 0.317412 0.450474 0.540291 0.470622 0.0736225 10
reco:pandoraTrack:LArPandoraTrackCreation 2.30695 5.16075 7.61858 5.14542 1.50621 10
reco:pandoraShower:LArPandoraShowerCreation 1.7298 5.93758 8.39582 6.60876 2.01827 10
reco:pandoracalo:Calorimetry 1.16095 2.40129 3.54505 2.47487 0.666399 10
reco:pandoracalonosce:Calorimetry 1.02156 2.26561 3.19566 2.29379 0.664212 10
reco:pandorapid:Chi2ParticleID 0.00485782 0.00682744 0.00862133 0.00726483 0.00122772 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0392312 0.0518614 0.0591127 0.0550085 0.00687216 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0045929 0.00571704 0.00683022 0.00579401 0.000671909 10
reco:pandoraShowercalo:ShowerCalorimetry 1.54342 5.22476 6.68242 6.04507 1.72224 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.50177 5.34788 7.68462 6.29598 1.94646 10
reco:emtrkmichelid:EmTrackMichelId 121.182 172.567 207.099 179.87 27.0742 10
reco:crttag:SingleCRTMatchingProducer 0.00898557 0.0137041 0.0181206 0.0138206 0.00301966 10
reco:crtreco:TwoCRTMatchingProducer 0.00651496 0.0101281 0.0124353 0.0109029 0.00198208 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.704449 0.855019 1.04227 0.878323 0.109757 10
reco:pandora2Track:LArPandoraTrackCreation 6.89317 17.5645 23.5908 19.3135 5.33484 10
reco:pandora2calo:Calorimetry 2.72292 7.31728 10.6052 7.85935 2.29201 10
reco:pandora2calonosce:Calorimetry 2.41892 6.93 8.77983 8.02543 2.19563 10
reco:pandora2pid:Chi2ParticleID 0.00992061 0.016505 0.0196146 0.0173735 0.00297425 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0470334 0.0677403 0.0800799 0.071651 0.0101684 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00997525 0.0153404 0.0182208 0.0158773 0.00241307 10
reco:pandora2Shower:LArPandoraShowerCreation 2.2843 6.07552 7.54549 6.7068 1.69331 10
reco:pandora2Showercalo:ShowerCalorimetry 2.19998 6.06515 7.91864 6.63633 1.83554 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.43707 5.43154 7.37813 5.69153 1.39002 10
[art]:TriggerResults:TriggerResultInserter 3.673e-05 4.98162e-05 0.000114001 4.4e-05 2.18134e-05 10
end_path:out1:RootOutput 5.57e-06 9.8821e-06 1.532e-05 8.935e-06 2.51926e-06 10
end_path:out1:RootOutput(write) 2.22615 3.10581 3.73718 3.22211 0.481975 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5102.08 MB
Peak resident set size usage (VmHWM): 4284.04 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.43 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10273736
-rw-r--r-- 1 dunegli fnalgrid 2419644520 Dec 18 12:49 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2297733732 Dec 18 12:47 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2124193581 Dec 18 13:50 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1840855991 Dec 18 10:56 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1757569036 Dec 18 10:44 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 79679400 Dec 18 13:45 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242916 Dec 18 13:50 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 18 13:50 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 18 13:50 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 18 13:50 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 18 12:49 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 18 10:56 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 18 13:50 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 18 10:39 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 18 13:50 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 18 12:55 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 18 12:49 debugprod.log
