Jobsub ID 265101.1@dunegpschedd02.fnal.gov
| Jobsub ID | 265101.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11416 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-30 14:14:44 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2025-12-30 17:22:00 |
| From worker node | Hostname | gpu01.pic.es |
| cpuinfo | Intel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-30 14:15:51 |
| Input files | monte-carlo-011416-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11132s) |
| CPU time | 3h (10874s = 97%) |
| Max RSS bytes | 4167032832 (3973 MiB) |
| Outputting started | 2025-12-30 17:21:25 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11416/1/001/reco_stage1.root
|
| Finished | 2025-12-30 17:22:00 |
| Saved logs | justin-logs:265101.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 161527 traces, 0 summary
Retagger: tagging trace set: gauss with 120696 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 120696 traces tagged "gauss"
FrameSaver: q=4.28349e+06 n=2113926 tag=gauss
wclsFrameSaver: saving 161527 traces tagged "wiener"
FrameSaver: q=4.5474e+06 n=1856694 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 53850 XUs and 47799 XVs -> 800 XUVs
C:0 T:1 173990 XUs and 112444 XVs -> 15074 XUVs
C:0 T:2 189570 XUs and 221592 XVs -> 13029 XUVs
C:0 T:3 77240 XUs and 77737 XVs -> 1120 XUVs
C:0 T:4 12580 XUs and 12093 XVs -> 448 XUVs
C:0 T:5 121814 XUs and 125128 XVs -> 24276 XUVs
C:0 T:6 92088 XUs and 104006 XVs -> 4835 XUVs
C:0 T:7 36981 XUs and 41542 XVs -> 281 XUVs
C:0 T:8 5573 XUs and 4380 XVs -> 26 XUVs
C:0 T:9 47535 XUs and 41862 XVs -> 4133 XUVs
C:0 T:10 48506 XUs and 34690 XVs -> 4792 XUVs
C:0 T:11 1966 XUs and 3094 XVs -> 429 XUVs
69243 XUVs total
14604 collection wire objects
63357 potential space points
Neighbour search...
10259601 tests to find 4661420 neighbours
Iterating with no regularization...
Begin: 8.00062e+07
0 6.38231e+07
1 6.26475e+07
2 6.24524e+07
3 6.23926e+07
Now with regularization...
Begin: 5.00684e+07
0 4.99986e+07
1 4.99477e+07
2 4.99086e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411435901
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411435901
fLifetime: 30000 [us]
30-Dec-2025 18:21:20 CET Closed output file "reco_stage1.root"
30-Dec-2025 18:21:20 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 242.848 450.806 606.007 465.214 114.713 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00105579 0.0031955 0.00512023 0.00330945 0.00117532 10
reco:ophit:OpHitFinder 0.218663 0.262854 0.305171 0.263368 0.02617 10
reco:opflash:OpFlashFinder 0.149371 0.207682 0.269797 0.203931 0.0370841 10
reco:opslicer:OpSlicer 0.49428 0.635623 0.737588 0.653032 0.0814621 10
reco:caldata:DataPrepModule 4.98568 5.29947 5.67375 5.29839 0.174154 10
reco:wclsdatasp:WireCellToolkit 42.5673 45.8815 48.1722 46.1211 1.55442 10
reco:gaushit:GausHitFinder 1.05155 1.52644 2.03221 1.54249 0.294549 10
reco:nhitsfilter:NumberOfHitsFilter 0.000475393 0.000691996 0.00102861 0.000648753 0.000151009 10
reco:reco3d:SpacePointSolver 4.68447 15.3767 26.5711 15.2094 6.00621 10
reco:hitpdune:DisambigFromSpacePoints 1.27511 2.3997 3.25136 2.40779 0.763405 10
reco:pandora:StandardPandora 17.0712 49.9049 95.59 43.5433 26.4196 10
reco:pandoraWriter:StandardPandora 0.308463 0.633111 1.30047 0.556073 0.29766 10
reco:pandoraTrack:LArPandoraTrackCreation 4.17812 9.36884 13.9876 9.01809 3.01852 10
reco:pandoraShower:LArPandoraShowerCreation 3.46168 11.346 18.2092 11.3084 4.16775 10
reco:pandoracalo:Calorimetry 1.78795 4.30837 6.46538 4.15943 1.435 10
reco:pandoracalonosce:Calorimetry 1.59034 4.07641 6.15399 3.96103 1.39091 10
reco:pandorapid:Chi2ParticleID 0.00415219 0.0058669 0.00763101 0.00572564 0.00103716 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0444509 0.0654875 0.0804439 0.0674788 0.0111693 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00408058 0.00560564 0.00680538 0.00543357 0.000849326 10
reco:pandoraShowercalo:ShowerCalorimetry 2.91398 10.2725 17.2377 10.1632 4.09461 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.75934 9.91539 16.6551 9.73816 4.00222 10
reco:emtrkmichelid:EmTrackMichelId 119.806 188.324 243.756 187.501 37.8646 10
reco:crttag:SingleCRTMatchingProducer 0.0146289 0.0252389 0.0363102 0.0252201 0.00556195 10
reco:crtreco:TwoCRTMatchingProducer 0.0125399 0.0212936 0.0271271 0.0229683 0.00448918 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.832285 1.25709 1.57741 1.26312 0.228396 10
reco:pandora2Track:LArPandoraTrackCreation 11.3074 31.3926 45.9914 31.3619 10.4871 10
reco:pandora2calo:Calorimetry 4.21552 13.2123 20.7322 13.647 4.75881 10
reco:pandora2calonosce:Calorimetry 3.86247 12.4089 19.4709 12.7519 4.48412 10
reco:pandora2pid:Chi2ParticleID 0.00896185 0.0146487 0.0207507 0.0145823 0.00320196 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0538481 0.0832349 0.109337 0.084194 0.015184 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00937586 0.0144317 0.0199084 0.0144486 0.00284062 10
reco:pandora2Shower:LArPandoraShowerCreation 2.93728 9.49564 13.9256 9.86495 3.20059 10
reco:pandora2Showercalo:ShowerCalorimetry 3.3869 10.5481 16.4537 10.5688 3.7405 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.85327 9.16761 13.6915 9.56168 3.2001 10
[art]:TriggerResults:TriggerResultInserter 3.6807e-05 5.57859e-05 0.000119502 4.7624e-05 2.31164e-05 10
end_path:out1:RootOutput 7.599e-06 9.3573e-06 1.5658e-05 8.618e-06 2.22884e-06 10
end_path:out1:RootOutput(write) 1.7087 3.19605 4.38 3.34844 0.853928 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4971.74 MB
Peak resident set size usage (VmHWM): 4167.03 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10241504
-rw-r--r-- 1 dune001 dune 2410079275 Dec 30 17:04 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2290549443 Dec 30 17:01 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2108148651 Dec 30 18:21 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1845655756 Dec 30 15:36 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1754030030 Dec 30 15:21 g4_stage1.root
-rw-r--r-- 1 dune001 dune 78206940 Dec 30 18:15 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242919 Dec 30 18:21 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Dec 30 18:21 mem.db
-rw-r--r-- 1 dune001 dune 62376 Dec 30 18:21 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Dec 30 18:21 time.db
-rw-r--r-- 1 dune001 dune 519 Dec 30 17:04 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Dec 30 15:36 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Dec 30 18:21 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Dec 30 15:15 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Dec 30 18:21 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Dec 30 17:12 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Dec 30 17:04 debugprod.log
