Jobsub ID 275663.0@dunegpschedd02.fnal.gov
| Jobsub ID | 275663.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12081 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-18 21:40:10 |
| Site | IT_CNAF |
| Entry | CMSHTPC_T1_IT_CNAF_condor_ce02 |
| Last heartbeat | 2026-01-19 03:27:38 |
| From worker node | Hostname | wn-f01-16-04-01.cr.cnaf.infn.it |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2697 v4 @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-18 21:44:44 |
| Input files | monte-carlo-012081-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (20507s) |
| CPU time | 5h (19982s = 97%) |
| Max RSS bytes | 4560027648 (4348 MiB) |
| Outputting started | 2026-01-19 03:26:32 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12081/1/001/reco_stage1.root
|
| Finished | 2026-01-19 03:27:38 |
| Saved logs | justin-logs:275663.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
ice:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 126645 traces, 0 summary
Retagger: tagging trace set: gauss with 100312 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 100312 traces tagged "gauss"
FrameSaver: q=3.4887e+06 n=1819352 tag=gauss
wclsFrameSaver: saving 126645 traces tagged "wiener"
FrameSaver: q=3.65213e+06 n=1623064 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 28689 XUs and 26848 XVs -> 275 XUVs
C:0 T:1 57102 XUs and 52895 XVs -> 3793 XUVs
C:0 T:2 86378 XUs and 106281 XVs -> 3504 XUVs
C:0 T:3 45439 XUs and 45792 XVs -> 290 XUVs
C:0 T:4 17923 XUs and 16066 XVs -> 138 XUVs
C:0 T:5 75733 XUs and 59521 XVs -> 5270 XUVs
C:0 T:6 66780 XUs and 57774 XVs -> 2813 XUVs
C:0 T:7 25679 XUs and 21850 XVs -> 257 XUVs
C:0 T:8 10231 XUs and 11446 XVs -> 170 XUVs
C:0 T:9 62076 XUs and 90672 XVs -> 5054 XUVs
C:0 T:10 18440 XUs and 13382 XVs -> 2669 XUVs
C:0 T:11 204 XUs and 127 XVs -> 36 XUVs
24269 XUVs total
11454 collection wire objects
22347 potential space points
Neighbour search...
839457 tests to find 472506 neighbours
Iterating with no regularization...
Begin: 7.58039e+07
0 6.62507e+07
1 6.56437e+07
2 6.55683e+07
3 6.55464e+07
Now with regularization...
Begin: 5.57453e+07
0 5.57347e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411824354
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411824354
fLifetime: 30000 [us]
19-Jan-2026 04:26:30 CET Closed output file "reco_stage1.root"
19-Jan-2026 04:26:30 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 454.356 773.217 1020.79 773.771 163.825 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00157216 0.00471592 0.00686663 0.00519677 0.00183977 10
reco:ophit:OpHitFinder 0.304812 0.441571 0.52891 0.465351 0.0674198 10
reco:opflash:OpFlashFinder 0.215222 0.268664 0.32663 0.273965 0.0337349 10
reco:opslicer:OpSlicer 0.927163 1.20605 1.47979 1.23267 0.190019 10
reco:caldata:DataPrepModule 6.89236 8.49058 9.74461 8.94729 1.00635 10
reco:wclsdatasp:WireCellToolkit 46.6976 60.8137 72.014 61.5259 8.18999 10
reco:gaushit:GausHitFinder 1.59381 2.53335 3.3578 2.70928 0.672597 10
reco:nhitsfilter:NumberOfHitsFilter 0.000679096 0.000941284 0.00113077 0.000957511 0.00015701 10
reco:reco3d:SpacePointSolver 12.27 24.1741 43.9598 21.985 8.81315 10
reco:hitpdune:DisambigFromSpacePoints 2.57763 4.79121 7.1958 4.45818 1.67561 10
reco:pandora:StandardPandora 35.7279 79.4272 116.532 82.0332 24.4629 10
reco:pandoraWriter:StandardPandora 0.498742 0.805731 1.08271 0.858177 0.179871 10
reco:pandoraTrack:LArPandoraTrackCreation 8.60982 14.9217 19.7887 15.5864 3.2391 10
reco:pandoraShower:LArPandoraShowerCreation 9.53017 17.4969 26.4548 16.575 5.0827 10
reco:pandoracalo:Calorimetry 3.79894 7.08712 9.31429 7.53318 1.67451 10
reco:pandoracalonosce:Calorimetry 3.73722 6.47989 8.80249 6.90961 1.63615 10
reco:pandorapid:Chi2ParticleID 0.00666443 0.0116164 0.0144878 0.0129362 0.00279137 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0730752 0.110465 0.141991 0.115569 0.0252701 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00642958 0.0112336 0.0142854 0.012485 0.00300693 10
reco:pandoraShowercalo:ShowerCalorimetry 9.50943 16.1974 25.8913 14.3954 5.48631 10
reco:pandoraShowercalonosce:ShowerCalorimetry 9.0528 16.0189 25.6331 15.0707 5.4438 10
reco:emtrkmichelid:EmTrackMichelId 200.834 350.249 439.917 366.81 71.4827 10
reco:crttag:SingleCRTMatchingProducer 0.0311421 0.0396529 0.0489498 0.0407185 0.00495775 10
reco:crtreco:TwoCRTMatchingProducer 0.0266598 0.0319908 0.0368869 0.0326948 0.00316419 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.96946 2.36228 2.6844 2.40683 0.182391 10
reco:pandora2Track:LArPandoraTrackCreation 30.4139 55.1417 75.4465 57.4638 12.8527 10
reco:pandora2calo:Calorimetry 11.9305 24.1332 34.294 25.5541 6.17323 10
reco:pandora2calonosce:Calorimetry 11.6037 22.4195 30.6148 22.2909 5.50532 10
reco:pandora2pid:Chi2ParticleID 0.016193 0.0335489 0.0424434 0.0343811 0.00682724 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.106239 0.158665 0.188856 0.163652 0.0247887 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0266759 0.0324916 0.0387225 0.032652 0.00339817 10
reco:pandora2Shower:LArPandoraShowerCreation 7.85299 15.49 21.5623 16.9164 4.79275 10
reco:pandora2Showercalo:ShowerCalorimetry 10.3936 19.652 26.827 22.2702 5.98949 10
reco:pandora2Showercalonosce:ShowerCalorimetry 8.08129 17.166 25.3718 20.6001 6.41397 10
[art]:TriggerResults:TriggerResultInserter 5.646e-05 9.25265e-05 0.000213025 8.48755e-05 4.17447e-05 10
end_path:out1:RootOutput 1.035e-05 1.37328e-05 2.0821e-05 1.35415e-05 2.76864e-06 10
end_path:out1:RootOutput(write) 2.90795 4.85003 6.4426 5.40658 1.28963 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5367.62 MB
Peak resident set size usage (VmHWM): 4560.03 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.34 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.27 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11671552
-rw-r--r-- 1 neutrino002 neutrino 2687717363 Jan 19 02:13 detsim_stage2.root
-rw-r--r-- 1 neutrino002 neutrino 2552814240 Jan 19 02:09 detsim_stage1.root
-rw-r--r-- 1 neutrino002 neutrino 2416577163 Jan 19 04:26 reco_stage1.root
-rw-r--r-- 1 neutrino002 neutrino 2153600537 Jan 18 23:19 g4_stage2.root
-rw-r--r-- 1 neutrino002 neutrino 2055764428 Jan 18 22:55 g4_stage1.root
-rw-r--r-- 1 neutrino002 neutrino 84570110 Jan 19 04:20 Pandora_Events.pndr
-rw-r--r-- 1 neutrino002 neutrino 242986 Jan 19 04:26 jobscript.log
-rw-r--r-- 1 neutrino002 neutrino 217088 Jan 19 04:26 mem.db
-rw-r--r-- 1 neutrino002 neutrino 62376 Jan 19 04:26 Pandora_Geometry.xml
-rw-r--r-- 1 neutrino002 neutrino 36864 Jan 19 04:26 time.db
-rw-r--r-- 1 neutrino002 neutrino 519 Jan 19 02:13 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 neutrino002 neutrino 519 Jan 18 23:19 g4_protoDUNE_hist.root
-rw-r--r-- 1 neutrino002 neutrino 519 Jan 19 04:26 protoDUNE_reco1_hist.root
-rw-r--r-- 1 neutrino002 neutrino 52 Jan 18 22:44 all-input-dids.txt
-rw-r--r-- 1 neutrino002 neutrino 7 Jan 19 04:26 justin-processed-pfns.txt
-rw-r--r-- 1 neutrino002 neutrino 0 Jan 19 02:23 ProtoDUNE.log
-rw-r--r-- 1 neutrino002 neutrino 0 Jan 19 02:13 debugprod.log
