Jobsub ID 275409.0@dunegpschedd02.fnal.gov
| Jobsub ID | 275409.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12078 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-18 15:13:52 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce03 |
| Last heartbeat | 2026-01-18 19:43:54 |
| From worker node | Hostname | ccwcondor0636 |
| cpuinfo | AMD EPYC 7453 28-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-18 15:15:39 |
| Input files | monte-carlo-012078-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15944s) |
| CPU time | 4h (15216s = 95%) |
| Max RSS bytes | 4813451264 (4590 MiB) |
| Outputting started | 2026-01-18 19:41:25 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12078/1/001/reco_stage1.root
|
| Finished | 2026-01-18 19:43:54 |
| Saved logs | justin-logs:275409.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
pare: Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 117423 traces, 0 summary
Retagger: tagging trace set: gauss with 90147 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 90147 traces tagged "gauss"
FrameSaver: q=3.151e+06 n=1593944 tag=gauss
wclsFrameSaver: saving 117423 traces tagged "wiener"
FrameSaver: q=3.32149e+06 n=1413915 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 22121 XUs and 28399 XVs -> 177 XUVs
C:0 T:1 37722 XUs and 42456 XVs -> 3874 XUVs
C:0 T:2 105693 XUs and 124796 XVs -> 8306 XUVs
C:0 T:3 48303 XUs and 53319 XVs -> 1065 XUVs
C:0 T:4 6738 XUs and 7999 XVs -> 47 XUVs
C:0 T:5 17409 XUs and 14118 XVs -> 1195 XUVs
C:0 T:6 146786 XUs and 129521 XVs -> 14890 XUVs
C:0 T:7 64734 XUs and 48065 XVs -> 4660 XUVs
C:0 T:8 8116 XUs and 7518 XVs -> 69 XUVs
C:0 T:9 42321 XUs and 53267 XVs -> 2764 XUVs
C:0 T:10 29868 XUs and 19143 XVs -> 4094 XUVs
C:0 T:11 404 XUs and 318 XVs -> 58 XUVs
41199 XUVs total
9803 collection wire objects
35973 potential space points
Neighbour search...
5659665 tests to find 2483892 neighbours
Iterating with no regularization...
Begin: 7.81956e+07
0 7.01745e+07
1 6.95626e+07
2 6.94799e+07
3 6.94587e+07
Now with regularization...
Begin: 6.02717e+07
0 6.02422e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411818943
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411818943
fLifetime: 30000 [us]
18-Jan-2026 20:41:19 CET Closed output file "reco_stage1.root"
18-Jan-2026 20:41:19 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 397.444 549.569 697.685 555.864 82.1452 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00153339 0.00618925 0.0212577 0.00488569 0.00546769 10
reco:ophit:OpHitFinder 0.381196 0.419233 0.479157 0.418738 0.0296002 10
reco:opflash:OpFlashFinder 0.211897 0.275033 0.361739 0.271998 0.041763 10
reco:opslicer:OpSlicer 0.913077 1.03783 1.18044 1.00092 0.0819327 10
reco:caldata:DataPrepModule 6.8136 7.31405 9.38504 7.08926 0.717807 10
reco:wclsdatasp:WireCellToolkit 39.6415 42.81 52.1335 40.6224 4.41358 10
reco:gaushit:GausHitFinder 1.43911 1.88201 2.17901 1.86936 0.232111 10
reco:nhitsfilter:NumberOfHitsFilter 0.000587339 0.000747364 0.0010712 0.000711096 0.000130349 10
reco:reco3d:SpacePointSolver 19.4778 29.0559 57.1981 26.5728 10.3416 10
reco:hitpdune:DisambigFromSpacePoints 1.71961 2.73201 3.76126 2.81969 0.603192 10
reco:pandora:StandardPandora 31.0184 58.5749 89.0933 60.6651 16.4379 10
reco:pandoraWriter:StandardPandora 0.487695 0.651706 0.750705 0.686923 0.0848806 10
reco:pandoraTrack:LArPandoraTrackCreation 6.89299 8.76368 10.9173 8.35326 1.29259 10
reco:pandoraShower:LArPandoraShowerCreation 6.11322 10.9808 14.4596 11.0279 2.68653 10
reco:pandoracalo:Calorimetry 3.62595 5.09103 7.30105 4.99464 1.05367 10
reco:pandoracalonosce:Calorimetry 3.70613 4.99935 6.80151 4.83428 1.02112 10
reco:pandorapid:Chi2ParticleID 0.00780422 0.0109796 0.0184939 0.00938566 0.00369012 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0659143 0.101922 0.224582 0.0870235 0.0433338 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00689259 0.00957882 0.0198936 0.00858935 0.00353535 10
reco:pandoraShowercalo:ShowerCalorimetry 7.04024 12.4973 15.9437 13.3677 3.10033 10
reco:pandoraShowercalonosce:ShowerCalorimetry 6.94137 12.1036 15.9499 11.8011 2.40744 10
reco:emtrkmichelid:EmTrackMichelId 189.982 254.073 289.811 261.708 29.946 10
reco:crttag:SingleCRTMatchingProducer 0.0202291 0.030714 0.0454751 0.0271299 0.00968167 10
reco:crtreco:TwoCRTMatchingProducer 0.0152822 0.0196295 0.0245495 0.0193691 0.00291884 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.803178 1.24156 1.97594 1.26294 0.311725 10
reco:pandora2Track:LArPandoraTrackCreation 18.5863 27.9819 37.5243 27.6137 5.47441 10
reco:pandora2calo:Calorimetry 10.5523 15.251 19.6208 15.9846 2.97662 10
reco:pandora2calonosce:Calorimetry 10.278 14.6365 19.5905 14.5754 2.90286 10
reco:pandora2pid:Chi2ParticleID 0.0170589 0.0211709 0.0244426 0.0219069 0.00243933 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.077626 0.108637 0.123746 0.111578 0.0131466 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0156925 0.0209715 0.0238059 0.0217773 0.00250642 10
reco:pandora2Shower:LArPandoraShowerCreation 6.97664 9.61183 12.9 9.43135 1.94302 10
reco:pandora2Showercalo:ShowerCalorimetry 7.5873 12.4754 16.9301 12.313 2.7958 10
reco:pandora2Showercalonosce:ShowerCalorimetry 7.08157 10.7316 14.5556 10.1688 2.15379 10
[art]:TriggerResults:TriggerResultInserter 4.7749e-05 9.0832e-05 0.000198431 7.6734e-05 3.95163e-05 10
end_path:out1:RootOutput 9.117e-06 1.26115e-05 2.094e-05 1.2037e-05 2.94582e-06 10
end_path:out1:RootOutput(write) 3.08506 3.85449 4.7155 3.87606 0.489311 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5630.33 MB
Peak resident set size usage (VmHWM): 4813.45 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.33 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.65 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11896708
-rw-r--r-- 1 dune001 lbno 2721406099 Jan 18 19:06 detsim_stage2.root
-rw-r--r-- 1 dune001 lbno 2580401099 Jan 18 19:03 detsim_stage1.root
-rw-r--r-- 1 dune001 lbno 2457798120 Jan 18 20:41 reco_stage1.root
-rw-r--r-- 1 dune001 lbno 2206083203 Jan 18 16:42 g4_stage2.root
-rw-r--r-- 1 dune001 lbno 2129528680 Jan 18 16:25 g4_stage1.root
-rw-r--r-- 1 dune001 lbno 86398970 Jan 18 20:36 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno 243088 Jan 18 20:41 jobscript.log
-rw-r--r-- 1 dune001 lbno 217088 Jan 18 20:41 mem.db
-rw-r--r-- 1 dune001 lbno 62376 Jan 18 20:41 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno 36864 Jan 18 20:41 time.db
-rw-r--r-- 1 dune001 lbno 519 Jan 18 19:06 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno 519 Jan 18 16:42 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno 519 Jan 18 20:41 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 lbno 52 Jan 18 16:15 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno 7 Jan 18 20:41 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno 0 Jan 18 19:15 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno 0 Jan 18 19:06 debugprod.log