Jobsub ID 296468.1@dunegpschedd02.fnal.gov
| Jobsub ID | 296468.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12504 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-29 09:31:46 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce511 |
| Last heartbeat | 2026-01-29 14:07:28 |
| From worker node | Hostname | b9p19p4756.cern.ch |
| cpuinfo | Intel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-29 09:32:09 |
| Input files | monte-carlo-012504-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (16435s) |
| CPU time | 4h (15775s = 95%) |
| Max RSS bytes | 4140724224 (3948 MiB) |
| Outputting started | 2026-01-29 14:06:05 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12504/1/001/reco_stage1.root
|
| Finished | 2026-01-29 14:07:28 |
| Saved logs | justin-logs:296468.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
repService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 108320 traces, 0 summary
Retagger: tagging trace set: gauss with 82249 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 82249 traces tagged "gauss"
FrameSaver: q=2.7021e+06 n=1394526 tag=gauss
wclsFrameSaver: saving 108320 traces tagged "wiener"
FrameSaver: q=2.86049e+06 n=1219573 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 22351 XUs and 18484 XVs -> 201 XUVs
C:0 T:1 46622 XUs and 37179 XVs -> 4451 XUVs
C:0 T:2 36263 XUs and 49787 XVs -> 1378 XUVs
C:0 T:3 20236 XUs and 21909 XVs -> 83 XUVs
C:0 T:4 12880 XUs and 9143 XVs -> 134 XUVs
C:0 T:5 76861 XUs and 38531 XVs -> 7069 XUVs
C:0 T:6 52617 XUs and 69629 XVs -> 2411 XUVs
C:0 T:7 21291 XUs and 29295 XVs -> 149 XUVs
C:0 T:8 6647 XUs and 4530 XVs -> 88 XUVs
C:0 T:9 78635 XUs and 52631 XVs -> 9718 XUVs
C:0 T:10 37871 XUs and 34679 XVs -> 4740 XUVs
C:0 T:11 785 XUs and 717 XVs -> 75 XUVs
30497 XUVs total
9201 collection wire objects
28838 potential space points
Neighbour search...
4392002 tests to find 1919338 neighbours
Iterating with no regularization...
Begin: 5.16468e+07
0 4.24494e+07
1 4.17984e+07
2 4.17262e+07
3 4.17071e+07
Now with regularization...
Begin: 3.43478e+07
0 3.43281e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 412035459
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412035459
fLifetime: 30000 [us]
29-Jan-2026 15:06:02 CET Closed output file "reco_stage1.root"
29-Jan-2026 15:06:02 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 444.95 639.005 843.283 591.428 141.537 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00119428 0.00314061 0.00514843 0.0032101 0.0011065 10
reco:ophit:OpHitFinder 0.300571 0.427675 0.569214 0.442704 0.0828401 10
reco:opflash:OpFlashFinder 0.211978 0.246439 0.326483 0.242264 0.0320438 10
reco:opslicer:OpSlicer 0.576968 1.01657 1.39068 1.01809 0.233502 10
reco:caldata:DataPrepModule 6.55065 9.15478 10.5411 10.1796 1.67995 10
reco:wclsdatasp:WireCellToolkit 54.0123 61.2113 67.3321 62.576 5.25369 10
reco:gaushit:GausHitFinder 1.42787 1.89615 2.70126 1.75164 0.436666 10
reco:nhitsfilter:NumberOfHitsFilter 0.000536557 0.000718483 0.000898293 0.00072239 0.000115732 10
reco:reco3d:SpacePointSolver 8.43296 20.5161 37.9778 19.5143 8.18763 10
reco:hitpdune:DisambigFromSpacePoints 1.76464 2.8644 4.58571 2.743 0.82451 10
reco:pandora:StandardPandora 27.2581 52.0319 103.41 39.784 22.5552 10
reco:pandoraWriter:StandardPandora 0.45587 0.64571 0.845114 0.641381 0.120057 10
reco:pandoraTrack:LArPandoraTrackCreation 6.66115 9.77606 14.8635 9.04708 2.77689 10
reco:pandoraShower:LArPandoraShowerCreation 5.86384 10.8297 18.2543 9.25844 3.87104 10
reco:pandoracalo:Calorimetry 2.09273 4.46842 6.76108 4.42379 1.28404 10
reco:pandoracalonosce:Calorimetry 1.91958 4.37621 6.39101 4.43128 1.22744 10
reco:pandorapid:Chi2ParticleID 0.00522635 0.0087112 0.0113926 0.00936464 0.00222815 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0611214 0.0865034 0.112301 0.089077 0.0143002 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00517094 0.00848225 0.0112866 0.00905256 0.00219536 10
reco:pandoraShowercalo:ShowerCalorimetry 4.60117 10.3936 17.9715 8.77156 3.85721 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.80109 9.95085 17.2709 8.4411 4.20787 10
reco:emtrkmichelid:EmTrackMichelId 244.361 339.533 508.76 331.876 81.1881 10
reco:crttag:SingleCRTMatchingProducer 0.0181782 0.0295218 0.0372305 0.0306754 0.00518215 10
reco:crtreco:TwoCRTMatchingProducer 0.0146276 0.0225648 0.0266474 0.0236012 0.00347573 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.994603 1.6322 2.1147 1.66689 0.25839 10
reco:pandora2Track:LArPandoraTrackCreation 15.8985 35.3135 51.7279 35.6424 12.2874 10
reco:pandora2calo:Calorimetry 6.34782 13.7078 20.6978 14.4366 5.11025 10
reco:pandora2calonosce:Calorimetry 5.31818 13.3101 20.2131 14.2581 4.92279 10
reco:pandora2pid:Chi2ParticleID 0.0120842 0.0230526 0.0315001 0.0249579 0.00721869 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0753008 0.11541 0.151505 0.117072 0.0291034 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0120314 0.0221527 0.0301477 0.0231819 0.00678585 10
reco:pandora2Shower:LArPandoraShowerCreation 5.41749 10.12 14.1772 9.84095 3.18083 10
reco:pandora2Showercalo:ShowerCalorimetry 6.32709 10.9655 16.6043 10.2477 3.89626 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.22888 10.2468 16.2331 9.20954 4.18965 10
[art]:TriggerResults:TriggerResultInserter 4.6436e-05 6.96342e-05 0.000116824 6.6295e-05 2.05212e-05 10
end_path:out1:RootOutput 6.971e-06 9.21e-06 1.3096e-05 8.7455e-06 1.70143e-06 10
end_path:out1:RootOutput(write) 2.35076 3.90475 5.61737 3.85364 1.06149 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4957.6 MB
Peak resident set size usage (VmHWM): 4140.72 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.83 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.33 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10143664
-rw-r--r--. 1 duneprd np-comp 2391642499 Jan 29 13:15 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2273621269 Jan 29 13:12 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 2067533750 Jan 29 15:06 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 1831881421 Jan 29 11:04 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1749381771 Jan 29 10:43 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp 72434800 Jan 29 15:00 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp 242865 Jan 29 15:06 jobscript.log
-rw-r--r--. 1 duneprd np-comp 217088 Jan 29 15:06 mem.db
-rw-r--r--. 1 duneprd np-comp 62376 Jan 29 15:06 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp 36864 Jan 29 15:06 time.db
-rw-r--r--. 1 duneprd np-comp 519 Jan 29 13:15 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp 519 Jan 29 11:04 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp 519 Jan 29 15:06 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp 52 Jan 29 10:32 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp 7 Jan 29 15:06 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp 0 Jan 29 13:25 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp 0 Jan 29 13:15 debugprod.log