Jobsub ID 236767.0@dunegpschedd02.fnal.gov
| Jobsub ID | 236767.0@dunegpschedd02.fnal.gov |
| Workflow ID | 9563 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-03 17:01:07 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-03 20:27:27 |
| From worker node | Hostname | dunegli-7472846-0-fnpc17119.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-03 17:05:54 |
| Input files | monte-carlo-009563-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12078s) |
| CPU time | 3h (11002s = 91%) |
| Max RSS bytes | 4112822272 (3922 MiB) |
| Outputting started | 2025-11-03 20:27:13 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09563/1/001/reco_stage1.root
|
| Finished | 2025-11-03 20:27:27 |
| Saved logs | justin-logs:236767.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
leKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 152917 traces, 0 summary
Retagger: tagging trace set: gauss with 109952 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 109952 traces tagged "gauss"
FrameSaver: q=3.99596e+06 n=1868333 tag=gauss
wclsFrameSaver: saving 152917 traces tagged "wiener"
FrameSaver: q=4.28249e+06 n=1638756 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38391 XUs and 45466 XVs -> 814 XUVs
C:0 T:1 74618 XUs and 81323 XVs -> 6085 XUVs
C:0 T:2 109882 XUs and 152246 XVs -> 6564 XUVs
C:0 T:3 49541 XUs and 59958 XVs -> 464 XUVs
C:0 T:4 10275 XUs and 10700 XVs -> 203 XUVs
C:0 T:5 39512 XUs and 27245 XVs -> 4023 XUVs
C:0 T:6 209481 XUs and 166840 XVs -> 31592 XUVs
C:0 T:7 54074 XUs and 52416 XVs -> 990 XUVs
C:0 T:8 7355 XUs and 6003 XVs -> 128 XUVs
C:0 T:9 68145 XUs and 53782 XVs -> 8781 XUVs
C:0 T:10 66539 XUs and 77618 XVs -> 38537 XUVs
C:0 T:11 54 XUs and 40 XVs -> 13 XUVs
98194 XUVs total
12267 collection wire objects
92052 potential space points
Neighbour search...
26232502 tests to find 10610014 neighbours
Iterating with no regularization...
Begin: 9.72936e+07
0 7.50022e+07
1 7.36896e+07
2 7.34879e+07
3 7.34289e+07
Now with regularization...
Begin: 6.09291e+07
0 6.08123e+07
1 6.07369e+07
2 6.06772e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410291519
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410291519
fLifetime: 30000 [us]
03-Nov-2025 20:27:11 UTC Closed output file "reco_stage1.root"
03-Nov-2025 20:27:11 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 198.953 327.221 463.303 313.813 77.1237 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00081219 0.00347555 0.00507824 0.00382217 0.00139895 10
reco:ophit:OpHitFinder 0.19933 0.254902 0.291069 0.26032 0.0272731 10
reco:opflash:OpFlashFinder 0.139716 0.199894 0.25039 0.202933 0.0302258 10
reco:opslicer:OpSlicer 0.43412 0.580926 0.691833 0.595043 0.0909802 10
reco:caldata:DataPrepModule 5.16662 5.43874 5.80229 5.41712 0.230918 10
reco:wclsdatasp:WireCellToolkit 41.7702 46.2872 51.266 45.135 3.46645 10
reco:gaushit:GausHitFinder 0.809985 1.19334 1.54088 1.16659 0.215758 10
reco:nhitsfilter:NumberOfHitsFilter 0.000440368 0.000624957 0.000724648 0.000617401 9.14447e-05 10
reco:reco3d:SpacePointSolver 4.00737 14.3109 40.7515 11.6401 9.32385 10
reco:hitpdune:DisambigFromSpacePoints 0.746632 1.6622 2.48365 1.59205 0.489001 10
reco:pandora:StandardPandora 15.3941 26.1853 39.6967 23.4871 8.23383 10
reco:pandoraWriter:StandardPandora 0.274694 0.419505 0.521381 0.412092 0.0765069 10
reco:pandoraTrack:LArPandoraTrackCreation 2.41781 5.80645 11.3641 5.63015 2.51562 10
reco:pandoraShower:LArPandoraShowerCreation 1.69076 5.11592 11.8437 4.39315 2.85476 10
reco:pandoracalo:Calorimetry 1.06759 2.65596 5.06753 2.73044 1.05329 10
reco:pandoracalonosce:Calorimetry 0.933604 2.47721 4.86109 2.45941 1.0795 10
reco:pandorapid:Chi2ParticleID 0.00384104 0.00513434 0.00649618 0.00517534 0.000664611 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0364055 0.0566907 0.0721131 0.058173 0.0103252 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00370773 0.00488766 0.00628067 0.00486445 0.000679339 10
reco:pandoraShowercalo:ShowerCalorimetry 1.53672 4.80759 8.75132 4.23934 2.33613 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.48847 4.56339 7.97003 4.14334 2.15864 10
reco:emtrkmichelid:EmTrackMichelId 99.0026 154.882 198.559 151.531 29.2997 10
reco:crttag:SingleCRTMatchingProducer 0.0133133 0.0227688 0.0335591 0.0215239 0.00577431 10
reco:crtreco:TwoCRTMatchingProducer 0.00735485 0.0142615 0.0210411 0.013585 0.00548205 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.73082 1.11492 1.434 1.1584 0.20088 10
reco:pandora2Track:LArPandoraTrackCreation 5.88575 16.7883 26.789 15.4134 7.04397 10
reco:pandora2calo:Calorimetry 2.52199 6.80821 10.0751 6.42535 2.59988 10
reco:pandora2calonosce:Calorimetry 2.426 6.60457 10.2868 6.74953 2.61659 10
reco:pandora2pid:Chi2ParticleID 0.00769584 0.0114241 0.0151843 0.0113433 0.00215165 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0446981 0.0699641 0.0916509 0.0696413 0.0140118 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00788693 0.011405 0.014639 0.0111164 0.00209801 10
reco:pandora2Shower:LArPandoraShowerCreation 1.96698 4.94992 7.68937 4.99123 1.89274 10
reco:pandora2Showercalo:ShowerCalorimetry 2.07425 5.93924 9.22295 6.02487 2.39403 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.0601 5.40757 8.22399 5.81209 2.09445 10
[art]:TriggerResults:TriggerResultInserter 4.7495e-05 6.52333e-05 0.000124986 6.0814e-05 2.10423e-05 10
end_path:out1:RootOutput 7.76e-06 1.09112e-05 1.5451e-05 1.103e-05 1.97663e-06 10
end_path:out1:RootOutput(write) 1.40201 2.42934 3.23109 2.46004 0.535094 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4925.99 MB
Peak resident set size usage (VmHWM): 4112.82 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.34 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9704236
-rw-r--r-- 1 dunegli fnalgrid 2290792585 Nov 3 19:30 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2175020135 Nov 3 19:28 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1947278050 Nov 3 20:27 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1763985643 Nov 3 17:38 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1692189153 Nov 3 17:23 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 67241700 Nov 3 20:21 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242869 Nov 3 20:27 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 3 20:27 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 3 20:27 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 3 20:27 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 19:30 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 17:38 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 20:27 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 3 17:05 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 3 20:27 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 19:34 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 19:30 debugprod.log
