justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 235434.0@dunegpschedd01.fnal.gov

Jobsub ID235434.0@dunegpschedd01.fnal.gov
Workflow ID9085
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-17 10:20:52
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2025-10-17 12:24:43
From worker nodeHostnamecomp17-02
cpuinfoIntel(R) Xeon(R) 6767P
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-17 10:22:10
Input filesmonte-carlo-009085-000001
JobscriptExit code0
Real time2h (7268s)
CPU time1h (6829s = 93%)
Max RSS bytes4371755008 (4169 MiB)
Outputting started2025-10-17 12:23:19
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09085/1/001/reco_stage1.root
Finished2025-10-17 12:24:43
Saved logsjustin-logs:235434.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

vice:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 141897 traces, 0 summary
Retagger: tagging trace set: gauss with 105081 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 105081 traces tagged "gauss"
FrameSaver: q=3.74361e+06 n=1843195 tag=gauss
wclsFrameSaver: saving 141897 traces tagged "wiener"
FrameSaver: q=3.98111e+06 n=1619931 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 45202 XUs and 34058 XVs -> 553 XUVs
C:0 T:1 95630 XUs and 77525 XVs -> 7926 XUVs
C:0 T:2 104638 XUs and 101646 XVs -> 5436 XUVs
C:0 T:3 47374 XUs and 40848 XVs -> 328 XUVs
C:0 T:4 11047 XUs and 17324 XVs -> 130 XUVs
C:0 T:5 44669 XUs and 50254 XVs -> 4673 XUVs
C:0 T:6 94717 XUs and 75057 XVs -> 5737 XUVs
C:0 T:7 37568 XUs and 23805 XVs -> 237 XUVs
C:0 T:8 8518 XUs and 10586 XVs -> 124 XUVs
C:0 T:9 62486 XUs and 113540 XVs -> 10244 XUVs
C:0 T:10 54159 XUs and 55028 XVs -> 12964 XUVs
C:0 T:11 241 XUs and 259 XVs -> 28 XUVs
48380 XUVs total
13678 collection wire objects
44998 potential space points
Neighbour search...
5101774 tests to find 2325478 neighbours
Iterating with no regularization...
Begin: 7.79371e+07
0 6.13313e+07
1 5.98199e+07
2 5.95515e+07
3 5.94747e+07
4 5.94425e+07
Now with regularization...
Begin: 4.60035e+07
0 4.59198e+07
1 4.58794e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 409944005
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 409944005
fLifetime: 30000 [us]
17-Oct-2025 13:23:11 BST  Closed output file "reco_stage1.root"
17-Oct-2025 13:23:11 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          167.46        261.624       337.822       271.122       49.9467        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000630388   0.00353643    0.00610963    0.00363194    0.00159858       10     
reco:ophit:OpHitFinder                             0.160769      0.206667      0.222986      0.211785      0.0173136       10     
reco:opflash:OpFlashFinder                         0.0626441     0.111545      0.124937      0.119214      0.0180014       10     
reco:opslicer:OpSlicer                             0.272286      0.379564      0.443348      0.369813      0.0465947       10     
reco:caldata:DataPrepModule                         3.29447       3.42239       3.53308       3.41395      0.063458        10     
reco:wclsdatasp:WireCellToolkit                     30.8186       32.7635       35.0189       32.7319       1.29797        10     
reco:gaushit:GausHitFinder                         0.495615      0.752589      0.928109       0.77689      0.127589        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000445179   0.000626734   0.000713125   0.000643068   8.3714e-05       10     
reco:reco3d:SpacePointSolver                        4.59283       9.9338        24.4046       7.64281       5.8992         10     
reco:hitpdune:DisambigFromSpacePoints              0.556459      0.978703       1.36375       1.01211      0.222384        10     
reco:pandora:StandardPandora                        13.4574       29.5134       47.874        30.2752       10.7298        10     
reco:pandoraWriter:StandardPandora                 0.237518      0.343963      0.407862      0.353094      0.0437777       10     
reco:pandoraTrack:LArPandoraTrackCreation           3.14467       5.06337       6.24887       5.48548      0.974779        10     
reco:pandoraShower:LArPandoraShowerCreation         3.09497        6.406        9.14227       6.68465       1.79214        10     
reco:pandoracalo:Calorimetry                        1.29241       2.5167        3.07415       2.74928      0.532545        10     
reco:pandoracalonosce:Calorimetry                   1.19244       2.39259       2.95441       2.61602      0.546829        10     
reco:pandorapid:Chi2ParticleID                    0.00267745    0.00334245    0.00386711    0.00336319    0.000295224      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0234228     0.0317103     0.0366197     0.0329681    0.00370699       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00251311    0.00319067    0.00361314    0.00324234    0.000322563      10     
reco:pandoraShowercalo:ShowerCalorimetry            2.16015       5.82152       8.38064       6.0948        1.76343        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.08535       5.70132       8.24568       5.96853       1.75303        10     
reco:emtrkmichelid:EmTrackMichelId                  72.2194       101.252       127.403       105.612       15.708         10     
reco:crttag:SingleCRTMatchingProducer              0.0127785     0.0217736     0.0310473     0.0216982    0.00493744       10     
reco:crtreco:TwoCRTMatchingProducer               0.00776899     0.0123961     0.0143419     0.0126939    0.00188069       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.484515      0.692162      0.857438      0.719301      0.100766        10     
reco:pandora2Track:LArPandoraTrackCreation          8.62187       16.5416       23.0999       17.584        4.09747        10     
reco:pandora2calo:Calorimetry                       3.3898        7.88927       10.8176       8.46924       2.08503        10     
reco:pandora2calonosce:Calorimetry                  3.52311       7.60805       10.2191       8.22484       1.91903        10     
reco:pandora2pid:Chi2ParticleID                   0.00634953    0.00815123    0.00981616    0.00834121    0.00109123       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0325351     0.0412493     0.0499204     0.0429855    0.00516252       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00561859     0.0080146    0.00990761    0.00816424    0.00126338       10     
reco:pandora2Shower:LArPandoraShowerCreation        4.06992       6.44623       8.45333       6.8068        1.31928        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.2035        6.76561       8.9039         7.248        1.62457        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.07872       6.07767       8.15322       6.47119       1.45497        10     
[art]:TriggerResults:TriggerResultInserter        3.3406e-05    4.22928e-05   8.5776e-05    3.8236e-05    1.46419e-05      10     
end_path:out1:RootOutput                          1.0787e-05    1.1835e-05    1.3909e-05    1.14125e-05   9.69333e-07      10     
end_path:out1:RootOutput(write)                     1.22159       1.76445       2.17428       1.82445      0.255873        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5181.9 MB
  Peak resident set size usage (VmHWM): 4371.76 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.15 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.00 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11019726
-rw-r--r-- 1 pltdune004 pltdune 2552784848 Oct 17 12:37 detsim_stage2.root
-rw-r--r-- 1 pltdune004 pltdune 2422589376 Oct 17 12:36 detsim_stage1.root
-rw-r--r-- 1 pltdune004 pltdune 2278021244 Oct 17 13:23 reco_stage1.root
-rw-r--r-- 1 pltdune004 pltdune 2011203374 Oct 17 11:36 g4_stage2.root
-rw-r--r-- 1 pltdune004 pltdune 1934865337 Oct 17 11:26 g4_stage1.root
-rw-r--r-- 1 pltdune004 pltdune   84170040 Oct 17 13:20 Pandora_Events.pndr
-rw-r--r-- 1 pltdune004 pltdune     243174 Oct 17 13:23 jobscript.log
-rw-r--r-- 1 pltdune004 pltdune     217088 Oct 17 13:23 mem.db
-rw-r--r-- 1 pltdune004 pltdune      62376 Oct 17 13:23 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune004 pltdune      36864 Oct 17 13:23 time.db
-rw-r--r-- 1 pltdune004 pltdune        519 Oct 17 12:37 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pltdune004 pltdune        519 Oct 17 11:36 g4_protoDUNE_hist.root
-rw-r--r-- 1 pltdune004 pltdune        519 Oct 17 13:23 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pltdune004 pltdune         52 Oct 17 11:22 all-input-dids.txt
-rw-r--r-- 1 pltdune004 pltdune          7 Oct 17 13:23 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune004 pltdune          0 Oct 17 12:41 ProtoDUNE.log
-rw-r--r-- 1 pltdune004 pltdune          0 Oct 17 12:37 debugprod.log
justIN time: 2025-11-05 07:29:14 UTC       justIN version: 01.05.01