justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 240827.0@dunegpschedd01.fnal.gov

Jobsub ID240827.0@dunegpschedd01.fnal.gov
Workflow ID9458
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-30 07:25:23
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce16-multicore
Last heartbeat2025-10-30 12:47:17
From worker nodeHostnametd818.pic.es
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-30 07:26:08
Input filesmonte-carlo-009458-000001
JobscriptExit code0
Real time5h (19219s)
CPU time5h (18259s = 95%)
Max RSS bytes4155289600 (3962 MiB)
Outputting started2025-10-30 12:46:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09458/1/001/reco_stage1.root
Finished2025-10-30 12:47:17
Saved logsjustin-logs:240827.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

are:   Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 130462 traces, 0 summary
Retagger: tagging trace set: gauss with 100929 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 100929 traces tagged "gauss"
FrameSaver: q=3.40171e+06 n=1805013 tag=gauss
wclsFrameSaver: saving 130462 traces tagged "wiener"
FrameSaver: q=3.58201e+06 n=1604904 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 26408 XUs and 20438 XVs -> 192 XUVs
C:0 T:1 73850 XUs and 45849 XVs -> 9689 XUVs
C:0 T:2 68999 XUs and 83494 XVs -> 3027 XUVs
C:0 T:3 35595 XUs and 35581 XVs -> 163 XUVs
C:0 T:4 13183 XUs and 15004 XVs -> 72 XUVs
C:0 T:5 56764 XUs and 46862 XVs -> 4588 XUVs
C:0 T:6 101233 XUs and 85214 XVs -> 3390 XUVs
C:0 T:7 40993 XUs and 33393 XVs -> 300 XUVs
C:0 T:8 10059 XUs and 10269 XVs -> 124 XUVs
C:0 T:9 62659 XUs and 77935 XVs -> 4298 XUVs
C:0 T:10 51901 XUs and 31154 XVs -> 10683 XUVs
C:0 T:11 179 XUs and 73 XVs -> 8 XUVs
36534 XUVs total
11484 collection wire objects
34822 potential space points
Neighbour search...
4561800 tests to find 2098896 neighbours
Iterating with no regularization...
Begin: 6.35508e+07
0 5.46644e+07
1 5.40069e+07
2 5.39155e+07
3 5.38907e+07
Now with regularization...
Begin: 4.4598e+07
0 4.4563e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410203021
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410203021
fLifetime: 30000 [us]
30-Oct-2025 13:46:26 CET  Closed output file "reco_stage1.root"
30-Oct-2025 13:46:26 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          393.526       681.858       890.366       687.469       133.193        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00124703    0.00530879    0.00998214    0.00519559     0.0025387       10     
reco:ophit:OpHitFinder                             0.362695       0.42838      0.473137      0.435867      0.0360873       10     
reco:opflash:OpFlashFinder                         0.186648      0.240621      0.290465      0.242825      0.0277674       10     
reco:opslicer:OpSlicer                              1.01452       1.18955       1.32558       1.1935       0.110817        10     
reco:caldata:DataPrepModule                         7.05117       8.36091       8.84208       8.57245      0.592372        10     
reco:wclsdatasp:WireCellToolkit                     48.6005       58.3495       65.1524       59.0838       4.42659        10     
reco:gaushit:GausHitFinder                         0.996354       1.95223       2.29701       2.03392      0.337146        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000450871   0.000921396   0.00120996    0.000924186   0.000203672      10     
reco:reco3d:SpacePointSolver                        5.8209        24.613        43.088        22.6316       10.097         10     
reco:hitpdune:DisambigFromSpacePoints               1.06479       2.69813       3.60104       2.6607       0.724243        10     
reco:pandora:StandardPandora                        18.2678       61.9347       106.152       58.6602       23.1438        10     
reco:pandoraWriter:StandardPandora                 0.502093       0.73874      0.955973       0.74331      0.121218        10     
reco:pandoraTrack:LArPandoraTrackCreation           2.96885       7.81001       12.8906       7.96307       2.38389        10     
reco:pandoraShower:LArPandoraShowerCreation         2.56233       9.03718       13.4959       8.87935       3.20196        10     
reco:pandoracalo:Calorimetry                        1.82443       4.50124       6.93427       4.55616       1.27457        10     
reco:pandoracalonosce:Calorimetry                   1.58658       4.10292       6.50134       4.29806       1.16088        10     
reco:pandorapid:Chi2ParticleID                    0.00690668     0.0107122     0.0139304     0.0109772    0.00198995       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0687091     0.110991      0.135218      0.113986      0.0214229       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00662032     0.0100803     0.0136705     0.0105685    0.00176018       10     
reco:pandoraShowercalo:ShowerCalorimetry            2.45919       9.0409         13.28        9.33595       2.88385        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.20956       8.62229       14.1958       8.56419       3.35007        10     
reco:emtrkmichelid:EmTrackMichelId                  250.949       393.157       490.131       398.941       65.2253        10     
reco:crttag:SingleCRTMatchingProducer             0.00980748     0.0250996     0.0315536     0.0255377    0.00621216       10     
reco:crtreco:TwoCRTMatchingProducer               0.00698455     0.0175714     0.0229891     0.0179193    0.00436256       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.802083       1.39462       2.06486       1.39492      0.329742        10     
reco:pandora2Track:LArPandoraTrackCreation          7.95333       25.3563       38.9616       26.0065       8.86934        10     
reco:pandora2calo:Calorimetry                       4.29627       12.5768       17.7781       13.4278       3.78425        10     
reco:pandora2calonosce:Calorimetry                  4.03224       11.5857       17.2918       11.6837       3.52004        10     
reco:pandora2pid:Chi2ParticleID                    0.0153486     0.0242252     0.0336049     0.0229818    0.00581385       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0832287     0.124543      0.165036      0.125762      0.0276393       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0148963     0.0232223     0.0342955     0.0214751    0.00639251       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.33742       9.41873       13.6861       10.0289       2.79622        10     
reco:pandora2Showercalo:ShowerCalorimetry            3.644        10.263        15.1946       10.6979       3.1904         10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.26275       9.20587       12.8317       9.50896       2.71003        10     
[art]:TriggerResults:TriggerResultInserter         6.625e-05    9.01569e-05   0.00017425    7.6165e-05    3.14776e-05      10     
end_path:out1:RootOutput                           1.124e-05    1.48871e-05    2.127e-05     1.425e-05    2.55715e-06      10     
end_path:out1:RootOutput(write)                     3.13535       4.73687       5.67493       4.89947      0.713331        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4985.48 MB
  Peak resident set size usage (VmHWM): 4155.29 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.34 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   5.20 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.20 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10010068
-rw-r--r-- 1 dune001 dune 2361474689 Oct 30 11:49 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2238985545 Oct 30 11:45 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2065224731 Oct 30 13:46 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1787569370 Oct 30 08:58 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1717421895 Oct 30 08:36 g4_stage1.root
-rw-r--r-- 1 dune001 dune   79000040 Oct 30 13:37 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune     242854 Oct 30 13:46 jobscript.log
-rw-r--r-- 1 dune001 dune     217088 Oct 30 13:46 mem.db
-rw-r--r-- 1 dune001 dune      62376 Oct 30 13:46 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune      36864 Oct 30 13:46 time.db
-rw-r--r-- 1 dune001 dune        519 Oct 30 11:49 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune        519 Oct 30 08:58 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune        519 Oct 30 13:46 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune         52 Oct 30 08:26 all-input-dids.txt
-rw-r--r-- 1 dune001 dune          7 Oct 30 13:46 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune          0 Oct 30 11:59 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune          0 Oct 30 11:49 debugprod.log
justIN time: 2025-11-04 01:30:13 UTC       justIN version: 01.05.01