justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 19787.1@dunegpschedd01.fnal.gov

Jobsub ID19787.1@dunegpschedd01.fnal.gov
Workflow ID173
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-07-31 11:04:47
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce513
Last heartbeat2025-07-31 14:45:01
From worker nodeHostnameb9p10p4646.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-07-31 11:07:13
Input filesmonte-carlo-000173-000001
JobscriptExit code0
Real time3h (12975s)
CPU time3h (12225s = 94%)
Max RSS bytes4192137216 (3997 MiB)
Outputting started2025-07-31 14:43:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/00173/1/001/reco_stage1.root
Finished2025-07-31 14:45:01
Saved logsjustin-logs:19787.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 132954 traces, 0 summary
Retagger: tagging trace set: gauss with 99459 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 99459 traces tagged "gauss"
FrameSaver: q=3.59334e+06 n=1770114 tag=gauss
wclsFrameSaver: saving 132954 traces tagged "wiener"
FrameSaver: q=3.8328e+06 n=1574465 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 36910 XUs and 29082 XVs -> 363 XUVs
C:0 T:1 62960 XUs and 49993 XVs -> 6348 XUVs
C:0 T:2 71774 XUs and 76717 XVs -> 2993 XUVs
C:0 T:3 35794 XUs and 33070 XVs -> 268 XUVs
C:0 T:4 15796 XUs and 13960 XVs -> 120 XUVs
C:0 T:5 59947 XUs and 44142 XVs -> 5453 XUVs
C:0 T:6 106379 XUs and 125830 XVs -> 5770 XUVs
C:0 T:7 38149 XUs and 47341 XVs -> 304 XUVs
C:0 T:8 5598 XUs and 7726 XVs -> 121 XUVs
C:0 T:9 34402 XUs and 58698 XVs -> 4956 XUVs
C:0 T:10 53720 XUs and 144236 XVs -> 10046 XUVs
C:0 T:11 100 XUs and 178 XVs -> 17 XUVs
36759 XUVs total
12253 collection wire objects
34207 potential space points
Neighbour search...
2205207 tests to find 1188566 neighbours
Iterating with no regularization...
Begin: 7.18187e+07
0 5.67241e+07
1 5.56474e+07
2 5.54442e+07
3 5.53811e+07
4 5.53529e+07
Now with regularization...
Begin: 4.38265e+07
0 4.37663e+07
1 4.37389e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 408352897
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 408352897
fLifetime: 30000 [us]
31-Jul-2025 16:43:27 CEST  Closed output file "reco_stage1.root"
31-Jul-2025 16:43:27 CEST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          219.462       356.841       432.72        370.688       59.2919        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00111353     0.003987      0.0055772    0.00461243    0.00149082       10     
reco:ophit:OpHitFinder                             0.232564      0.340422      0.460069       0.35975      0.0613677       10     
reco:opflash:OpFlashFinder                         0.136282      0.181193      0.253152      0.174039      0.0364123       10     
reco:opslicer:OpSlicer                              0.43203      0.695832       1.07739      0.737253      0.203548        10     
reco:caldata:DataPrepModule                         4.9771        5.78122       7.18441       5.70677      0.658287        10     
reco:wclsdatasp:WireCellToolkit                     31.549        35.939        38.7709       35.917        2.28702        10     
reco:gaushit:GausHitFinder                         0.704607       1.29397       1.72237       1.40342      0.332041        10     
reco:nhitsfilter:NumberOfHitsFilter                0.0003187    0.000573433   0.00073724    0.00063281    0.00013991       10     
reco:reco3d:SpacePointSolver                        7.14404       19.0096       26.9324       20.0126       5.78862        10     
reco:hitpdune:DisambigFromSpacePoints              0.525133       1.6407        2.84614       1.7301       0.567617        10     
reco:pandora:StandardPandora                        12.6496       31.1546       49.0615       30.6815       10.3827        10     
reco:pandoraWriter:StandardPandora                 0.191815      0.424916      0.547941      0.432906      0.102027        10     
reco:pandoraTrack:LArPandoraTrackCreation           1.7959        3.64429       5.20805       3.34332       1.0689         10     
reco:pandoraShower:LArPandoraShowerCreation         1.38244       3.92628       5.36638       4.23004       1.15841        10     
reco:pandoracalo:Calorimetry                        1.23066       2.01151       2.58944       2.08003      0.346684        10     
reco:pandoracalonosce:Calorimetry                   1.10556       2.05764       2.54602       2.14073      0.391013        10     
reco:pandorapid:Chi2ParticleID                    0.00420193    0.00583309    0.00838083    0.00582175    0.00114441       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0436759     0.0585409     0.0830703     0.0514582     0.0139342       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID           0.0041036    0.00553939    0.00828492    0.00517659    0.00118423       10     
reco:pandoraShowercalo:ShowerCalorimetry            1.52197       4.26883       6.17084       4.86299       1.45459        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       1.1952        4.29442       5.64551       4.85856       1.46684        10     
reco:emtrkmichelid:EmTrackMichelId                   130.7        197.821       233.783       205.684       28.7735        10     
reco:crttag:SingleCRTMatchingProducer              0.0111888     0.0146941     0.0178702     0.0151465    0.00213439       10     
reco:crtreco:TwoCRTMatchingProducer               0.00512119    0.00898273     0.0107748    0.00988519     0.0019706       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.702963      0.992964       1.2412        1.0034       0.183086        10     
reco:pandora2Track:LArPandoraTrackCreation          5.06879       12.0425       19.2799       12.8577       4.37611        10     
reco:pandora2calo:Calorimetry                       2.51647       6.23164       9.4225        6.70099        2.099         10     
reco:pandora2calonosce:Calorimetry                  1.97672       5.90014       8.37753       5.97092       2.05652        10     
reco:pandora2pid:Chi2ParticleID                   0.00659878     0.0126024     0.0212729     0.0112823     0.0042983       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0324193     0.0674568     0.0981291     0.0620677     0.0190137       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00638496     0.0121925     0.0185685     0.0115328    0.00349651       10     
reco:pandora2Shower:LArPandoraShowerCreation        1.50274       4.07607       5.50482       4.31886       1.14451        10     
reco:pandora2Showercalo:ShowerCalorimetry           1.66966       5.25924       7.25912       5.6278        1.73325        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      1.43187       4.61367       6.16064       5.03449       1.3953         10     
[art]:TriggerResults:TriggerResultInserter          4.2e-05     7.0611e-05    0.00016486     5.72e-05     3.44757e-05      10     
end_path:out1:RootOutput                           1.045e-05    1.2571e-05     2.055e-05    1.1605e-05    2.9135e-06       10     
end_path:out1:RootOutput(write)                     1.71108       2.93903       3.50756       3.08951      0.473702        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5056.81 MB
  Peak resident set size usage (VmHWM): 4192.14 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.26 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.59 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.14 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9919400
-rw-r--r--. 1 duneprd np-comp 2337093350 Jul 31 15:42 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2219323458 Jul 31 15:40 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 2029839623 Jul 31 16:43 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 1786030051 Jul 31 13:30 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1708360519 Jul 31 13:14 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp   76197130 Jul 31 16:38 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp     243213 Jul 31 16:43 jobscript.log
-rw-r--r--. 1 duneprd np-comp     217088 Jul 31 16:43 mem.db
-rw-r--r--. 1 duneprd np-comp      62376 Jul 31 16:43 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp      36864 Jul 31 16:43 time.db
-rw-r--r--. 1 duneprd np-comp        519 Jul 31 15:42 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jul 31 13:30 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jul 31 16:43 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp         52 Jul 31 13:07 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp          7 Jul 31 16:43 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp          0 Jul 31 15:48 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp          0 Jul 31 15:42 debugprod.log
justIN time: 2025-08-05 02:40:47 UTC       justIN version: 01.04.00