justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301886.0@dunegpschedd01.fnal.gov

Jobsub ID301886.0@dunegpschedd01.fnal.gov
Workflow ID12462
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-28 08:06:25
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce507
Last heartbeat2026-01-28 10:58:41
From worker nodeHostnameb9p10p4185.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-28 08:07:55
Input filesmonte-carlo-012462-000001
JobscriptExit code0
Real time2h (10169s)
CPU time2h (9248s = 90%)
Max RSS bytes3860959232 (3682 MiB)
Outputting started2026-01-28 10:57:25
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12462/1/001/reco_stage1.root
Finished2026-01-28 10:58:41
Saved logsjustin-logs:301886.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

pService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 106287 traces, 0 summary
Retagger: tagging trace set: gauss with 83289 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 83289 traces tagged "gauss"
FrameSaver: q=2.88127e+06 n=1537820 tag=gauss
wclsFrameSaver: saving 106287 traces tagged "wiener"
FrameSaver: q=3.02975e+06 n=1375967 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 33863 XUs and 32980 XVs -> 452 XUVs
C:0 T:1 95851 XUs and 130819 XVs -> 19590 XUVs
C:0 T:2 67771 XUs and 111530 XVs -> 3368 XUVs
C:0 T:3 34512 XUs and 48075 XVs -> 382 XUVs
C:0 T:4 7815 XUs and 9282 XVs -> 78 XUVs
C:0 T:5 22425 XUs and 19238 XVs -> 2471 XUVs
C:0 T:6 41114 XUs and 44894 XVs -> 1862 XUVs
C:0 T:7 17522 XUs and 18748 XVs -> 84 XUVs
C:0 T:8 6815 XUs and 6334 XVs -> 61 XUVs
C:0 T:9 34408 XUs and 39423 XVs -> 2142 XUVs
C:0 T:10 56545 XUs and 42080 XVs -> 5138 XUVs
C:0 T:11 617 XUs and 398 XVs -> 66 XUVs
35694 XUVs total
10079 collection wire objects
32956 potential space points
Neighbour search...
4568398 tests to find 1999364 neighbours
Iterating with no regularization...
Begin: 5.66608e+07
0 4.7985e+07
1 4.74254e+07
2 4.73483e+07
3 4.73245e+07
Now with regularization...
Begin: 3.99115e+07
0 3.98803e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 412014121
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412014121
fLifetime: 30000 [us]
28-Jan-2026 11:57:23 CET  Closed output file "reco_stage1.root"
28-Jan-2026 11:57:23 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          191.204       259.084       330.741       260.563       42.2851        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00099731    0.00278833    0.00438748    0.00254622    0.00108624       10     
reco:ophit:OpHitFinder                             0.191895      0.261319      0.327156      0.260262      0.0470553       10     
reco:opflash:OpFlashFinder                         0.100424      0.130075      0.164547      0.122012      0.0232649       10     
reco:opslicer:OpSlicer                             0.391288      0.533652      0.781811      0.509593      0.110689        10     
reco:caldata:DataPrepModule                         4.06386       5.00827       6.69463       4.61038      0.914756        10     
reco:wclsdatasp:WireCellToolkit                     25.7274       30.0249       41.6451       29.1475       4.3246         10     
reco:gaushit:GausHitFinder                         0.632998      0.910178       1.3884       0.831739      0.211901        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000256672   0.000388374   0.000545006   0.000363979   8.49917e-05      10     
reco:reco3d:SpacePointSolver                        7.3864        12.054        31.3377       9.88037       6.65724        10     
reco:hitpdune:DisambigFromSpacePoints              0.635742       1.10436       1.56889       1.06684      0.352371        10     
reco:pandora:StandardPandora                        14.7301       21.1881       31.5051       21.0223       4.96917        10     
reco:pandoraWriter:StandardPandora                 0.191578      0.324556      0.441465      0.316047      0.0759051       10     
reco:pandoraTrack:LArPandoraTrackCreation           1.03562       2.18425       2.87539       2.15037      0.521944        10     
reco:pandoraShower:LArPandoraShowerCreation        0.979525       2.31679       4.33506       2.17751      0.892621        10     
reco:pandoracalo:Calorimetry                       0.681722       1.38104       1.93471       1.33472      0.405844        10     
reco:pandoracalonosce:Calorimetry                  0.872372       1.27893       1.99378       1.15808      0.353108        10     
reco:pandorapid:Chi2ParticleID                    0.00323337    0.00477372    0.00640684     0.0050332     0.001138        10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0275101     0.0454706     0.0626771     0.0471609     0.0127635       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID           0.0029544    0.00432478    0.00556453    0.00436129    0.000958615      10     
reco:pandoraShowercalo:ShowerCalorimetry            1.4485        2.65937       5.07253       2.38854       1.15265        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       1.1933        2.57153       4.90522       2.38498       1.15535        10     
reco:emtrkmichelid:EmTrackMichelId                  108.53        149.574       183.735       150.491       23.6357        10     
reco:crttag:SingleCRTMatchingProducer             0.00723595     0.0118071     0.0174031     0.0110278    0.00321309       10     
reco:crtreco:TwoCRTMatchingProducer               0.00472173    0.00676249     0.0103732    0.00671765    0.00153199       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.563527      0.781005       0.97298      0.756983      0.131247        10     
reco:pandora2Track:LArPandoraTrackCreation          3.35843       6.91788       9.09689       7.13102       1.77925        10     
reco:pandora2calo:Calorimetry                       1.67722       3.57249       4.97724       3.44311      0.990338        10     
reco:pandora2calonosce:Calorimetry                  1.5287        3.33527       5.84164       2.96791       1.1887         10     
reco:pandora2pid:Chi2ParticleID                   0.00555289     0.0103573     0.0153049    0.00989545    0.00308116       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0290292     0.0503801     0.0723821     0.0465943     0.0148292       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00549166    0.00975991     0.0144677    0.00914146    0.00304896       10     
reco:pandora2Shower:LArPandoraShowerCreation        1.12902       2.56213       3.98422       2.43826      0.824912        10     
reco:pandora2Showercalo:ShowerCalorimetry           1.38464       3.08543       4.59524       2.92838      0.987436        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      1.76431       2.96262       4.57609       2.74159       0.9614         10     
[art]:TriggerResults:TriggerResultInserter         3.507e-05    5.39418e-05   0.000104071   5.1266e-05    1.95705e-05      10     
end_path:out1:RootOutput                            8.3e-06     1.04103e-05   1.4241e-05     1.044e-05    1.62727e-06      10     
end_path:out1:RootOutput(write)                     1.79247       2.14246       2.68408       2.0605       0.303261        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4705.21 MB
  Peak resident set size usage (VmHWM): 3860.96 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.22 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.08 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.13 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 8949612
-rw-r--r--. 1 duneprd np-comp 2149579167 Jan 28 11:10 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2046899929 Jan 28 11:08 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 1789588719 Jan 28 11:57 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 1591167218 Jan 28 09:28 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1522509351 Jan 28 09:15 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp   64041910 Jan 28 11:53 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp     242704 Jan 28 11:57 jobscript.log
-rw-r--r--. 1 duneprd np-comp     217088 Jan 28 11:57 mem.db
-rw-r--r--. 1 duneprd np-comp      62376 Jan 28 11:57 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp      36864 Jan 28 11:57 time.db
-rw-r--r--. 1 duneprd np-comp        519 Jan 28 11:10 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jan 28 09:28 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jan 28 11:57 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp         52 Jan 28 09:07 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp          7 Jan 28 11:57 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp          0 Jan 28 11:16 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp          0 Jan 28 11:10 debugprod.log
justIN time: 2026-02-04 18:09:26 UTC       justIN version: 01.06.00