justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 302560.0@dunegpschedd01.fnal.gov

Jobsub ID302560.0@dunegpschedd01.fnal.gov
Workflow ID12607
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-31 08:46:03
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce504
Last heartbeat2026-01-31 10:53:01
From worker nodeHostnameb9p35p0005.cern.ch
cpuinfoAMD EPYC 9655P 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-31 08:47:01
Input filesmonte-carlo-012607-000001
JobscriptExit code0
Real time2h (7487s)
CPU time1h (6516s = 87%)
Max RSS bytes4222255104 (4026 MiB)
Outputting started2026-01-31 10:51:49
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12607/1/001/reco_stage1.root
Finished2026-01-31 10:53:01
Saved logsjustin-logs:302560.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

vice:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 127956 traces, 0 summary
Retagger: tagging trace set: gauss with 99851 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 99851 traces tagged "gauss"
FrameSaver: q=3.53397e+06 n=1806934 tag=gauss
wclsFrameSaver: saving 127956 traces tagged "wiener"
FrameSaver: q=3.75346e+06 n=1629598 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 32924 XUs and 33682 XVs -> 366 XUVs
C:0 T:1 71216 XUs and 69668 XVs -> 4181 XUVs
C:0 T:2 108820 XUs and 94558 XVs -> 3528 XUVs
C:0 T:3 52614 XUs and 37596 XVs -> 369 XUVs
C:0 T:4 14705 XUs and 14692 XVs -> 135 XUVs
C:0 T:5 48847 XUs and 38374 XVs -> 4560 XUVs
C:0 T:6 167107 XUs and 145495 XVs -> 8392 XUVs
C:0 T:7 65427 XUs and 53257 XVs -> 909 XUVs
C:0 T:8 7950 XUs and 5487 XVs -> 62 XUVs
C:0 T:9 65263 XUs and 60628 XVs -> 10208 XUVs
C:0 T:10 15975 XUs and 15117 XVs -> 2069 XUVs
C:0 T:11 121 XUs and 115 XVs -> 12 XUVs
34791 XUVs total
10843 collection wire objects
30763 potential space points
Neighbour search...
2462473 tests to find 1213688 neighbours
Iterating with no regularization...
Begin: 8.23294e+07
0 7.0759e+07
1 6.98803e+07
2 6.97714e+07
3 6.97429e+07
Now with regularization...
Begin: 5.94237e+07
0 5.94062e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 412075039
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412075039
fLifetime: 30000 [us]
31-Jan-2026 11:51:48 CET  Closed output file "reco_stage1.root"
31-Jan-2026 11:51:48 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          115.267       221.908       308.949       229.678       54.4838        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00077372    0.00304333    0.00451905    0.00322327    0.00110602       10     
reco:ophit:OpHitFinder                              0.14302      0.208138      0.267205      0.194508      0.0368874       10     
reco:opflash:OpFlashFinder                         0.060154      0.0986628     0.146369      0.0904435     0.0259132       10     
reco:opslicer:OpSlicer                             0.336342      0.493389      0.623717      0.502707      0.098071        10     
reco:caldata:DataPrepModule                         3.0132        3.71802       4.90372       3.34059      0.656122        10     
reco:wclsdatasp:WireCellToolkit                     19.8389       23.477        26.484        23.6503       2.11224        10     
reco:gaushit:GausHitFinder                         0.507902      0.902757       1.2668       0.897225      0.245659        10     
reco:nhitsfilter:NumberOfHitsFilter               0.00020178    0.000293387    0.0004042    0.00028432    6.48042e-05      10     
reco:reco3d:SpacePointSolver                        4.23111       11.7167       19.0665       12.8378       5.30415        10     
reco:hitpdune:DisambigFromSpacePoints              0.487816       1.15869       1.66133       1.12667      0.361014        10     
reco:pandora:StandardPandora                        8.09801       23.1348       29.5641       24.0557       6.3358         10     
reco:pandoraWriter:StandardPandora                 0.206656      0.347481      0.451732       0.36298      0.0655209       10     
reco:pandoraTrack:LArPandoraTrackCreation           1.07476       2.89727       4.45589       3.09224       1.0998         10     
reco:pandoraShower:LArPandoraShowerCreation        0.774812       3.17775       5.07101       3.13737       1.50818        10     
reco:pandoracalo:Calorimetry                       0.779159        1.561        2.28031       1.62956      0.481043        10     
reco:pandoracalonosce:Calorimetry                  0.570556       1.37803       2.08001       1.50606      0.463294        10     
reco:pandorapid:Chi2ParticleID                    0.00278901    0.00388707    0.00513179    0.00384797    0.000664246      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0300093     0.0410443     0.0627738     0.039074      0.0106131       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00284845    0.00372026    0.00513754    0.00368165    0.000634506      10     
reco:pandoraShowercalo:ShowerCalorimetry           0.747973       3.06096       4.80872       3.10065       1.40187        10     
reco:pandoraShowercalonosce:ShowerCalorimetry      0.707829       3.11261       5.50234       3.17309       1.47885        10     
reco:emtrkmichelid:EmTrackMichelId                  62.6364       108.414       146.391       110.712       22.903         10     
reco:crttag:SingleCRTMatchingProducer             0.00633048     0.0116483     0.0173712     0.0116873    0.00309845       10     
reco:crtreco:TwoCRTMatchingProducer               0.00309801    0.00751518     0.0107592    0.00758183     0.0023375       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.230603      0.458747      0.599543      0.460435       0.11686        10     
reco:pandora2Track:LArPandoraTrackCreation          2.19138       10.0216       19.6465       10.1655       5.35776        10     
reco:pandora2calo:Calorimetry                       1.18712       4.49293       8.20434       4.5942        2.13789        10     
reco:pandora2calonosce:Calorimetry                  1.22289       4.53378       8.49307       5.05616       2.11435        10     
reco:pandora2pid:Chi2ParticleID                   0.00568111    0.00963069     0.014962     0.00964105    0.00243637       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0371023     0.0541092     0.079718      0.0503062     0.0126758       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00565013    0.00983008     0.0153905    0.00970853    0.00255321       10     
reco:pandora2Shower:LArPandoraShowerCreation       0.964271       3.44837       6.07338       3.46401       1.54969        10     
reco:pandora2Showercalo:ShowerCalorimetry           1.04648       3.93889       6.71374       4.18241       1.7457         10     
reco:pandora2Showercalonosce:ShowerCalorimetry     0.956617       3.71977       6.27928       4.06297       1.70266        10     
[art]:TriggerResults:TriggerResultInserter         2.963e-05    4.1212e-05     9.52e-05     3.3905e-05    1.87548e-05      10     
end_path:out1:RootOutput                            5.2e-06      6.762e-06     1.198e-05     6.325e-06    1.80036e-06      10     
end_path:out1:RootOutput(write)                     1.30875       2.16614       3.0309        2.1107        0.53202        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5056.3 MB
  Peak resident set size usage (VmHWM): 4222.26 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.16 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.37 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9729240
-rw-r--r--. 1 duneprd np-comp 2303838713 Jan 31 11:12 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2194262467 Jan 31 11:11 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 1980827593 Jan 31 11:51 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 1740758394 Jan 31 10:11 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1670016493 Jan 31 09:51 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp   72425010 Jan 31 11:49 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp     242899 Jan 31 11:51 jobscript.log
-rw-r--r--. 1 duneprd np-comp     217088 Jan 31 11:51 mem.db
-rw-r--r--. 1 duneprd np-comp      62376 Jan 31 11:51 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp      36864 Jan 31 11:51 time.db
-rw-r--r--. 1 duneprd np-comp        519 Jan 31 11:12 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jan 31 10:11 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Jan 31 11:51 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp         52 Jan 31 09:47 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp          7 Jan 31 11:51 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp          0 Jan 31 11:16 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp          0 Jan 31 11:12 debugprod.log
justIN time: 2026-02-04 09:24:24 UTC       justIN version: 01.06.00