justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269312.1@dunegpschedd01.fnal.gov

Jobsub ID269312.1@dunegpschedd01.fnal.gov
Workflow ID11283
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-19 20:07:18
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce512
Last heartbeat2025-12-20 00:39:18
From worker nodeHostnameb9p24p4428.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-19 20:08:16
Input filesmonte-carlo-011283-000001
JobscriptExit code0
Real time4h (16168s)
CPU time4h (15525s = 96%)
Max RSS bytes4665552896 (4449 MiB)
Outputting started2025-12-20 00:37:46
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11283/1/001/reco_stage1.root
Finished2025-12-20 00:39:18
Saved logsjustin-logs:269312.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

epare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 138243 traces, 0 summary
Retagger: tagging trace set: gauss with 107015 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 107015 traces tagged "gauss"
FrameSaver: q=3.85559e+06 n=1937051 tag=gauss
wclsFrameSaver: saving 138243 traces tagged "wiener"
FrameSaver: q=4.07754e+06 n=1741347 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 44323 XUs and 40487 XVs -> 723 XUVs
C:0 T:1 72316 XUs and 62564 XVs -> 4757 XUVs
C:0 T:2 84086 XUs and 91501 XVs -> 10528 XUVs
C:0 T:3 41439 XUs and 37544 XVs -> 381 XUVs
C:0 T:4 12874 XUs and 12411 XVs -> 118 XUVs
C:0 T:5 48764 XUs and 38255 XVs -> 3352 XUVs
C:0 T:6 145505 XUs and 130726 XVs -> 7722 XUVs
C:0 T:7 53156 XUs and 52794 XVs -> 666 XUVs
C:0 T:8 9173 XUs and 8978 XVs -> 188 XUVs
C:0 T:9 55965 XUs and 71875 XVs -> 9821 XUVs
C:0 T:10 139320 XUs and 27783 XVs -> 11116 XUVs
C:0 T:11 159 XUs and 101 XVs -> 11 XUVs
49383 XUVs total
11063 collection wire objects
43753 potential space points
Neighbour search...
6444019 tests to find 3002034 neighbours
Iterating with no regularization...
Begin: 6.61478e+07
0 5.37191e+07
1 5.27923e+07
2 5.26681e+07
3 5.26328e+07
Now with regularization...
Begin: 4.18781e+07
0 4.18593e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411219574
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411219574
fLifetime: 30000 [us]
20-Dec-2025 01:37:43 CET  Closed output file "reco_stage1.root"
20-Dec-2025 01:37:43 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          308.083       524.22        627.51        552.821       95.1583        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00129824    0.00436141    0.00718918    0.00462749    0.00182972       10     
reco:ophit:OpHitFinder                              0.3031       0.369255      0.435667      0.384727      0.0493494       10     
reco:opflash:OpFlashFinder                         0.172305      0.247013      0.325937      0.237626      0.0470516       10     
reco:opslicer:OpSlicer                             0.686888      0.922233       1.1527       0.963996      0.184535        10     
reco:caldata:DataPrepModule                         4.96406       6.01479       6.75241       6.18454      0.711081        10     
reco:wclsdatasp:WireCellToolkit                     37.648        43.9308       50.5936       43.4923       4.36278        10     
reco:gaushit:GausHitFinder                         0.908208       1.6116        2.20214       1.6061       0.354196        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000405455   0.00082943    0.00139543    0.000811096   0.000265142      10     
reco:reco3d:SpacePointSolver                        6.17192       23.3832       36.2461       23.9351       8.81731        10     
reco:hitpdune:DisambigFromSpacePoints               0.76076       2.3566        3.4953        2.27706      0.799818        10     
reco:pandora:StandardPandora                        36.151        52.0871       80.7138       47.8321       13.4155        10     
reco:pandoraWriter:StandardPandora                 0.292065      0.586815       0.76491      0.578351      0.129302        10     
reco:pandoraTrack:LArPandoraTrackCreation           2.7501        6.4845        8.14287       6.97187       1.56308        10     
reco:pandoraShower:LArPandoraShowerCreation          1.879        6.94441       10.2793       7.14948       2.24888        10     
reco:pandoracalo:Calorimetry                        1.7397        3.27974       4.1833        3.46268      0.802279        10     
reco:pandoracalonosce:Calorimetry                   1.28881       3.09905       3.9038        3.51113      0.858397        10     
reco:pandorapid:Chi2ParticleID                    0.00474681    0.00943028     0.0221439    0.00878615    0.00459834       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0366243     0.0848125     0.109113      0.0917559     0.0225209       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00441206    0.00828643     0.0145893    0.00834573    0.00258953       10     
reco:pandoraShowercalo:ShowerCalorimetry            1.34428       6.47355       9.22546       6.95543       2.42034        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       1.48691       6.06099       8.72475       6.52265       2.05701        10     
reco:emtrkmichelid:EmTrackMichelId                  178.519       293.784       350.683       305.905       49.4631        10     
reco:crttag:SingleCRTMatchingProducer              0.0132751     0.0180932     0.0226908     0.0186267    0.00295054       10     
reco:crtreco:TwoCRTMatchingProducer               0.00938677     0.0123137     0.014689      0.0123741    0.00142155       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.650011       1.09504       1.43212       1.16388      0.238518        10     
reco:pandora2Track:LArPandoraTrackCreation          5.64913       21.2452       27.604        23.5115       6.60281        10     
reco:pandora2calo:Calorimetry                       3.29046       8.82641       12.174        9.89836       2.64908        10     
reco:pandora2calonosce:Calorimetry                  2.38148       8.68907       12.3927       9.15694       2.78939        10     
reco:pandora2pid:Chi2ParticleID                    0.0134337     0.0201983     0.0282768     0.0204178    0.00459687       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0683978     0.0962552      0.14524      0.0921318     0.0246702       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0118081     0.0188486     0.0241816     0.0188916    0.00382297       10     
reco:pandora2Shower:LArPandoraShowerCreation        2.52191       7.4203        10.0068       7.16326       2.14475        10     
reco:pandora2Showercalo:ShowerCalorimetry            2.822        7.91792       10.5912       8.04474       2.15263        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      2.67164       7.07389       9.65102       7.08825       2.24113        10     
[art]:TriggerResults:TriggerResultInserter        4.4061e-05    6.95291e-05   0.000190293   5.66355e-05   4.14976e-05      10     
end_path:out1:RootOutput                           9.03e-06      1.146e-05     1.94e-05      1.07e-05     2.86004e-06      10     
end_path:out1:RootOutput(write)                     2.48119       3.90241       4.68004       3.96252      0.552847        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5482.51 MB
  Peak resident set size usage (VmHWM): 4665.55 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.25 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.73 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.15 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11523728
-rw-r--r--. 1 duneprd np-comp 2666004484 Dec 20 00:07 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2525422965 Dec 20 00:04 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 2406240662 Dec 20 01:37 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 2103807807 Dec 19 21:30 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 2010279294 Dec 19 21:14 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp   87926650 Dec 20 01:31 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp     242764 Dec 20 01:37 jobscript.log
-rw-r--r--. 1 duneprd np-comp     217088 Dec 20 01:37 mem.db
-rw-r--r--. 1 duneprd np-comp      62376 Dec 20 01:37 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp      36864 Dec 20 01:37 time.db
-rw-r--r--. 1 duneprd np-comp        519 Dec 20 00:07 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Dec 19 21:30 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Dec 20 01:37 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp         52 Dec 19 21:08 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp          7 Dec 20 01:37 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp          0 Dec 20 00:16 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp          0 Dec 20 00:07 debugprod.log
justIN time: 2025-12-20 13:38:38 UTC       justIN version: 01.05.03