Jobsub ID 207247.18@dunegpschedd02.fnal.gov

Jobsub ID	207247.18@dunegpschedd02.fnal.gov
Workflow ID	8090
Stage ID	1
User name	calcuttj@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	8387559424 (7999 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-09-26 14:09:37
Site	UK_QMUL
Entry	DUNE_UK_London_QMUL_arcce03
Last heartbeat	2025-09-26 16:51:39
From worker node	Hostname	cn077.htc.esc.qmul
	cpuinfo	Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	10485760000 (10000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-26 15:27:06
Input files	usertests:prod_beam_p5GeV_protodunehd_1_212254_22_1758820597_pdint_TPC1_pdint_TPC2_pdint_TPC5_pdint_TPC6.root
Jobscript	Exit code	0
	Real time	1h (4731s)
	CPU time	1h (4494s = 94%)
	Max RSS bytes	6555299840 (6251 MiB)
Outputting started	2025-09-26 16:45:58
Output files	usertests:prod_beam_p5GeV_protodunehd_1_207247_18_1758900433_detsim_reco1.root
Finished	2025-09-26 16:51:39
Saved logs	justin-logs:207247.18-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

8315 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 68315 traces tagged "gauss"
FrameSaver: q=1.90516e+06 n=975069 tag=gauss
wclsFrameSaver: saving 86194 traces tagged "wiener"
FrameSaver: q=2.55269e+06 n=957502 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 104704 traces, 104704 summary
Retagger: tagging trace set: gauss with 83035 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 83035 traces tagged "gauss"
FrameSaver: q=2.57081e+06 n=1346388 tag=gauss
wclsFrameSaver: saving 104704 traces tagged "wiener"
FrameSaver: q=3.28337e+06 n=1301125 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 88529 traces, 88529 summary
Retagger: tagging trace set: gauss with 71216 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 71216 traces tagged "gauss"
FrameSaver: q=2.03592e+06 n=1109430 tag=gauss
wclsFrameSaver: saving 88529 traces tagged "wiener"
FrameSaver: q=2.40847e+06 n=1047564 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 94245 traces, 94245 summary
Retagger: tagging trace set: gauss with 74415 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 74415 traces tagged "gauss"
FrameSaver: q=2.36075e+06 n=1226516 tag=gauss
wclsFrameSaver: saving 94245 traces tagged "wiener"
FrameSaver: q=2.8489e+06 n=1171789 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 91973 traces, 91973 summary
Retagger: tagging trace set: gauss with 72646 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 72646 traces tagged "gauss"
FrameSaver: q=2.40023e+06 n=1158689 tag=gauss
wclsFrameSaver: saving 91973 traces tagged "wiener"
FrameSaver: q=3.06135e+06 n=1120333 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 94623 traces, 94623 summary
Retagger: tagging trace set: gauss with 72596 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 72596 traces tagged "gauss"
FrameSaver: q=2.22013e+06 n=1106524 tag=gauss
wclsFrameSaver: saving 94623 traces tagged "wiener"
FrameSaver: q=2.7361e+06 n=1060871 tag=wiener
26-Sep-2025 17:45:52 BST  Closed output file "prod_beam_p5GeV_protodunehd_1_207247_18_1758900433_detsim_reco1.root"
26-Sep-2025 17:45:52 BST  Closed input file "prod_beam_p5GeV_protodunehd_1_207247_18_1758900433_detsim.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            96.3437       158.703       290.696       156.194       53.3421        10     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.000853511   0.00634974     0.0118771     0.007112     0.00332308       10     
reco:opdec:Deconvolution                             0.900494       0.98373       1.19586      0.953567      0.0863077       10     
reco:ophitspe:OpHitFinderDeco                        0.211978      0.270164      0.452012      0.253346      0.0696433       10     
reco:opflash:OpFlashFinder                           0.0695014     0.0873431     0.105454      0.0855165     0.0114658       10     
reco:opslicer:OpSlicer                               0.184117       0.24153      0.378554      0.230955      0.0534537       10     
reco:wclsdatahd:WireCellToolkit                       50.1275       54.1297       68.4415       52.9672       4.90858        10     
reco:gaushit:GausHitFinder                           0.614094      0.815686       1.07125      0.812109      0.127774        10     
reco:nhitsfilter:NumberOfHitsFilter                 0.000420091   0.000571188   0.000923117   0.000547424   0.000132987      10     
reco:reco3d:SpacePointSolver                         0.429969      0.822753       1.34208      0.824012      0.257687        10     
reco:hitpdune:DisambigFromSpacePoints                0.423387      0.712235       1.30089      0.635938      0.264579        10     
reco:pandora:StandardPandora                          9.43337        33.57        114.88        27.5714       28.8956        10     
reco:pandoraWriter:StandardPandora                   0.213448      0.283944      0.399855      0.278834      0.0545011       10     
reco:pandoraTrack:LArPandoraTrackCreation             1.82719       4.02052       6.17679       4.01605       1.5352         10     
reco:pandoraShower:LArPandoraShowerCreation           2.02489       5.01607       9.98323       4.42392       2.4097         10     
reco:pandoracalo:Calorimetry                         0.762475       1.57392       2.59714       1.71215      0.636181        10     
reco:pandoracalonosce:Calorimetry                    0.770132       1.59927       2.64144       1.66717      0.657098        10     
reco:pandoraShowercalo:ShowerCalorimetry              1.44215       3.48943       7.82605       3.05741       1.86906        10     
reco:pandoraShowercalonosce:ShowerCalorimetry         1.3383        3.41351       8.00806       2.92757       1.94361        10     
reco:pandoraGnocchiCalo:GnocchiCalorimetry           0.0403006     0.0604709     0.0955978     0.0551074     0.0178829       10     
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry      0.0406201     0.0584807     0.0872736     0.0535632     0.0150851       10     
reco:emtrkmichelid:EmTrackMichelId                    11.0354       15.9324       21.3262       15.684        3.25149        10     
reco:crttag:SingleCRTMatchingProducer               0.00979147     0.0125934     0.019874      0.0120162    0.00272399       10     
reco:crtreco:TwoCRTMatchingProducer                 0.00866786     0.0111825     0.0177619     0.0104952    0.00253634       10     
reco:pandora2Track:LArPandoraTrackCreation            4.55564       11.2808       21.4746       10.0452       5.61072        10     
reco:pandora2calo:ShowerCalorimetry                   1.09876       3.08397       5.78766       2.54935       1.76919        10     
reco:pandora2calonosce:ShowerCalorimetry             0.986442       3.07795       6.85822       2.39724       1.93593        10     
reco:pandora2GnocchiCalo:GnocchiCalorimetry          0.0371893     0.0588237     0.0945659     0.0490677     0.0203821       10     
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry     0.0385938     0.0584693     0.0937452     0.0490525     0.0191437       10     
reco:pandora2Shower:LArPandoraShowerCreation          1.4267        4.36579       9.06262       3.71494       2.53927        10     
reco:pandora2Showercalo:ShowerCalorimetry             1.47892       3.77527       7.79676       2.91538       2.22559        10     
reco:pandora2Showercalonosce:ShowerCalorimetry        1.31631       3.61938       7.21133       2.89313       2.12581        10     
[art]:TriggerResults:TriggerResultInserter           2.096e-05    3.22471e-05   7.0658e-05    2.8459e-05    1.34797e-05      10     
end_path:out1:RootOutput                             5.383e-06    7.8517e-06    2.1077e-05     6.27e-06     4.48612e-06      10     
end_path:out1:RootOutput(write)                       1.56207       2.12885       3.09833       1.87591       0.55682        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6827.18 MB
  Peak resident set size usage (VmHWM): 4270.36 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_beam_p5GeV_protodunehd_1_207247_18_1758900433_detsim_reco1.root', 'start_time': 1758903420.2799065, 'end_time': 1758905157.358619}
lsing
total 11G
-rw-r--r-- 1 pildune32 pildune 5.5G Sep 26 17:45 prod_beam_p5GeV_protodunehd_1_207247_18_1758900433_detsim_reco1.root
-rw-r--r-- 1 pildune32 pildune 5.2G Sep 26 17:16 prod_beam_p5GeV_protodunehd_1_207247_18_1758900433_detsim.root
-rw-r--r-- 1 pildune32 pildune  51M Sep 26 17:45 Pandora_Events.pndr
-rw-r--r-- 1 pildune32 pildune 196K Sep 26 17:45 mem.db
-rw-r--r-- 1 pildune32 pildune 180K Sep 26 17:45 jobscript.log
-rw-r--r-- 1 pildune32 pildune  36K Sep 26 17:45 time.db
-rw-r--r-- 1 pildune32 pildune  13K Sep 26 17:45 prod_beam_p5GeV_protodunehd_1_207247_18_1758900433_detsim_reco1.err
-rw-r--r-- 1 pildune32 pildune  12K Sep 26 17:17 prod_beam_p5GeV_protodunehd_1_207247_18_1758900433_detsim.log
-rw-r--r-- 1 pildune32 pildune  12K Sep 26 17:45 prod_beam_p5GeV_protodunehd_1_207247_18_1758900433_detsim_reco1.log
-rw-r--r-- 1 pildune32 pildune 4.4K Sep 26 17:17 prod_beam_p5GeV_protodunehd_1_207247_18_1758900433_detsim.err
-rw-r--r-- 1 pildune32 pildune 3.5K Sep 26 17:45 Pandora_Geometry.xml
-rw-r--r-- 1 pildune32 pildune  519 Sep 26 17:16 detsim_single_protodunehd_hist.root
-rw-r--r-- 1 pildune32 pildune  519 Sep 26 17:45 reco_protodunehd_hist.root
-rw-r--r-- 1 pildune32 pildune  110 Sep 26 16:27 all-input-dids.txt
-rw-r--r-- 1 pildune32 pildune    0 Sep 26 17:21 ProtoDUNE.log
-rw-r--r-- 1 pildune32 pildune    0 Sep 26 17:17 debugprod.log
disk usage
11G	.