justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263305.17@dunegpschedd02.fnal.gov

Jobsub ID263305.17@dunegpschedd02.fnal.gov
Workflow ID11264
Stage ID1
User nameavizcaya@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes9437184000 (9000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-18 19:31:07
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-18 21:58:15
From worker nodeHostnamedunegli-8108563-0-fnpc19140.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-18 20:31:20
Input filesusertests:pdhd_prod_beam__261612_95_1_20251212T160333Z_gen_g4_IonScintPDExt.root_262727_78_1_20251215T214825Z_PDInt.root
JobscriptExit code0
Real time1h (5151s)
CPU time1h (5068s = 98%)
Max RSS bytes7333306368 (6993 MiB)
Outputting started2025-12-18 21:57:11
Output filesusertests:pdhd_prod_beam__261612_95_1_20251212T160333Z_gen_g4_IonScintPDExt.root_262727_78_1_20251215T214825Z_PDInt.root_263305_17_1_20251218T203124Z_detsim_reco1.root
Finished2025-12-18 21:58:15
Saved logsjustin-logs:263305.17-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

woViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000587344 0.000587225 0.000523925 0.000504434 0.000504315 0.000504375 0.000504434 0.000528336 0.000545263 0.000545323 0.000545323 
----view 1: 0.000573635 0.000573575 0.000570059 0.00055325 0.000553191 0.000553191 0.000553191 0.000553191 0.000553191 0.00055325 0.000528336 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000587225 0.000523925 0.000504434 0.000504315 0.000504375 0.000504434 0.000528336 0.000545263 0.000545323 0.000545323 0.000545263 
----view 1: 0.000573575 0.000570059 0.00055325 0.000553191 0.000553191 0.000553191 0.000553191 0.000553191 0.00055325 0.000528336 0.000525713 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000523925 0.000504434 0.000504315 0.000504375 0.000504434 0.000528336 0.000545263 0.000545323 0.000545323 0.000545263 0.000545382 
----view 1: 0.000570059 0.00055325 0.000553191 0.000553191 0.000553191 0.000553191 0.000553191 0.00055325 0.000528336 0.000525713 0.000525773 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000504434 0.000504315 0.000504375 0.000504434 0.000528336 0.000545263 0.000545323 0.000545323 0.000545263 0.000545382 0.000293553 
----view 1: 0.00055325 0.000553191 0.000553191 0.000553191 0.000553191 0.000553191 0.00055325 0.000528336 0.000525713 0.000525773 0.000525713 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000504315 0.000504375 0.000504434 0.000528336 0.000545263 0.000545323 0.000545323 0.000545263 0.000545382 0.000293553 0.000289798 
----view 1: 0.000553191 0.000553191 0.000553191 0.000553191 0.000553191 0.00055325 0.000528336 0.000525713 0.000525773 0.000525713 0.000525713 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000504375 0.000504434 0.000528336 0.000545263 0.000545323 0.000545323 0.000545263 0.000545382 0.000293553 0.000289798 0.000289917 
----view 1: 0.000553191 0.000553191 0.000553191 0.000553191 0.00055325 0.000528336 0.000525713 0.000525773 0.000525713 0.000525713 0.000525773 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000504434 0.000528336 0.000545263 0.000545323 0.000545323 0.000545263 0.000545382 0.000293553 0.000289798 0.000289917 0.000289857 
----view 1: 0.000553191 0.000553191 0.000553191 0.00055325 0.000528336 0.000525713 0.000525773 0.000525713 0.000525713 0.000525773 0.000525713 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000528336 0.000545263 0.000545323 0.000545323 0.000545263 0.000545382 0.000293553 0.000289798 0.000289917 0.000289857 0.000289857 
----view 1: 0.000553191 0.000553191 0.00055325 0.000528336 0.000525713 0.000525773 0.000525713 0.000525713 0.000525773 0.000525713 0.000525713 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000545263 0.000545323 0.000545323 0.000545263 0.000545382 0.000293553 0.000289798 0.000289917 0.000289857 0.000289857 0.000289917 
----view 1: 0.000553191 0.00055325 0.000528336 0.000525713 0.000525773 0.000525713 0.000525713 0.000525773 0.000525713 0.000525713 0.000545979 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000545323 0.000545323 0.000545263 0.000545382 0.000293553 0.000289798 0.000289917 0.000289857 0.000289857 0.000289917 7.89165e-05 
----view 1: 0.00055325 0.000528336 0.000525713 0.000525773 0.000525713 0.000525713 0.000525773 0.000525713 0.000525713 0.000545979 0.000608683 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000545323 0.000545263 0.000545382 0.000293553 0.000289798 0.000289917 0.000289857 0.000289857 0.000289917 7.89165e-05 0 
----view 1: 0.000528336 0.000525713 0.000525773 0.000525713 0.000525713 0.000525773 0.000525713 0.000525713 0.000545979 0.000608683 0.000608683 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000545263 0.000545382 0.000293553 0.000289798 0.000289917 0.000289857 0.000289857 0.000289917 7.89165e-05 0 0 
----view 1: 0.000525713 0.000525773 0.000525713 0.000525713 0.000525773 0.000525713 0.000525713 0.000545979 0.000608683 0.000608683 0.000608742 
18-Dec-2025 21:57:10 UTC  Closed output file "pdhd_prod_beam__261612_95_1_20251212T160333Z_gen_g4_IonScintPDExt.root_262727_78_1_20251215T214825Z_PDInt.root_263305_17_1_20251218T203124Z_detsim_reco1.root"
18-Dec-2025 21:57:10 UTC  Closed input file "temp_detsim.root"

=====================================================================================================================================
TimeTracker printout (sec)                             Min           Avg           Max         Median          RMS         nEvts   
=====================================================================================================================================
Full event                                           61.6207       74.0643       81.601        74.5933       6.03234        10     
-------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                             0.000565215   0.00309445    0.00498845    0.00327649    0.00137999       10     
reco:wclsdatahd:WireCellToolkit                       38.51        42.5288       46.0533       42.7704       2.30511        10     
reco:wirefilter:WireFilter                          0.0115883     0.0148468     0.0175244     0.0151527    0.00208409       10     
reco:gaushit:GausHitFinder                          0.399598      0.509063      0.645776      0.483058      0.0807323       10     
reco:nhitsfilter:NumberOfHitsFilter                0.000150111   0.000232476   0.000408964   0.000210367   7.24019e-05      10     
reco:reco3d:SpacePointSolver                        0.222365      0.536425       1.40599      0.448525      0.330398        10     
reco:hitpdune:DisambigFromSpacePoints               0.212904      0.345831      0.599794      0.330416      0.121372        10     
reco:pandora:StandardPandora                         4.36865       6.38602       9.22075       6.23337       1.74005        10     
reco:pandoraWriter:StandardPandora                  0.127856      0.167604      0.223895      0.165947      0.0308847       10     
reco:pandoraTrack:LArPandoraTrackCreation           0.511847      0.707788       1.03792       0.66336      0.168832        10     
reco:pandoraShower:LArPandoraShowerCreation         0.441831       0.71469       1.23751      0.690631      0.227854        10     
reco:pandoracalo:Calorimetry                         0.2701       0.386252      0.541786      0.360546      0.0793689       10     
reco:pandoracalonosce:Calorimetry                    0.26581      0.372983      0.504811      0.355414      0.0714654       10     
reco:pandoraShowercalo:ShowerCalorimetry            0.432921      0.691067       1.20036       0.65716      0.208633        10     
reco:pandoraShowercalonosce:ShowerCalorimetry        0.41944      0.683164       1.1801       0.657393      0.208207        10     
reco:pandoraGnocchiCalo:GnocchiCalorimetry          0.0338287     0.0444178     0.0618338     0.0430977    0.00858464       10     
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0325954     0.0445421     0.0562578     0.0458974    0.00771957       10     
reco:emtrkmichelid:EmTrackMichelId                   14.3535       18.7896        23.68         18.75        3.26886        10     
[art]:TriggerResults:TriggerResultInserter          2.316e-05    3.04921e-05   6.8441e-05     2.632e-05    1.28415e-05      10     
end_path:out1:RootOutput                            7.08e-06      9.056e-06     2.012e-05     7.92e-06     3.7078e-06       10     
end_path:out1:RootOutput(write)                     0.895936       1.08751       1.32081       1.06771      0.143144        10     
=====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6096.05 MB
  Peak resident set size usage (VmHWM): 3932.93 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Reco returns 0
.:
total 12439464
-rw-r--r-- 1 dunegli fnalgrid     239361 Dec 18 21:57 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid        200 Dec 18 21:57 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid        519 Dec 18 21:57 reco_protodunehd_hist.root
-rw-r--r-- 1 dunegli fnalgrid       3574 Dec 18 21:57 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid     139264 Dec 18 21:57 mem.db
-rw-r--r-- 1 dunegli fnalgrid      28672 Dec 18 21:57 time.db
-rw-r--r-- 1 dunegli fnalgrid 6450759984 Dec 18 21:57 pdhd_prod_beam__261612_95_1_20251212T160333Z_gen_g4_IonScintPDExt.root_262727_78_1_20251215T214825Z_PDInt.root_263305_17_1_20251218T203124Z_detsim_reco1.root
-rw-r--r-- 1 dunegli fnalgrid   37871700 Dec 18 21:56 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid          0 Dec 18 21:43 debugprod.log
-rw-r--r-- 1 dunegli fnalgrid        519 Dec 18 21:42 detsim_single_protodunehd_hist.root
-rw-r--r-- 1 dunegli fnalgrid 6248910948 Dec 18 21:42 temp_detsim.root
-rw-r--r-- 1 dunegli fnalgrid        121 Dec 18 20:31 all-input-dids.txt
justIN time: 2025-12-18 23:06:52 UTC       justIN version: 01.05.03