Jobsub ID 241092.0@dunegpschedd01.fnal.gov
| Jobsub ID | 241092.0@dunegpschedd01.fnal.gov |
| Workflow ID | 9483 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-10-30 18:27:58 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-10-30 21:42:02 |
| From worker node | Hostname | dunegli-7579663-0-fnpc9002.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-30 18:29:32 |
| Input files | monte-carlo-009483-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11527s) |
| CPU time | 3h (11410s = 98%) |
| Max RSS bytes | 4322652160 (4122 MiB) |
| Outputting started | 2025-10-30 21:41:39 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09483/1/001/reco_stage1.root
|
| Finished | 2025-10-30 21:42:02 |
| Saved logs | justin-logs:241092.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 132363 traces, 0 summary
Retagger: tagging trace set: gauss with 102819 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 102819 traces tagged "gauss"
FrameSaver: q=3.54686e+06 n=1878936 tag=gauss
wclsFrameSaver: saving 132363 traces tagged "wiener"
FrameSaver: q=3.72327e+06 n=1671755 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 24786 XUs and 26365 XVs -> 186 XUVs
C:0 T:1 59145 XUs and 57703 XVs -> 3770 XUVs
C:0 T:2 135883 XUs and 149747 XVs -> 8992 XUVs
C:0 T:3 57585 XUs and 53963 XVs -> 659 XUVs
C:0 T:4 13284 XUs and 12436 XVs -> 56 XUVs
C:0 T:5 57083 XUs and 43681 XVs -> 6483 XUVs
C:0 T:6 107451 XUs and 100200 XVs -> 4072 XUVs
C:0 T:7 44667 XUs and 40583 XVs -> 283 XUVs
C:0 T:8 6498 XUs and 3522 XVs -> 30 XUVs
C:0 T:9 41921 XUs and 38440 XVs -> 2802 XUVs
C:0 T:10 42773 XUs and 36367 XVs -> 4741 XUVs
C:0 T:11 207 XUs and 148 XVs -> 22 XUVs
32096 XUVs total
12103 collection wire objects
29512 potential space points
Neighbour search...
2157658 tests to find 1095268 neighbours
Iterating with no regularization...
Begin: 8.04995e+07
0 6.67141e+07
1 6.60341e+07
2 6.59365e+07
3 6.59068e+07
Now with regularization...
Begin: 5.68849e+07
0 5.68389e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410212066
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410212066
fLifetime: 30000 [us]
30-Oct-2025 21:41:33 UTC Closed output file "reco_stage1.root"
30-Oct-2025 21:41:33 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 329.379 408.804 486.02 415.168 51.6875 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000785965 0.00345692 0.00572894 0.00341076 0.00163431 10
reco:ophit:OpHitFinder 0.230847 0.279091 0.30519 0.280752 0.0220221 10
reco:opflash:OpFlashFinder 0.153307 0.196527 0.226396 0.199344 0.0221094 10
reco:opslicer:OpSlicer 0.515384 0.68621 0.841664 0.690498 0.101086 10
reco:caldata:DataPrepModule 5.48108 5.58038 5.78979 5.58192 0.0874145 10
reco:wclsdatasp:WireCellToolkit 40.0752 45.8348 48.5818 47.4453 3.11801 10
reco:gaushit:GausHitFinder 1.10499 1.39698 1.67584 1.3993 0.198339 10
reco:nhitsfilter:NumberOfHitsFilter 0.000306882 0.000474875 0.000697112 0.000443647 0.000131866 10
reco:reco3d:SpacePointSolver 9.13462 18.5897 38.6218 16.3108 7.98119 10
reco:hitpdune:DisambigFromSpacePoints 2.02122 2.6613 3.27302 2.74437 0.434243 10
reco:pandora:StandardPandora 33.8981 50.6914 63.4599 53.6378 9.93549 10
reco:pandoraWriter:StandardPandora 0.395166 0.524921 0.960935 0.492609 0.153149 10
reco:pandoraTrack:LArPandoraTrackCreation 4.14664 5.39952 6.82872 5.29994 0.812274 10
reco:pandoraShower:LArPandoraShowerCreation 3.78752 5.45117 6.88057 5.46713 1.14242 10
reco:pandoracalo:Calorimetry 2.2206 2.86121 3.60088 2.82941 0.413489 10
reco:pandoracalonosce:Calorimetry 1.97671 2.57001 3.16617 2.51492 0.37632 10
reco:pandorapid:Chi2ParticleID 0.00521953 0.00621777 0.0075994 0.00618853 0.000642992 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0631949 0.0735287 0.0852746 0.0721612 0.00768391 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00506594 0.0057956 0.00641813 0.00578221 0.000457739 10
reco:pandoraShowercalo:ShowerCalorimetry 4.04419 5.65323 7.22213 5.68213 1.14622 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.02575 5.59289 7.12499 5.56939 1.12881 10
reco:emtrkmichelid:EmTrackMichelId 162.273 194.424 224.259 198.13 20.2705 10
reco:crttag:SingleCRTMatchingProducer 0.0162685 0.0208979 0.0304081 0.0201744 0.00382735 10
reco:crtreco:TwoCRTMatchingProducer 0.00960474 0.0129641 0.0220013 0.0121009 0.00332986 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.37187 1.84177 2.37468 1.82917 0.27079 10
reco:pandora2Track:LArPandoraTrackCreation 12.612 18.2951 23.2804 18.6974 3.89525 10
reco:pandora2calo:Calorimetry 6.13547 8.42874 10.8235 8.74265 1.69172 10
reco:pandora2calonosce:Calorimetry 5.71296 7.92557 10.2708 8.10111 1.61128 10
reco:pandora2pid:Chi2ParticleID 0.0131864 0.0155977 0.0183265 0.0157688 0.00168839 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0779022 0.09234 0.107778 0.0912102 0.0107481 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0125677 0.0150949 0.0179101 0.0152202 0.00179908 10
reco:pandora2Shower:LArPandoraShowerCreation 4.56385 6.35621 8.26153 6.49467 1.40033 10
reco:pandora2Showercalo:ShowerCalorimetry 5.48208 7.40821 9.24576 7.62192 1.43257 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.11612 6.8913 8.55764 7.0222 1.25973 10
[art]:TriggerResults:TriggerResultInserter 4.4529e-05 5.57506e-05 0.000114084 5.0363e-05 1.9647e-05 10
end_path:out1:RootOutput 9.023e-06 1.00504e-05 1.3752e-05 9.5935e-06 1.28875e-06 10
end_path:out1:RootOutput(write) 2.42272 2.93422 3.46276 3.07337 0.351533 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5132.82 MB
Peak resident set size usage (VmHWM): 4322.65 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.53 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10443080
-rw-r--r-- 1 dunegli fnalgrid 2441278065 Oct 30 20:31 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2315644040 Oct 30 20:29 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2152083351 Oct 30 21:41 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1889936738 Oct 30 18:49 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1813546555 Oct 30 18:34 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 80542130 Oct 30 21:36 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242951 Oct 30 21:41 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Oct 30 21:41 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Oct 30 21:41 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Oct 30 21:41 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 30 20:31 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 30 18:49 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 30 21:41 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Oct 30 18:29 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Oct 30 21:41 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 30 20:37 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 30 20:31 debugprod.log