Jobsub ID 233301.2@dunegpschedd01.fnal.gov
| Jobsub ID | 233301.2@dunegpschedd01.fnal.gov |
| Workflow ID | 8928 |
| Stage ID | 1 |
| User name | jjo@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8387559424 (7999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-10-13 13:53:54 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-10-13 17:36:41 |
| From worker node | Hostname | dunegli-7231092-0-fnpc22020.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-13 13:57:51 |
| Input files | monte-carlo-008928-000003
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13108s) |
| CPU time | 3h (12899s = 98%) |
| Max RSS bytes | 7835983872 (7472 MiB) |
| Outputting started | 2025-10-13 17:36:19 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/jjo/fnal/08928/1/001/monte-carlo-008928-000003_233301_2_1_20251013T135755Z_reco.root
|
| Finished | 2025-10-13 17:36:41 |
| Saved logs | justin-logs:233301.2-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
5] D [sigproc ] <OmnibusSigProc:anode0sigproc0> call=38 save plane index: 0, Qtot=31689313 Qloss=-2579103, 939 indices spanning [2949,3887] "gauss"
[17:36:16.977] D [sigproc ] <OmnibusSigProc:anode0sigproc0> call=38 save plane index: 1, Qtot=34529262 Qloss=-3938699, 1265 indices spanning [3888,5152] "wiener"
[17:36:17.057] D [sigproc ] <OmnibusSigProc:anode0sigproc0> call=38 save plane index: 1, Qtot=31972798 Qloss=-2625397, 1122 indices spanning [5153,6274] "gauss"
[17:36:17.219] D [sigproc ] <OmnibusSigProc:anode0sigproc0> call=38 save plane index: 2, Qtot=29565240 Qloss=-1126586, 715 indices spanning [6275,6989] "wiener"
[17:36:17.372] D [sigproc ] <OmnibusSigProc:anode0sigproc0> call=38 save plane index: 2, Qtot=28968841 Qloss=-522596, 603 indices spanning [6990,7592] "gauss"
[17:36:17.372] D [sigproc ] <OmnibusSigProc:anode0sigproc0> call=38 produce 7593 traces: 2996 wiener0, 0 decon_charge0, 2664 gauss0, frame tag: sigproc
[17:36:17.372] D [sigproc ] <OmnibusSigProc:anode0sigproc0> call=38 output frame: frame: ident=20 time=12 tick=500 with 7593 traces. frame tags:[ "sigproc" ] 4 tagged trace sets:[ "gauss0":2664 [0] "mp2_roi0":1268 [0] "mp3_roi0":665 [0] "wiener0":2996 [2996] ] cmm:[ ]
[17:36:17.382] D [ glue ] <FrameFanin:nfsp> call=38 input 0: frame: ident=20 time=12 tick=500 with 7593 traces. frame tags:[ "sigproc" ] 4 tagged trace sets:[ "gauss0":2664 [0] "mp2_roi0":1268 [0] "mp3_roi0":665 [0] "wiener0":2996 [2996] ] cmm:[ ] input 1: frame: ident=20 time=12 tick=500 with 8535 traces. frame tags:[ "sigproc" ] 4 tagged trace sets:[ "gauss1":3002 [0] "mp2_roi1":1564 [0] "mp3_roi1":403 [0] "wiener1":3566 [3566] ] cmm:[ ] input 2: frame: ident=20 time=12 tick=500 with 31898 traces. frame tags:[ "sigproc" ] 4 tagged trace sets:[ "gauss2":9015 [0] "mp2_roi2":9380 [0] "mp3_roi2":2559 [0] "wiener2":10944 [10944] ] cmm:[ ] input 3: frame: ident=20 time=12 tick=500 with 17545 traces. frame tags:[ "sigproc" ] 4 tagged trace sets:[ "gauss3":5258 [0] "mp2_roi3":4511 [0] "mp3_roi3":1307 [0] "wiener3":6469 [6469] ] cmm:[ ] input 4: frame: ident=20 time=12 tick=500 with 21403 traces. frame tags:[ "sigproc" ] 4 tagged trace sets:[ "gauss4":6222 [0] "mp2_roi4":5874 [0] "mp3_roi4":2041 [0] "wiener4":7266 [7266] ] cmm:[ ] input 5: frame: ident=20 time=12 tick=500 with 7286 traces. frame tags:[ "sigproc" ] 4 tagged trace sets:[ "gauss5":2125 [0] "mp2_roi5":1793 [0] "mp3_roi5":602 [0] "wiener5":2766 [2766] ] cmm:[ ] input 6: frame: ident=20 time=12 tick=500 with 26535 traces. frame tags:[ "sigproc" ] 4 tagged trace sets:[ "gauss6":7895 [0] "mp2_roi6":6869 [0] "mp3_roi6":2002 [0] "wiener6":9769 [9769] ] cmm:[ ] input 7: frame: ident=20 time=12 tick=500 with 18943 traces. frame tags:[ "sigproc" ] 4 tagged trace sets:[ "gauss7":5613 [0] "mp2_roi7":5209 [0] "mp3_roi7":1447 [0] "wiener7":6674 [6674] ] cmm:[ ] output: frame: ident=20 time=12 tick=500 with 139738 traces. frame tags:[ "framefanin" ] 16 tagged trace sets:[ "gauss0":2664 [0] "gauss1":3002 [0] "gauss2":9015 [0] "gauss3":5258 [0] "gauss4":6222 [0] "gauss5":2125 [0] "gauss6":7895 [0] "gauss7":5613 [0] "wiener0":2996 [2996] "wiener1":3566 [3566] "wiener2":10944 [10944] "wiener3":6469 [6469] "wiener4":7266 [7266] "wiener5":2766 [2766] "wiener6":9769 [9769] "wiener7":6674 [6674] ] cmm:[ ]
Retagger: tagging trace set: wiener with 50450 traces, 50450 summary
Retagger: tagging trace set: gauss with 41794 traces, 0 summary
[17:36:17.386] D [ glue ] sink frame: #20 @1.2e-05 with 139738 traces, frame tags:[retagger], trace tags:[gauss, wiener]
[17:36:17.387] D [ glue ] <FrameFanout:nfsp> call=39: see EOS
[17:36:17.387] D [ glue ] <ChannelSelector:chsel7> see EOS at call=19
[17:36:17.387] D [sigproc ] <OmnibusSigProc:anode7sigproc7> EOS at call=39 anode=7
[17:36:17.387] D [ glue ] <ChannelSelector:chsel6> see EOS at call=19
[17:36:17.387] D [sigproc ] <OmnibusSigProc:anode6sigproc6> EOS at call=39 anode=6
[17:36:17.387] D [ glue ] <ChannelSelector:chsel5> see EOS at call=19
[17:36:17.387] D [sigproc ] <OmnibusSigProc:anode5sigproc5> EOS at call=39 anode=5
[17:36:17.387] D [ glue ] <ChannelSelector:chsel4> see EOS at call=19
[17:36:17.387] D [sigproc ] <OmnibusSigProc:anode4sigproc4> EOS at call=39 anode=4
[17:36:17.387] D [ glue ] <ChannelSelector:chsel3> see EOS at call=19
[17:36:17.387] D [sigproc ] <OmnibusSigProc:anode3sigproc3> EOS at call=39 anode=3
[17:36:17.387] D [ glue ] <ChannelSelector:chsel2> see EOS at call=19
[17:36:17.387] D [sigproc ] <OmnibusSigProc:anode2sigproc2> EOS at call=39 anode=2
[17:36:17.387] D [ glue ] <ChannelSelector:chsel1> see EOS at call=19
[17:36:17.387] D [sigproc ] <OmnibusSigProc:anode1sigproc1> EOS at call=39 anode=1
[17:36:17.387] D [ glue ] <ChannelSelector:chsel0> see EOS at call=19
[17:36:17.387] D [sigproc ] <OmnibusSigProc:anode0sigproc0> EOS at call=39 anode=0
[17:36:17.387] D [ glue ] <FrameFanin:nfsp> EOS at call=39 with 8
[17:36:17.387] D [ glue ] frame sink sees EOS
[17:36:17.387] D [ pgraph ] <Pgrapher:> graph execution complete
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 3.97 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 3.82 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 3.61 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 3.55 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 3.42 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 3.34 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 3.19 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 3.19 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[17:36:17.387] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:36:17.387] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:36:17.387] I [ timer ] Timer: WireCell::Gen::Retagger : 0 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:36:17.387] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:36:17.387] I [ timer ] Timer: WireCell::Gen::FrameFanout : 0 sec
[17:36:17.387] I [ timer ] Timer: wcls::RawFrameSource : 0 sec
[17:36:17.387] I [ timer ] Timer: wcls::FrameSaver : 0 sec
[17:36:17.387] I [ timer ] Timer: Total node execution : 28.099999913945794 sec
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 41794 traces tagged "gauss"
FrameSaver: q=9.15273e+06 n=746847 tag=gauss
wclsFrameSaver: saving 50450 traces tagged "wiener"
FrameSaver: q=9.51227e+06 n=713131 tag=wiener
13-Oct-2025 17:36:19 UTC Closed output file "monte-carlo-008928-000003_233301_2_1_20251013T135755Z_reco.root"
13-Oct-2025 17:36:19 UTC Closed input file "detsim.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 25.2481 29.6844 37.4873 29.3328 2.79262 20
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000501486 0.00150615 0.0021629 0.00167158 0.000461487 20
reco:rns:RandomNumberSaver 3.0848e-05 5.31594e-05 0.00026495 4.0612e-05 4.93788e-05 20
reco:wclsdatavd:WireCellToolkit 24.5523 28.8525 36.6212 28.55 2.74059 20
reco:gaushit:GausHitFinder 0.401548 0.616155 0.893053 0.644016 0.145189 20
[art]:TriggerResults:TriggerResultInserter 1.1081e-05 1.99657e-05 5.5986e-05 1.74075e-05 9.76583e-06 20
end_path:out1:RootOutput 2.755e-06 6.6085e-06 2.0118e-05 4.9395e-06 4.96708e-06 20
end_path:out1:RootOutput(write) 0.140174 0.21193 0.304562 0.206776 0.0437316 20
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5665.12 MB
Peak resident set size usage (VmHWM): 3976.41 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Job completed successfully.
-rw-r--r-- 1 dunegli fnalgrid 3.6G Oct 13 17:24 detsim.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 13 17:24 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 13 14:14 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 5.3G Oct 13 14:08 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 12G Oct 13 14:14 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 998K Oct 13 13:59 gen.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 13 13:59 gen_protodunevd_cosmics_hist.root
-rw-r--r-- 1 dunegli fnalgrid 3.7G Oct 13 17:36 monte-carlo-008928-000003_233301_2_1_20251013T135755Z_reco.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 13 17:36 reco_protoDUNE_hist.root
