justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 23211.1@dunegpschedd02.fnal.gov

Jobsub ID23211.1@dunegpschedd02.fnal.gov
Workflow ID1736
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-08-20 21:29:41
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp
Last heartbeat2025-08-20 21:32:24
From worker nodeHostnamewn-snel-026.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-08-20 21:30:16
Input filesmonte-carlo-001736-000092
JobscriptExit code0
Real time1m (105s)
CPU time1m (100s = 95%)
Max RSS bytes522371072 (498 MiB)
Outputting started2025-08-20 21:32:02
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/wirecell_sim_tracks/fnal/01736/1/001/bad_apa_23211_1.npz
Finished2025-08-20 21:32:24
Saved logsjustin-logs:23211.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

1
Will use justin-get-file
PFN: 000092
PFN num: 91
jobsub_id: 23211_1
Good apa: false bad_apa_23211_1.npz
Doing tracks
root://fndca1.fnal.gov:1094//pnfs/fnal.gov/usr/dune/resilient/users/calcuttj/test_tracks
[23:30:24.954] D [  main  ] configuring component: "DepoFileSource":""
[23:30:24.955] D [   io   ] <DepoFileSource:> reading test_tracks_91.npz with scale=1 
[23:30:24.955] D [  main  ] configuring component: "Random":""
[23:30:24.955] D [  main  ] configuring component: "Drifter":""
[23:30:24.956] D [  gen   ] <Drifter:> time offset: 0 ms, drift speed: 1.565 mm/us 
[23:30:24.956] D [  main  ] configuring component: "DepoSetDrifter":""
[23:30:24.956] D [  main  ] configuring component: "WireSchemaFile":""
[23:30:24.956] I [  wct   ] loading compressed json file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/a86f07c7506a23a276258783e58616bd3d366426/protodunehd-wires-larsoft-v1.json.bz2
[23:30:29.848] D [  main  ] configuring component: "AnodePlane":"apa0"
[23:30:29.848] D [  geom  ] <AnodePlane:apa0> X planes: "cathode"@ -0.001587500000000091m, "response"@-3.4304650000000003m, "anode"@-3.520945m, dirx=1 
[23:30:29.849] D [  geom  ] <AnodePlane:apa0> face:0, plane:0, origin:(-3430.47 3071.4 1152.36) mm 
[23:30:29.849] D [  geom  ] <AnodePlane:apa0> face:0, plane:1, origin:(-3430.47 3069.72 1152.36) mm 
[23:30:29.850] D [  geom  ] <AnodePlane:apa0> face:0, plane:2, origin:(-3430.47 3068.05 1152.28) mm 
[23:30:29.850] D [  geom  ] <AnodePlane:apa0> face:0 with 3 planes and sensvol: [(-3520.95 76.1 2.34345) --> (-1.5875 6060 2302.36)] 
[23:30:29.850] D [  geom  ] <AnodePlane:apa0> X planes: "cathode"@ -7.1452124999999995m, "response"@-3.716335m, "anode"@-3.625855m, dirx=-1 
[23:30:29.850] D [  geom  ] <AnodePlane:apa0> face:1, plane:0, origin:(-3716.34 3071.4 1152.36) mm 
[23:30:29.851] D [  geom  ] <AnodePlane:apa0> face:1, plane:1, origin:(-3716.34 3069.72 1152.36) mm 
[23:30:29.851] D [  geom  ] <AnodePlane:apa0> face:1, plane:2, origin:(-3716.34 3068.05 1152.43) mm 
[23:30:29.851] D [  geom  ] <AnodePlane:apa0> face:1 with 3 planes and sensvol: [(-7145.21 76.1 2.35463) --> (-3625.86 6060 2302.38)] 
[23:30:29.851] D [  main  ] configuring component: "FftwDFT":""
[23:30:29.851] D [  main  ] configuring component: "FieldResponse":"field0"
[23:30:29.852] I [  wct   ] loading compressed json file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/a86f07c7506a23a276258783e58616bd3d366426/np04hd-garfield-6paths-mcmc-bestfit.json.bz2
[23:30:32.850] D [  main  ] configuring component: "ColdElecResponse":""
[23:30:32.850] D [  main  ] configuring component: "RCResponse":""
[23:30:32.850] D [  main  ] configuring component: "ResponseSys":""
[23:30:32.850] D [  main  ] configuring component: "PlaneImpactResponse":"PIRfield0plane0"
[23:30:32.851] D [  gen   ] <PlaneImpactResponse:PIRfield0plane0> short response ColdElecResponse has different number of samples (6128) than expected (200) 
[23:30:32.851] D [  gen   ] <PlaneImpactResponse:PIRfield0plane0> Nfr=1000 Nfr_slow=200 Nfr_ext=2000 Ner=200 Nfrxer=400 Tfr=100 Ter=500 FieldResponse:field0 
[23:30:32.874] D [  gen   ] <PlaneImpactResponse:PIRfield0plane0> fr=FieldResponse:field0 plane=0 short=100000 long=1500000 tick=500 nticks=6128 
[23:30:32.874] D [  main  ] configuring component: "PlaneImpactResponse":"PIRfield0plane1"
[23:30:32.874] D [  gen   ] <PlaneImpactResponse:PIRfield0plane1> short response ColdElecResponse has different number of samples (6128) than expected (200) 
[23:30:32.874] D [  gen   ] <PlaneImpactResponse:PIRfield0plane1> Nfr=1000 Nfr_slow=200 Nfr_ext=2000 Ner=200 Nfrxer=400 Tfr=100 Ter=500 FieldResponse:field0 
[23:30:32.896] D [  gen   ] <PlaneImpactResponse:PIRfield0plane1> fr=FieldResponse:field0 plane=1 short=100000 long=1500000 tick=500 nticks=6128 
[23:30:32.896] D [  main  ] configuring component: "PlaneImpactResponse":"PIRfield0plane2"
[23:30:32.896] D [  gen   ] <PlaneImpactResponse:PIRfield0plane2> short response ColdElecResponse has different number of samples (6128) than expected (200) 
[23:30:32.897] D [  gen   ] <PlaneImpactResponse:PIRfield0plane2> Nfr=1000 Nfr_slow=200 Nfr_ext=2000 Ner=200 Nfrxer=400 Tfr=100 Ter=500 FieldResponse:field0 
[23:30:32.918] D [  gen   ] <PlaneImpactResponse:PIRfield0plane2> fr=FieldResponse:field0 plane=2 short=100000 long=1500000 tick=500 nticks=6128 
[23:30:32.918] D [  main  ] configuring component: "DepoTransform":"depotransform-apa0"
[23:30:32.919] D [  gen   ] <DepoTransform:depotransform-apa0> tick=0.5 us, start=-313.89776357827475 us, readin=3064 us, drift_speed=1.565 mm/us 
[23:30:32.919] D [  main  ] configuring component: "Reframer":"reframer-apa0"
[23:30:32.919] D [  gen   ] <Reframer:reframer-apa0> using anode: "AnodePlane:apa0" 
[23:30:32.919] D [  main  ] configuring component: "FrameFileSink":"bad_apa_23211_1.npz"
[23:30:32.920] D [   io   ] <FrameFileSink:bad_apa_23211_1.npz> save * with baseline=0 scale=1 offset=0 digitize=false ch=[0,2560] tbin=[0,6000] to bad_apa_23211_1.npz 
[23:30:32.920] D [  main  ] configuring component: "Pgrapher":""
[23:30:32.920] D [ pgraph ] <Pgrapher:> connecting: 4 edges 
[23:30:32.920] D [ pgraph ] connect <Node  type:WireCell::Sio::DepoFileSource cat:1 sig:WireCell::IDepoSetSource inputs:[ ] outputs:[ WireCell::IDepoSet ]:(WireCell::IDepoSet:0) -> <Node  type:WireCell::Gen::DepoSetDrifter cat:3 sig:WireCell::IDepoSetFilter inputs:[ WireCell::IDepoSet ] outputs:[ WireCell::IDepoSet ](WireCell::IDepoSet:0)
[23:30:32.920] D [ pgraph ] connect <Node  type:WireCell::Gen::DepoSetDrifter cat:3 sig:WireCell::IDepoSetFilter inputs:[ WireCell::IDepoSet ] outputs:[ WireCell::IDepoSet ]:(WireCell::IDepoSet:0) -> <Node  type:WireCell::Gen::DepoTransform cat:3 sig:WireCell::IDepoFramer inputs:[ WireCell::IDepoSet ] outputs:[ WireCell::IFrame ](WireCell::IDepoSet:0)
[23:30:32.920] D [ pgraph ] connect <Node  type:WireCell::Gen::Reframer cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::Sio::FrameFileSink cat:2 sig:WireCell::IFrameSink inputs:[ WireCell::IFrame ] outputs:[ ](WireCell::IFrame:0)
[23:30:32.920] D [ pgraph ] connect <Node  type:WireCell::Gen::DepoTransform cat:3 sig:WireCell::IDepoFramer inputs:[ WireCell::IDepoSet ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::Gen::Reframer cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[23:30:32.920] D [  main  ] executing 1 apps, thread limit 0:
[23:30:32.920] D [  main  ] executing 1 apps, thread limit 0:
[23:30:32.920] D [  main  ] executing app: "Pgrapher"
[23:30:32.920] D [ pgraph ] <Pgrapher:> executing graph 
[23:30:32.920] D [ pgraph ] executing with 5 nodes
[23:30:32.981] D [   io   ] <DepoFileSource:> call=0 loaded 248857 active, 248857 total depos from ident 0 stream test_tracks_91.npz with 0 priors 
[23:30:33.771] D [  gen   ] <Drifter:> see EOS, ( dropped:14511 + drifted:234346 ) / total:248857 depos from stream, outside of all 2 drift xregions 
[23:30:33.787] D [  gen   ] <DepoSetDrifter:> call=0 drifted ndepos=234346 Qout=-1147333239 (92.20823517120274%) 
[23:31:02.043] D [  gen   ] <DepoTransform:depotransform-apa0> plane=0 face=0 depos=185382 total traces=1120 
[23:31:29.976] D [  gen   ] <DepoTransform:depotransform-apa0> plane=1 face=0 depos=185382 total traces=2268 
[23:31:56.908] D [  gen   ] <DepoTransform:depotransform-apa0> plane=2 face=0 depos=185382 total traces=2748 
[23:31:58.332] D [  gen   ] <DepoTransform:depotransform-apa0> plane=0 face=1 depos=14005 total traces=3540 
[23:31:59.638] D [  gen   ] <DepoTransform:depotransform-apa0> plane=1 face=1 depos=14005 total traces=4340 
[23:32:00.632] D [  gen   ] <DepoTransform:depotransform-apa0> plane=2 face=1 depos=14005 total traces=4702 
[23:32:00.641] D [  gen   ] <DepoTransform:depotransform-apa0> call=0 count=100 ndepos_in=234346 ndepos_used=199387 
[23:32:00.641] D [  gen   ] <DepoTransform:depotransform-apa0> output: frame: ident=100 time=-313898 tick=500 with 4702 traces.  frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] 
[23:32:00.822] D [  gen   ] <Reframer:reframer-apa0> input : frame: ident=100 time=-313898 tick=500 with 4702 traces.  frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] 
[23:32:00.822] D [  gen   ] <Reframer:reframer-apa0> output: frame: ident=100 time=-249898 tick=500 with 2560 traces.  frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] 
[23:32:00.824] D [   io   ] <FrameFileSink:bad_apa_23211_1.npz> input frame: frame: ident=100 time=-249898 tick=500 with 2560 traces.  frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] 
[23:32:00.824] D [   io   ] <FrameFileSink:bad_apa_23211_1.npz> call=0 frame=100 ntraces=2560 tag="*" 
[23:32:02.480] D [   io   ] <FrameFileSink:bad_apa_23211_1.npz> no channel mask maps at call 0 
[23:32:02.488] D [   io   ] <DepoFileSource:> call=1, read1 depo stream EOF with file=test_tracks_91.npz 
[23:32:02.488] D [   io   ] <DepoFileSource:> EOS at call=1 
[23:32:02.488] D [  gen   ] <DepoSetDrifter:> EOS at call=1 
[23:32:02.488] D [  gen   ] <DepoTransform:depotransform-apa0> EOS at call=1 
[23:32:02.488] D [  gen   ] <Reframer:reframer-apa0> EOS at call=1 
[23:32:02.488] D [   io   ] <FrameFileSink:bad_apa_23211_1.npz> EOS at call=1 
[23:32:02.488] D [ pgraph ] <Pgrapher:> graph execution complete 
[23:32:02.488] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 86.14 sec
[23:32:02.488] I [ timer  ] Timer: WireCell::Sio::FrameFileSink : 1.66 sec
[23:32:02.488] I [ timer  ] Timer: WireCell::Gen::DepoSetDrifter : 0.76 sec
[23:32:02.488] I [ timer  ] Timer: WireCell::Sio::DepoFileSource : 0.07 sec
[23:32:02.488] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.04 sec
[23:32:02.488] I [ timer  ] Timer: Total node execution : 88.66999934613705 sec
[23:32:02.489] D [  main  ] finalizing component: "FrameFileSink":"bad_apa_23211_1.npz"
[23:32:02.489] D [   io   ] <FrameFileSink:bad_apa_23211_1.npz> closing bad_apa_23211_1.npz after 2 calls
justIN time: 2025-09-19 09:27:15 UTC       justIN version: 01.05.00