MOC Plot at 26n#

# import os
import numpy as np
import matplotlib.pyplot as plt
import xarray as xr

import dask
from dask.distributed import Client
import intake

import pop_tools

import nc_time_axis
import util
### this cell will get parametrized

path_to_cat = "placeholder"
subset_kwargs = {}
asset_path = "placeholder"
# Parameters
casename = "gcp-cases"
title_param = "26n"
path_to_cat = "/glade/u/home/eromashkova/codes/my-cesm-experiment-extended/notebooks/temp_data/gcp-cases_subset.json"
cluster_scheduler_address = "tcp://10.12.206.47:39726"
subset_kwargs = {}
asset_path = "/glade/u/home/eromashkova/codes/my-cesm-experiment-extended/notebooks/cache_data/gcp-cases_POP_MOC_extract_cat_1.nc"

Connecting to cluster#

if cluster_scheduler_address is None:
    cluster, client = util.get_ClusterClient()
    cluster.scale(12)
else:
    client = Client(cluster_scheduler_address)
client

Client

Client-b7afab00-a1a9-11ed-93c7-3cecef1aca46

Connection method: Direct
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/8787/status

Scheduler Info

Scheduler

Scheduler-7cfddfff-723a-4eb5-8b97-437cfe055d0a

Comm: tcp://10.12.206.47:39726 Workers: 14
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/8787/status Total threads: 14
Started: Just now Total memory: 325.92 GiB

Workers

Worker: PBSCluster-0

Comm: tcp://10.12.205.23:42696 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/42447/status Memory: 23.28 GiB
Nanny: tcp://10.12.205.23:45370
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-ldwiof8h
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 0.0% Last seen: Just now
Memory usage: 205.51 MiB Spilled bytes: 0 B
Read bytes: 54.49 kiB Write bytes: 2.76 kiB

Worker: PBSCluster-10

Comm: tcp://10.12.206.54:46661 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/38540/status Memory: 23.28 GiB
Nanny: tcp://10.12.206.54:36281
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-kdng5ht7
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 4.0% Last seen: Just now
Memory usage: 210.19 MiB Spilled bytes: 0 B
Read bytes: 48.39 MiB Write bytes: 0.99 MiB

Worker: PBSCluster-11

Comm: tcp://10.12.206.56:32952 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/43547/status Memory: 23.28 GiB
Nanny: tcp://10.12.206.56:39886
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-s_h6jgot
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 2.0% Last seen: Just now
Memory usage: 214.32 MiB Spilled bytes: 0 B
Read bytes: 103.00 MiB Write bytes: 786.13 kiB

Worker: PBSCluster-12

Comm: tcp://10.12.206.56:35153 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/33514/status Memory: 23.28 GiB
Nanny: tcp://10.12.206.56:44855
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-wxbnwdzh
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 0.0% Last seen: Just now
Memory usage: 221.61 MiB Spilled bytes: 0 B
Read bytes: 102.88 MiB Write bytes: 786.60 kiB

Worker: PBSCluster-14

Comm: tcp://10.12.205.23:35738 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/37595/status Memory: 23.28 GiB
Nanny: tcp://10.12.205.23:32970
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-hd8il_3s
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 0.0% Last seen: Just now
Memory usage: 216.92 MiB Spilled bytes: 0 B
Read bytes: 54.55 kiB Write bytes: 4.10 kiB

Worker: PBSCluster-15

Comm: tcp://10.12.206.54:41090 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/34349/status Memory: 23.28 GiB
Nanny: tcp://10.12.206.54:37296
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-6m7n2cvt
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 2.0% Last seen: Just now
Memory usage: 206.61 MiB Spilled bytes: 0 B
Read bytes: 48.26 MiB Write bytes: 1.00 MiB

Worker: PBSCluster-16

Comm: tcp://10.12.206.60:42728 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/38728/status Memory: 23.28 GiB
Nanny: tcp://10.12.206.60:35710
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-vunonffe
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 2.0% Last seen: Just now
Memory usage: 209.03 MiB Spilled bytes: 0 B
Read bytes: 14.93 kiB Write bytes: 11.47 kiB

Worker: PBSCluster-23

Comm: tcp://10.12.205.23:39804 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/42286/status Memory: 23.28 GiB
Nanny: tcp://10.12.205.23:41617
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-tg14tvbg
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 2.0% Last seen: Just now
Memory usage: 207.81 MiB Spilled bytes: 0 B
Read bytes: 54.46 kiB Write bytes: 5.44 kiB

Worker: PBSCluster-24

Comm: tcp://10.12.205.23:46599 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/43644/status Memory: 23.28 GiB
Nanny: tcp://10.12.205.23:36001
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-ay6s71lw
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 4.0% Last seen: Just now
Memory usage: 194.73 MiB Spilled bytes: 0 B
Read bytes: 54.62 kiB Write bytes: 1.44 kiB

Worker: PBSCluster-25

Comm: tcp://10.12.206.51:44308 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/41280/status Memory: 23.28 GiB
Nanny: tcp://10.12.206.51:44650
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-r68y8gm5
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 2.0% Last seen: Just now
Memory usage: 209.77 MiB Spilled bytes: 0 B
Read bytes: 338.26 MiB Write bytes: 331.20 kiB

Worker: PBSCluster-29

Comm: tcp://10.12.206.51:39955 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/41499/status Memory: 23.28 GiB
Nanny: tcp://10.12.206.51:33751
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-adtwuntq
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 2.0% Last seen: Just now
Memory usage: 197.76 MiB Spilled bytes: 0 B
Read bytes: 336.53 MiB Write bytes: 328.63 kiB

Worker: PBSCluster-3

Comm: tcp://10.12.206.60:44687 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/39923/status Memory: 23.28 GiB
Nanny: tcp://10.12.206.60:33900
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-7z9f9t6k
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 2.0% Last seen: Just now
Memory usage: 197.92 MiB Spilled bytes: 0 B
Read bytes: 14.94 kiB Write bytes: 8.80 kiB

Worker: PBSCluster-31

Comm: tcp://10.12.206.60:35661 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/45124/status Memory: 23.28 GiB
Nanny: tcp://10.12.206.60:39472
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-fbi8k1sf
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 4.0% Last seen: Just now
Memory usage: 215.71 MiB Spilled bytes: 0 B
Read bytes: 14.92 kiB Write bytes: 8.79 kiB

Worker: PBSCluster-9

Comm: tcp://10.12.206.54:42439 Total threads: 1
Dashboard: https://jupyterhub.hpc.ucar.edu/stable/user/eromashkova/proxy/39444/status Memory: 23.28 GiB
Nanny: tcp://10.12.206.54:38421
Local directory: /glade/scratch/eromashkova/dask-workers/dask-worker-space/worker-wug0p2lu
Tasks executing: Tasks in memory:
Tasks ready: Tasks in flight:
CPU usage: 2.0% Last seen: Just now
Memory usage: 194.75 MiB Spilled bytes: 0 B
Read bytes: 48.50 MiB Write bytes: 1.00 MiB
ds = xr.open_dataset(asset_path)
ds
<xarray.Dataset>
Dimensions:  (time: 4428)
Coordinates:
  * time     (time) object 1653-02-01 00:00:00 ... 2022-01-01 00:00:00
Data variables:
    MOC      (time) float32 ...
ds.MOC.plot()
[<matplotlib.lines.Line2D at 0x2aee122f6dc0>]
_images/moc-view-26n_8_1.png
ds.close()