Welcome to mist.client’s documentation!

Version:0.3.0
Author:Mist.io Inc
Source:https://github.com/mistio/mist.client
License:GPL v3

Mist is a Python and a command line interface for managing and monitoring servers across clouds from any device that can access the web. To use it you need an account to the freemium https://mist.io service or a private open source installation of mist.io.

Quickstart

Quickstart Guide

In this quickstart guide we’ll see how to provision and manage servers on an Openstack backend.

pip install mist

After installing mist:

from mistclient import MistClient
client = MistClient(email="demo@mist.io", password="supersecret")

We have a stack of 4 machines to provision:

machines = [
'dbserver1',
'dbserver2',
'haproxy',
'webserver'
]

We add our Openstack backend:

client.add_backend(title="Openstack", proviser="openstack", key="admin', secret="admin_pass", apiurl="http://10.0.0.1:5000", tenant_name="admin")

We then provision those machines in this newly added Openstack backend, using a auto-generated key:

private = client.generate_key()
key = client.add_key(key_name="MyKey", private=private)
backend = client.backends(search="Openstack")[0]

for machine in machines:
    backend.create_machine(name=machine, key=key, image_id="a098798798-9809808-098098", size_id="2", location_id="1")

We then tag the machines with the dev tag:

for machine_name in machines:
    machine = client.machines(name=machine_name)
    machine.tag("dev")

We will now use the mist command line tool to manage those servers. Use the mist run option to run a command accross tagged servers:

mist run --command "apt-get update -y" --tag dev

mistclient - Python interface

Installation

Install using pip

This is the easiest way to obtain the mist.client package:

pip install mist

You now have the mistclient module and the mist command line tool installed.

Note

You may have to install ansible separately: pip install ansible, prior to installing mist.

Clone from Github

mist is an opensource project and can be found here on its github page: https://github.com/mistio/mist.client

git clone https://github.com/mistio/mist.client

Install mist.client:

python setup.py install

Install for development:

python setup.py develop

Getting Started

Now that you have the mistclient package you can import it to use it:

from mistclient import MistClient
client = MistClient(email="yourmail@mist.io", password="yourpassword")

By default MistClient will try to connect to the mist.io service, with default url set to https://mist.io. However, you may have a custom, in-house installation of mist.io as described here: https://github.com/mistio/mist.io. In this case you may change the url and even leave email and password blank (if it is an in-house installation without authentication):

client = MistClient(mist_uri="http://localhost:8000")

Backends

A backend can be an IaaS cloud, a Docker host, or any single server.

Supported Providers

Mist.io supports a big list of providers including EC2, Rackspace, SoftLayer, Digital Ocean, Nephoscale, Openstack, Docker, HP Cloud and any single server.

In order to see the list of all supported providers:

client.supported_providers

The result will look like this:

[{u'provider': u'bare_metal', u'title': u'Bare Metal Server'},
{u'provider': u'ec2_ap_northeast', u'title': u'EC2 AP NORTHEAST'},
{u'provider': u'ec2_ap_southeast', u'title': u'EC2 AP SOUTHEAST'},
{u'provider': u'ec2_ap_southeast_2', u'title': u'EC2 AP Sydney'},
{u'provider': u'ec2_eu_west', u'title': u'EC2 EU Ireland'},
{u'provider': u'ec2_sa_east', u'title': u'EC2 SA EAST'},
{u'provider': u'ec2_us_east', u'title': u'EC2 US EAST'},
{u'provider': u'ec2_us_west', u'title': u'EC2 US WEST'},
{u'provider': u'ec2_us_west_oregon', u'title': u'EC2 US WEST OREGON'},
{u'provider': u'gce', u'title': u'Google Compute Engine'},
{u'provider': u'nephoscale', u'title': u'NephoScale'},
{u'provider': u'digitalocean', u'title': u'DigitalOcean'},
{u'provider': u'linode', u'title': u'Linode'},
{u'provider': u'openstack', u'title': u'OpenStack'},
{u'provider': u'rackspace:dfw', u'title': u'Rackspace DFW'},
{u'provider': u'rackspace:ord', u'title': u'Rackspace ORD'},
{u'provider': u'rackspace:iad', u'title': u'Rackspace IAD'},
{u'provider': u'rackspace:lon', u'title': u'Rackspace LON'},
{u'provider': u'rackspace:syd', u'title': u'Rackspace AU'},
{u'provider': u'rackspace:hkg', u'title': u'Rackspace HKG'},
{u'provider': u'rackspace_first_gen:us', u'title': u'Rackspace US (OLD)'},
{u'provider': u'rackspace_first_gen:uk', u'title': u'Rackspace UK (OLD)'},
{u'provider': u'softlayer', u'title': u'SoftLayer'},
{u'provider': u'hpcloud:region-a.geo-1',
u'title': u'HP Helion Cloud - US West'},
{u'provider': u'hpcloud:region-b.geo-1',
u'title': u'HP Helion Cloud - US East'},
{u'provider': u'docker', u'title': u'Docker'}]

Add Backend

Before anything you must add your Backends to the mist.io service. By doing that you’ll be able to handle all your machines from the mist.io service or the service’s API.

In order to add a backend, you’ll need the provider information from the supported providers you listed before. For example to add a “Rackspace LON” backend:

client.add_backend(provider="rackspace:lon", title="My Rack London", key="rack_username", secret="rack_api_secret")

See also mist.client.add_backend method for detailed information about the different params for each backend.

After adding a new backend, mist.backends are automatically updated.

Backend actions

You can see all of your added backends:

client.backends()

This will return a list of all your added backends:

[Backend => EC2 AP NORTHEAST, ec2_ap_northeast, D1g9abwqGUmQuZKGGBMfCgw8AUQ,
 Backend => openstackaf0.mist.io, bare_metal, 2Mn2ZnCoXhK3ywqzGn1fzWVmSSe6,
 Backend => Icehouse, openstack, 4ukW6Juooqa8bTu2YgM4mE8RAsk7,
 Backend => EC2 AP Sydney, ec2_ap_southeast_2, 25ykPERh5D17DyoeKsCgw35DLmvw,
 Backend => Openstack Juno, openstack, 2u5yKqXmDiZ7BHCk1u17FFcmFS2m,
 Backend => HP Helion Cloud, hpcloud, 3WwgPBXETjdeMEbM5fUCACSvedGT,
 Backend => Google Compute Engine, gce, g6T3HYae2ZMcHfHyFGKVtMG6PZU,
 Backend => Docker, docker, B3rbEA6bteaqMWJ4obVbgbqrXWf,
 Backend => openstackdfe.mist.io, bare_metal, XMdRN2u3NVASMm14BuHo4HJnS15]

You can also choose a backend by providing either the backend’s name or id:

backend = client.backends(id="XMdRN2u3NVASMm14BuHo4HJnS15")[0]
backend = client.backends(name="Docker")[0]

You can also search in all the backends’ ids and names:

backend = client.backends(search="OpenStack")[0]

Your new backend object has a lot of attributes and methods:

backend.id
backend.info
backend.images
...

See mistclient.model.Backend class for detailed information.

You have the option to rename a backend:

backend.rename("newName")

Finally, you can delete a backend:

backend.delete()

Keys

By uploading your SSH keys to mist.io you can access all your machines through mist.io, have a shell prompt from your browser and even let mist.io take care of enabling monitoring to your machines. You also can have mist.io run commands to your machines during provisiong or after an alert is triggered.

Add a new key

When adding a new key, you have 2 choices. Either upload a local ssh-key to mist.io, or ask mist.io to generate one for you.

When uploading a local ssh-key, you have to provide the private ssh-key as a string. So first you can:

with open("/home/user/.ssh/my_key") as f:
    private = f.read()

You now have the private key and can add a new key to mist.io:

client.add_key(key_name="MyKey", private=private)

Or have mist.io generate a randon one for you:

private = client.generate_key()
client.add_key(key_name="MyKey", private=private)

After adding a new key, client.keys will be automatically updated.

Keys actions

To see all added keys:

client.keys()

The result will be a list like this:

[Key => Dummy,
 Key => ParisDemo2,
 Key => testkey,
 Key => DemoKey,
 Key => TestKey,
 Key => ParisDemo]

You can now search for key names:

key = client.keys(search="Paris")[0]

You have the option to set a key as the default one. This becomes handy if you want mist.io to auto-assign this key to a machine if you leave the association blank:

key.set_default()

You can rename the key:

key.rename("newName")

Finally, to delete the key:

key.delete()

See mistclient.model.Key class for detailed information.

Machines

Before you can provision a machine, you have to know some data that are necessary for the creation of a machine. Every backend has different OS Images, locations, machine sizes. You can list all the available options after you have chosen a backend:

backend = client.backends(search="NephoScale")

Images

You can list all available OS Images in a backend:

backend.images

This will return a list of all available images. From the desired image you will need the image’s id in order to create a machine with that image:

[{u'extra': {u'architecture': u'x86',
   u'billable_type': None,
   u'cores': None,
   u'disks': None,
   u'pcpus': None,
   u'storage': None,
   u'uri': u'https://api.nephoscale.com/image/server/3/'},
  u'id': u'3',
  u'name': u'Linux CentOS 5.5 32-bit',
  u'star': True},
 {u'extra': {u'architecture': u'x86_64',
   u'billable_type': None,
   u'cores': None,
   u'disks': None,
   u'pcpus': None,
   u'storage': None,
   u'uri': u'https://api.nephoscale.com/image/server/5/'},
  u'id': u'5',
  u'name': u'Linux CentOS 5.5 64-bit',
  u'star': True},
 {u'extra': {u'architecture': u'x86',
   u'billable_type': None,
   u'cores': None,
   u'disks': None,
   u'pcpus': None,
   u'storage': None,
   u'uri': u'https://api.nephoscale.com/image/server/23/'},
  u'id': u'23',
  u'name': u'Linux Debian Server 5.05 32-bit',
  u'star': True},
 {u'extra': {u'architecture': u'x86',
   u'billable_type': None,
   u'cores': None,
   u'disks': None,
   u'pcpus': None,
   u'storage': None,
   u'uri': u'https://api.nephoscale.com/image/server/43/'},
  u'id': u'43',
  u'name': u'Linux Ubuntu Server 10.04 LTS 32-bit',
  u'star': True},
 {u'extra': {u'architecture': u'x86',
   u'billable_type': None,
   u'cores': None,
   u'disks': None,
   u'pcpus': None,
   u'storage': None,
   u'uri': u'https://api.nephoscale.com/image/server/45/'},
  u'id': u'45',
  u'name': u'Linux CentOS 5.7 32-bit',
  u'star': True},
 {u'extra': {u'architecture': u'x86_64',
   u'billable_type': None,
   u'cores': None,
   u'disks': None,
   u'pcpus': None,
   u'storage': None,
   u'uri': u'https://api.nephoscale.com/image/server/49/'},
  u'id': u'49',
  u'name': u'Linux Ubuntu Server 10.04 LTS 64-bit',
  u'star': True},
 {u'extra': {u'architecture': u'x86_64',
   u'billable_type': None,
   u'cores': None,
   u'disks': None,
   u'pcpus': None,
   u'storage': None,
   u'uri': u'https://api.nephoscale.com/image/server/51/'},
  u'id': u'51',
  u'name': u'Linux Debian Server 6.0.3 64-bit',
  u'star': True},
 {u'extra': {u'architecture': u'x86_64',
   u'billable_type': None,
   u'cores': None,
   u'disks': None,
   u'pcpus': None,
   u'storage': None,
   u'uri': u'https://api.nephoscale.com/image/server/55/'},
  u'id': u'55',
  u'name': u'Linux Debian 5.0.9 64-bit',
  u'star': True}]

image_id = backend.images[0]['id']

You also have the option to search for an image. Especially in EC2 backends, the result of the search will include community and public images:

backend.search_image("Debian")

Sizes

To list available machine sizes for the chosen backend:

backend.sizes

From the list of all available sizes, you’ll also need the id of the desired size:

[{u'bandwidth': None,
  u'disk': 25,
  u'driver': u'NephoScale',
  u'id': u'219',
  u'name': u'CS05-SSD - 0.5GB, 1Core, 25GB, 10 Gbps',
  u'price': None,
  u'ram': 512},
 {u'bandwidth': None,
  u'disk': 25,
  u'driver': u'NephoScale',
  u'id': u'221',
  u'name': u'CS1-SSD - 1GB, 1Core, 25GB, 10 Gbps',
  u'price': None,
  u'ram': 1024},
  ...

size_id = backend.sizes[0]['id']

Locations

Some backends have different locations for you to provision a machine to. You can list them:

backend.locations

From the list of available locations, you’ll need the id of the desired location:

[{u'country': u'US', u'id': u'86945', u'name': u'SJC-1'},
 {u'country': u'US', u'id': u'87729', u'name': u'RIC-1'}]

location_id = backend.locations[0]

Create machines

In order to create a machine you basically need to have chosen a backend, a key, image_id, location_id, size_id and a name for the machine:

backend.create_machine(name="production.server", key=key, image_id=image_id, location_id=location_id, size_id=size_id)

In some backends some extra information is needed. You can see mistclient.model.Backend.create_machine method for more details.

Machine actions

You can see a list of all your created machines for a given backend:

client.machines()

Or for a specific backend:

backend.machines()

You can choose one:

machine = client.machines(search="dev")[0]
machine = client.machines(name="dbserver1")[0]

Machines support actions like:

machine.reboot()
machine.start()
machine.stop()
machine.destroy()

After creating a machine, the machine may take some time to be up and running. You can see that by using machine.probe(). Machine probe, if successful will show that the machine is up and running and that the key association was successful. It will also return some useful information about the machine like the machine’s uptime etc.

In case you want, you can associate another ssh-key to the machine, provided you have uploaded that key to mist.io service:

machine.associate_key(key_id, host="187.23.43.98")

The host of the machine can be found in the machine.info[‘public_ips’] list. You can also provide two more parameters. ssh_user and ssh_port.

Monitoring

Enable monitoring

In case you have an account with the mist.io service (https://mist.io), you can enable monitoring to a machine:

machine.enable_monitoring()

This will take some time, cause mist.io will auto-install collectd and configure it to send monitoting data to mist.io servers. One way to see that the process has finished and you have data coming is:

machine.get_stats()

In case enabling monitoring has finished you’ll get your monitoring data in a dict.

Advanced monitoring options

By default, mist.io’s collectd will be configured with some metrics, like Disk usage, CPU usage etc. However, mist.io supports a huge list of collectd plugins that you can choose from:

machine.available_metrics

Using your desired metric id, you can add that to a monitored machine. For example to have data about the number of users that are currently logged in, we can use the users metric:

machine.add_metric("users")

Custom metrics

Since the last updates of mist.io, you can now upload custom python metrics that can literally monitor anything. These plugins are simple python files that you can upload to the machine. They can be as simple as:

import random

def read():
    # return random value
    return random.random()

Or more complex, taking care of pings to other servers etc.

To upload a custom plugin to a monitored machine, all you need is the python file’s path in your computer, and a name for the plugin:

machine.add_python_plugin(name="Random", python_file="/home/user/random.py")

Some more advanced options can be used, determining the value_type, the unit etc. You can see mistclient.model.Machine.add_python_plugin method for more info.

mist - command line interface

Getting Started with mist command

The mist command line tool gets installed alongside mist package.

mist will prompt for your mist email and password. At the end it will ask you to create a config file ~/.mist. By having the config file you’ll be able to use mist command without providing your credentials every time. The config file will look like this:

[mist.io]
mist_uri=https://mist.io

[mist.credentials]
email=user@mist.io
password=mist_password

Note

In case you have a private installation of mist.io you can change the mist_uri to point to your custom url

Note

The mist command line tool supports bash completion.

To enable auto-completion, you have to do the following:

sudo activate-global-python-argcomplete

And then add the following line in your ~/.bashrc:

eval "$(register-python-argcomplete  /usr/bin/mist)"

To see your accounts’ specific information:

mist user-info

Output:

User Details:
+---------+--------------+-------------------+--------------+------------------+
| country | company_name | number_of_servers |     name     | number_of_people |
+---------+--------------+-------------------+--------------+------------------+
|  Greece |     Mist     |        1-5        | John Doe     |       1-5        |
+---------+--------------+-------------------+--------------+------------------+

Current Plan:
+---------------+------------+---------+--------------------------+---------+-------------+---------------------------+
| machine_limit | promo_code |  title  |         started          | isTrial | has_expired |         expiration        |
+---------------+------------+---------+--------------------------+---------+-------------+---------------------------+
|       20      |            | Startup | Mon Oct 28 18:49:50 2013 |   True  |    False    | Mon Jun 24 19:41:35 29393 |
|               |            |         |                          |         |             |                           |
+---------------+------------+---------+--------------------------+---------+-------------+---------------------------+

General Usage

The command line tool is used as mist <action> [--extra-params...]

For example:

mist list-providers
mist list-machines
mist add-backend --name EC2 --provider ec2_ap_northeast --ec2-api-key IUOOLK9098OLIU --ec2-api-secret sahkjlhadoiu098098lLKlkjlkj
mist delete-backend Rackspace
mist create-machine --name dbServer

mist backends

With mist you can handle multiple machines on multiple providers from one interface, the mist.io service. In order to do so, the very first thing to do when using mist.io is to ensure that you have added your backends. After doing that you’ll be able to provision, monitor and in general handle all your machines on all those providers.

Supported Providers

Before you add a new backend, you’ll find it useful to see a list of all the providers that mist.io supports:

mist list-providers

Output:

Bare Metal Server              bare_metal
Azure                          azure
EC2 AP NORTHEAST               ec2_ap_northeast
EC2 AP SOUTHEAST               ec2_ap_southeast
EC2 AP Sydney                  ec2_ap_southeast_2
EC2 EU Ireland                 ec2_eu_west
EC2 SA EAST                    ec2_sa_east
EC2 US EAST                    ec2_us_east
EC2 US WEST                    ec2_us_west
EC2 US WEST OREGON             ec2_us_west_oregon
Google Compute Engine          gce
NephoScale                     nephoscale
DigitalOcean                   digitalocean
Linode                         linode
OpenStack                      openstack
Rackspace DFW                  rackspace:dfw
Rackspace ORD                  rackspace:ord
Rackspace IAD                  rackspace:iad
Rackspace LON                  rackspace:lon
Rackspace AU                   rackspace:syd
Rackspace HKG                  rackspace:hkg
Rackspace US (OLD)             rackspace_first_gen:us
Rackspace UK (OLD)             rackspace_first_gen:uk
SoftLayer                      softlayer
HP Helion Cloud - US West      hpcloud:region-a.geo-1
HP Helion Cloud - US East      hpcloud:region-b.geo-1
Docker                         docker

Note

With every list action, you can have the output in a more pretty format by providing the --pretty flag.

For example, mist list-providers --pretty will return this output:

+---------------------------+------------------------+
|           Title           |      Provider ID       |
+---------------------------+------------------------+
|     Bare Metal Server     |       bare_metal       |
|           Azure           |         azure          |
|      EC2 AP NORTHEAST     |    ec2_ap_northeast    |
|      EC2 AP SOUTHEAST     |    ec2_ap_southeast    |
|       EC2 AP Sydney       |   ec2_ap_southeast_2   |
|       EC2 EU Ireland      |      ec2_eu_west       |
|        EC2 SA EAST        |      ec2_sa_east       |
|        EC2 US EAST        |      ec2_us_east       |
|        EC2 US WEST        |      ec2_us_west       |
|     EC2 US WEST OREGON    |   ec2_us_west_oregon   |
|   Google Compute Engine   |          gce           |
|         NephoScale        |       nephoscale       |
|        DigitalOcean       |      digitalocean      |
|           Linode          |         linode         |
|         OpenStack         |       openstack        |
|       Rackspace DFW       |     rackspace:dfw      |
|       Rackspace ORD       |     rackspace:ord      |
|       Rackspace IAD       |     rackspace:iad      |
|       Rackspace LON       |     rackspace:lon      |
|        Rackspace AU       |     rackspace:syd      |
|       Rackspace HKG       |     rackspace:hkg      |
|     Rackspace US (OLD)    | rackspace_first_gen:us |
|     Rackspace UK (OLD)    | rackspace_first_gen:uk |
|         SoftLayer         |       softlayer        |
| HP Helion Cloud - US West | hpcloud:region-a.geo-1 |
| HP Helion Cloud - US East | hpcloud:region-b.geo-1 |
|           Docker          |         docker         |
+---------------------------+------------------------+

From here on you’ll need your desired provider’s id in order to use it when adding a new backend.

Backend Actions

Add an EC2 backend:

mist add-backend --provider ec2_ap_northeast --ec2-api-key AKIAHKIB7OIJCX7YLIO3JA --ec2-api-secret knbkGJKHG9gjhUuhgfjtiu987

Add a Rackspace backend:

mist add-backend --provider rackspace:iad --rackspace-username my_username --rackspace-api-key 098er098eqwec98dqdqd098

Add a Nephoscale backend:

mist list backends --provider nephoscale --nepho-username nepho_username --nepho-password nepho_passwd

Add a DigitalOcean backend:

mist add-backend --provider digitalocean --digi-token kjhdkfh897dfodlkfjlkhdf90sdfusldkfjkljsdf098lkjlkj

Add a Linode backend:

mist add-backend --provider linode --linode-api-key dkljflkjlkgddgijgd00987ghudGgcf9Glkjh

Add an OpenStack backend:

mist add-backend --provider openstack --openstack-username demo --openstack-password mypass --openstack-auth-url http://10.0.0.1:5000 --openstack-tenant demo

Add a Softlayer backend:

mist add-backend --provider softlayer --softlayer-username soft_username --softlayer-api-key kjhfdkjahf098OIjhkFChiugiGIIUuoh

Add a HP Cloud backend:

mist add-backend --provider hpcloud:region-a.geo-1 --hp-username hp_username --hp-password my_pass --hp-tenant my_tenant

Add a Azure backend:

To add a Azure backend you have to download to a file the Azure certificate.

mist add-backend --provider azure --azure-sub-id lkjoiy8-kjdjkhd-987-hd9d --azure-cert-path /home/user/azure.cert

Add a Docker backend:

mist add-backend --provider docker --docker-host 10.0.0.1 --docker-port 4243

Add a Bare Metal Server (or any server):

mist add-backend --provider bare_metal --bare-hostname 198.230.89.3 --bare-user root --bare-port 22 --bare-ssh-key-id my_ssh_key

You can now see a list of all your added backends:

mist list-backends

Output:

openstackaf0.mist.io                     2Mn2ZnCoXhK3ywqzGn1fzWVmSSe6             bare_metal                     online
Icehouse                                 4ukW6Juooqa8bTu2YgM4mE8RAsk7             openstack                      online
EC2 AP Sydney                            25ykPERh5D17DyoeKsCgw35DLmvw             ec2_ap_southeast_2             online
Openstack Juno                           2u5yKqXmDiZ7BHCk1u17FFcmFS2m             openstack                      online
HP Helion Cloud                          3WwgPBXETjdeMEbM5fUCACSvedGT             hpcloud                        online
Google Compute Engine                    g6T3HYae2ZMcHfHyFGKVtMG6PZU              gce                            online
Docker                                   B3rbEA6bteaqMWJ4obVbgbqrXWf              docker                         online
openstackdfe.mist.io                     XMdRN2u3NVASMm14BuHo4HJnS15              bare_metal                     online

Note

You can use the --pretty flag. mist list-backends --pretty will return:

+-----------------------+------------------------------+--------------------+--------+
|          Name         |              ID              |      Provider      | State  |
+-----------------------+------------------------------+--------------------+--------+
|  openstackaf0.mist.io | 2Mn2ZnCoXhK3ywqzGn1fzWVmSSe6 |     bare_metal     | online |
|        Icehouse       | 4ukW6Juooqa8bTu2YgM4mE8RAsk7 |     openstack      | online |
|     EC2 AP Sydney     | 25ykPERh5D17DyoeKsCgw35DLmvw | ec2_ap_southeast_2 | online |
|     Openstack Juno    | 2u5yKqXmDiZ7BHCk1u17FFcmFS2m |     openstack      | online |
|    HP Helion Cloud    | 3WwgPBXETjdeMEbM5fUCACSvedGT |      hpcloud       | online |
| Google Compute Engine | g6T3HYae2ZMcHfHyFGKVtMG6PZU  |        gce         | online |
|         Docker        | B3rbEA6bteaqMWJ4obVbgbqrXWf  |       docker       | online |
|  openstackdfe.mist.io | XMdRN2u3NVASMm14BuHo4HJnS15  |     bare_metal     | online |
+-----------------------+------------------------------+--------------------+--------+

You can also display information about a specific backend, either by providing the backend’s name or ID. The following commands are equivalent:

mist describe-backend Icehouse
mist describe-backend 4ukW6Juooqa8bTu2YgM4mE8RAsk7
mist describe-backend --id 4ukW6Juooqa8bTu2YgM4mE8RAsk7
mist describe-backend --name Icehouse

Output:

+----------+------------------------------+-----------+--------+
|  Title   |              ID              |  Provider | State  |
+----------+------------------------------+-----------+--------+
| Icehouse | 4ukW6Juooqa8bTu2YgM4mE8RAsk7 | openstack | online |
+----------+------------------------------+-----------+--------+

Machines:
+---------+--------------------------------------+---------+-------------+
|   Name  |                  ID                  |  State  |  Public Ips |
+---------+--------------------------------------+---------+-------------+
| atlanta | c9411bbe-2bb2-4a88-996c-d831272b426e | running | 109.59.77.32|
+---------+--------------------------------------+---------+-------------+

You have the option to rename a backend:

mist rename-backend Icehouse --new-name Openstack_Icehouse

Finally you can delete a backend. The following two commands are equivalent:

mist delete-backend Docker

mist keys

By uploading your SSH keys to mist.io you can access all your machines through mist.io, have a shell prompt from your browser and even let mist.io take care of enabling monitoring to your machines. You also can have mist.io run commands to your machines during provisiong or after an alert is triggered.

Add a new key

You can use one of your existing keys and upload it to mist.io for further usage:

mist add-key --name MyKey --key-path /home/user/.ssh/mist_key

Or you can ask mist.io to auto-generate a key for you:

mist add-key --name AutogeneratedKey --auto-generate

Keys Actions

To list all of your added keys:

mist list-keys

Output:

Dummy
testkey
ParisDemo
TestKey
DemoKey

Or use the --pretty flag. mist list-keys --pretty:

+------------+------------+
|    Name    | Is Default |
+------------+------------+
|   Dummy    |   False    |
|  testkey   |   False    |
|  DemoKey   |    True    |
|  TestKey   |   False    |
| ParisDemo  |   False    |
+------------+------------+

You can also inspect a specific key:

mist describe-key Dummy

Output:

Name: Dummy

Private key:
-----BEGIN RSA PRIVATE KEY-----
MIIEpAIBAAKCAQEAz1aWE6y8uB3PQJhlVdc1RpZyRlBFQpN8c2edGIP/SfdAeGT3
QdOoTJFkVZTxk99YJG/cRPzanl9PAjZXJjYX1CiyFSYpJivRfN7j/QzzMJv6ouK/
62WXyjwWxDa9pixAQj2na9N0Gn8sqIIFxFqEXW0wFkac3A4I8vke8AZrRitGw3MO
FoIfrZjcicW6U2b4XLgK3vLSIe5myN9bgAqTPYPOLm/m8Rz3cv+1B0qCbPZEHBG3
2zoLTG40F6JgmekUrNSQhKaEWJJwLJRRj4aEtw7WeSbP3lnVNm0ch34j4+vVIp0L
+hFYAt9gjI2p/aa/YRg++H5Wfpvz21POWw4pTQIDAQABAoIBAA4ai7bm5yd3D6QL
OclvDDazAS77QtrWgX6wK6WBRRpY8U+/PnqB1U7wDO0tZolyheJkoY0nzg872HoE
DEWTJGfQJNz/bYklLejamJOcD+bclV4DIp72mC6vi7TpLFljZTOcUgkppxouUHFd
9tp2dc6NINpDD2SAp+cvPwWAykdJhuKI/cruyZ2y6b+FNCoJPF0f1yB6gwD3KAj0
YjcvDRjDaZKwFej+97YaKt37FuQaUjOKIruMytlcxm9qzQfSPeubfHEya61dL+Za
epJjm4NN5+x9PqSGhNpSbj1KwEbI67zNLLovEep7IC/7Et4rXm3/OtbNglKb/s67
YAifgVkCgYEA1H6PgSHp2Y12m+fIBFLyQqWOW3DjBV267h+R26pLOLfQCBaONZjS
35Ru+prQEcIGRbGD5BC/DP19qkk0VIuVYlKIRfgryEmS2Uq+h24htpaqw+Ehqes6
yN7q5pqikONP8wJ+y25u8TN8kssZm8U8Q3qOCgnZ2prP/ctB1eefkvcCgYEA+cnG
7ygDoHv7sdmGDkAAkuU0skhpaZD4CV2XvWtS61vAu4V3xFkLAAi43rUuPqO/R7LG
br3CaDDe3PJOjXSzJtGpM6eIz5hsglm3aoaQ6cDBJS1B9B488eDLkT8l6CH2IAuf
XsmqNKWFVcn+oWLlkYdZWP49+S8er7ulKfOEENsCgYB8RRO5qlKvdyqxXKi91qB1
V4rccTVjMwCaN/4+H+Zj4iOYR1CdiaVxOcZ5asZaTEUMxxbh7uU8PJccWjlvZD5V
xPyLJuq79EMcLrkkTMUMmip96ZCdZcL4LF3lxPNjlnxwGrp6UDgzeS/WTU7JqVxn
/ilJN5+fV8BhpVf4N8A72wKBgQDrP2eF8W+JA3uGglDItupTbl500dHFRGz1lRnF
oYBUfPNFKGwllZ7Qh2ZlCMnm4JzTT8Gmpjyjl/Msr1/fxVq8YpUyOsSUjv8SvKAL
SXTNUWYWN0t4N8o6GvZdctWmi+WbRJbx1IfiUUkEBNs070k6B/jT4Y5IUmJaKyVg
HyHwJQKBgQDOBYoJjancXX4H7sW8rah5j7Lj3LYfTc2kwLUv9NeROd+gdVPZt9PT
SWbT/d+7foCyMwWIK3eCT7lFHsiR8nNIvet8AFjnM3aa8xTgvJwZlCLhvyWA3FHt
8NpVCBubPk4+fs2x0j/D3Uwqho51XXztnqE/R3nr1XeB7xDSJm1iEA==
-----END RSA PRIVATE KEY-----

Puclic key:
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPVpYTrLy4Hc9AmGVV1zVGlnJGUEVCk3xzZ50Yg/9J90B4ZPdB06hMkWRVlPGT31gkb9xE/NqeX08CNlcmNhfUKLIVJikmK9F83uP9DPMwm/qi4r/rZZfKPBbENr2mLEBCPadr03QafyyoggXEWoRdbTAWRpzcDgjy+R7wBmtGK0bDcw4Wgh+tmNyJxbpTZvhcuAre8tIh7mbI31uACpM9g84ub+bxHPdy/7UHSoJs9kQcEbfbOgtMbjQXomCZ6RSs1JCEpoRYknAslFGPhoS3DtZ5Js/eWdU2bRyHfiPj69UinQv6EVgC32CMjan9pr9hGD74flZ+m/PbU85bDilN

You have the option to rename a key:

mist rename-key Dummy --name MyKey --new-name RenamedKey

And delete one:

mist delete-key Dummy

mist machines

Now that you have added your backends and keys you can provision and monitor any machine on any of your providers.

Before you provision a machine, you’ll need to provide some information, regarding the OS Image to use, the size of the machine and on which Backend’s location. All of these information differ with each provider. However you can list all of them and choose your desired values.

Images

To see all the available images for a backend. The --backend option can be either the backend’s id or name. Both will do.

mist list-images --backend Juno

Output:

Fedora-x86_64-20-20140618-sda            755c8a98-882f-4dd2-9598-5c01c039e63a
cirros-0.3.2-x86_64-uec                  cbcc00f7-6ec0-41a5-ad42-3008143a77b2
cirros-0.3.2-x86_64-uec-ramdisk          586360b9-06f4-4353-9f62-7191a9f95d64
cirros-0.3.2-x86_64-uec-kernel           475ae832-7d2a-4b0b-a4d9-63e7d170a223

And with the --pretty flag, mist list-images --backend Juno --pretty:

+---------------------------------+--------------------------------------+
|               Name              |                  ID                  |
+---------------------------------+--------------------------------------+
|  Fedora-x86_64-20-20140618-sda  | 755c8a98-882f-4dd2-9598-5c01c039e63a |
|     cirros-0.3.2-x86_64-uec     | cbcc00f7-6ec0-41a5-ad42-3008143a77b2 |
| cirros-0.3.2-x86_64-uec-ramdisk | 586360b9-06f4-4353-9f62-7191a9f95d64 |
|  cirros-0.3.2-x86_64-uec-kernel | 475ae832-7d2a-4b0b-a4d9-63e7d170a223 |
+---------------------------------+--------------------------------------+

The list of images can be huge, especially on providers such as EC2. My default mist.io will return a list of the most used images. You can however use the --search option. If you provide --search all mist.io will provide all available images. If you want to narrow your search you can search for a specific image:

mist list-images --backend DigitalOcean --search all
mist list-images --backend DigitalOcean --search gentoo

From the returned list you ‘ll need your desired image’s ID to be used with machine creation.

Sizes - Locations/Regions

Each provider offers different options for machine sizes and locations/regions to choose from. For each of them you’ll need the corresponding ID:

mist list-sizes --backend DigitalOcean
mist list-sizes --backend DigitalOcean --pretty

Output:

+---------------------------------------------+-----+
|                     Name                    |  ID |
+---------------------------------------------+-----+
|    CS05-SSD - 0.5GB, 1Core, 25GB, 10 Gbps   | 219 |
|     CS1-SSD - 1GB, 1Core, 25GB, 10 Gbps     | 221 |
|    CS2.1-SSD - 2GB, 1Core, 37GB, 10 Gbps    | 223 |
|    CS2.2-SSD - 2GB, 2Core, 50GB, 10 Gbps    | 225 |
|    CS4.2-SSD - 4GB, 2Core, 75GB, 10 Gbps    | 227 |
|    CS4.4-SSD - 4GB, 4Core, 100GB, 10 Gbps   | 229 |
|    CS8.4-SSD - 8GB, 4Core, 150GB, 10 Gbps   | 231 |
|    CS8.8-SSD - 8GB, 8Core, 200GB, 10 Gbps   | 233 |
|   CS16.8-SSD - 16GB, 8Core, 300GB, 10 Gbps  | 235 |
|  CS16.16-SSD - 16GB, 16Core, 400GB, 10 Gbps | 237 |
|   CS32.8-SSD - 32GB, 8Core, 600GB, 10 Gbps  | 239 |
|  CS32.16-SSD - 32GB, 16Core, 800GB, 10 Gbps | 241 |
| CS64.20-SSD - 64GB, 20Core, 1600GB, 10 Gbps | 243 |
|      CS05 - 0.5GB, 1Core, 25GB, 1 Gbps      |  5  |
|        CS1 - 1GB, 1Core, 50GB, 1 Gbps       |  3  |
|       CS2.1 - 2GB, 1Core, 75GB, 1 Gbps      |  46 |
|      CS2.2 - 2GB, 2Core, 100GB, 1 Gbps      |  7  |
|      CS4.2 - 4GB, 2Core, 150GB, 1 Gbps      |  48 |
|      CS4.4 - 4GB, 4Core, 200GB, 1 Gbps      |  9  |
|      CS8.4 - 8GB, 4Core, 300GB, 1 Gbps      |  50 |
|      CS8.8 - 8GB, 8Core, 400GB, 1 Gbps      |  11 |
|     CS16.8 - 16GB, 8Core, 600GB, 1 Gbps     |  52 |
|    CS16.16 - 16GB, 16Core, 800GB, 1 Gbps    |  1  |
|     CS32.8 - 32GB, 8Core, 1000GB, 1 Gbps    |  56 |
|    CS32.16 - 32GB, 16Core, 1200GB, 1 Gbps   |  54 |
+---------------------------------------------+-----+
mist list-locations --backend DigitalOcean
mist list-locations --backend DigitalOcean --pretty

Output:

+-------+-------+
|  Name |   ID  |
+-------+-------+
| SJC-1 | 86945 |
| RIC-1 | 87729 |
+-------+-------+

Create a new machine

Now that you have gathered the information needed for machine creation you can tell mist to provision a machine on a specific backend. Alongside the image, location and size ID’s you’ll also need to provide a keys’ name to be assigned to the newly created machine:

mist create-machine --backend EC2 --name dev.machine --image ami-bddaa2bc --size t1.micro --location 0 --key MyKey

Machine Actions

You can list all your machines on all your Backends, or list machines on a specific backend:

mist list-machines
mist list-machines --backend Docker

You can start, stop, reboot or destroy a machine. To specify a machine you can either directly use the machine’s name or ID, or pass the --id, --name flags:

mist reboot db-server-1
mist destroy db-server-1

You can also probe a machine. By probing a machine you verify that sshd is up an running and that you have access to the machine with the previously assigned key:

mist probe db-server-1

After creating a new machine it might take a little time for the probe to be successful.

You can also tag machine:

mist tag db-server-1 --new-tag dbservers

Tagging will be useful later when you want to group your machines across different clouds and run multiple commands and configuration scripts.

mist monitoring

Mist.io offers plans for monitoring your machines. By default it will install a collectd instance pre-configured with some basic metrics and send the results to mist.io’s servers. By visiting mist.io you can see live graphs of your monitored machines.

Furthermore, you have a huge list of collectd plugins that you can add to your machine and even upload custom pyton scripts to be used as collectd plugins, allowing you to monitor...well, almost everything.

Enable monitoring

In order to enable monitoring on a machine with name dbServer:

mist enable-monitoring dbServer

Now, your dbServer machine has collectd installed and you can visit mist.io to see live graphs (note that the first time you enable collectd it may take some time for the package to install).

To disable monitoring on a machine:

mist disable-monitoring dbServer

Add Metrics

Collectd supports a huge list of custom metrics/plugins. To see all available plugins/metrics for a monitored machine:

mist list-metrics --machine dbServer

If you wish to add one of those metrics you have to use the metric’s id. For example, to add the metric users:

mist add-metric --machine dbServer --metric-id users

Mist.io supports custom, python plugins. For example, if you have a ~/plugin.py:

import random

def read():
    # return random value
    return random.random()

You can add it by providing the --custom_plugin parameter and providing a plugin name with the --plugin parameter:

mist add-custom-metric --machine dbServer --metric-name my_custom_metric --file-path ~/plugin.py --unit my_unit

mist run

With mist command line tool you can run a bash command in multiple tagged servers at once. For example to run a command in all your dev servers:

mist run --command "touch something" --tag dev

Output

Found tagged machines
Found key association for machine: atlanta

Finished in machine: atlanta

mist.ansible - Ansible modules for mist.io service

You can see the mist.ansible documentation here

Package Info

Changelog

Release 0.3.0 (released Nov 18,2014)

Featured added: * Repackage mist.client to mist * Refactor mistclient.machines and mistclient.backends * client.machines, client.backends, client.keys are now lists instead of dicts * Refactor the mist command line tool * Add mist run capability

Release 0.1.0 (released Sep 3, 2014)

Features added:

  • mist command line interface
  • Add client.backend_from_name, client.backend_from_id and client.search_backend methods
  • Add backend.machine_from_name, backend.machine_from_id, backend.machine_from_ip and backend.search_machine methods
  • client.backends is now a dict with backend ids as dict.keys
  • backend.machines is now a dict with machine ids as dict.keys

Bugs fixed:

  • #5: Fix pip hanging up when installing requirements for the first time
  • #6: Fix mist sync when syncing Bare Metal Backends

Roadmap

Upcoming Release 0.3.1

  • Use the api-token instead of re-login
  • Auto-populate the config file with image_id, size_id etc values

Indices and tables