Articles in this section

VAST Cluster Installation Options

Sara Levy
  • Updated
Follow

This document is for support use. It may not be complete or final. 

Since VAST Cluster is flexibly deployed in terms of architecture, scale, topology and networking, the following aspects are some of the key choices that are custom planned per installation. These aspects affect your choice of scheme file.

Hardware Components

Each installation comprises:

  • One or more DBox(es). The DBox is populated with two data servers called DNodes.

  • Usually one or more CBoxes(es). The CBox is populated with four compute nodes (CNodes). Each CNode can be shipped with either one or two 2-port Network Interface Cards (NICs) depending on the networking needs. CNodes can also run on customer provided hardware.

  • One or more pairs of data switches. These switches provide inter-connectivity between the CNodes and the DNodes and provide connectivity between the cluster and uplinks to the client data network. The number of pairs needed depends on the numbers of Dboxes and CNodes. Two Ethernet models are commonly used:

    • The MLX2100 16-port ethernet data switch.

    • The MLX2700 32-port ethernet data switch.

    In some installations, other switches are used, which may be provided by the customer. These may be Infiniband switches.

  • Optionally, a 1GigE management switch used to provide management access on an isolated Ethernet network.

Server Scale and Data Switch Options

The CBox and DBox are matched to provide ideal performance for most workloads when deployed in a one to one ratio, although since they are separate modules, they can also be combined in a different proportion.

Data switches are always deployed in pairs. As a general guideline, the following switch pair configurations support the following numbers of CBoxes and DBoxes, and higher scale installations are also supported.

Switch Configuration

Number of switch ports

Supports up to

2 x Mellanox MSN2100-CB2F

32 x 100GbE QSFP28 ports

3 CBoxes

3 DBoxes

2 x Mellanox MSN2700-CS2F

64 x 100GbE QSFP28 ports

6 CBoxes

6 DBoxs

4 x Mellanox MSN2700-CS2F

128 x 100GbE QSFP28 ports

8 CBoxes

8 DBoxes

...

...

...

Networking Options

Three networks transport three types of traffic:

  • The client data network. This network carries data traffic between the CNodes and the client data network being served by the cluster.

  • The VAST internal network. This network carries internal system traffic between the DNodes and CNodes.

  • The management network. This network is dedicated to the Vast Management System (VMS) running on one of the CNodes (the management CNode) and management clients.

The main networking variations are as follows:

Networking Option

Shipping and Installation Handling

The transport protocol of the client data network

This is handled by configuring the CNode NICs in the required mode, which could be either of these:

  • Ethernet (ETH)

  • Infiniband (IB)

The transport protocol for the VAST Cluster internal network

This can be the same or different to the client data network protocol, and can be either of these:

  • Ethernet (ETH)

  • Infiniband (IB)

The management topology

The management network can be:

  • Isolated from the data network. This is referred to as "Out of band" management and is usually implemented by installing a ToR 1 GigEth management switch, which can be provided in the shipment.

  • On the data network. This is referred to as "inband" management.

Separation of the VAST internal network from the client data network

The client data network and the VAST internal network can optionally be isolated from each other. These are the typical implementations:

  • No separation. The CNodes are shipped with one NIC installed.

    • If the client data network is ETH type, then Ethernet data switches are shipped, which are connected to the CNodes, DNodes and uplinks to the client data network.

    • If the client data network is IB, the CNodes and Dnodes are connected to customer provided IB switches.

  • Separation. The CNodes are shipped with a second Network Interface Card (NIC) on each CNode which provides extra connectivity. Examples:

    • The VAST internal network runs on Ethernet, client data network runs on IB . For this configuration, Ethernet data switches are provided. These are connected to the CNodes and DNodes. One NIC per CNode is configured in ETH mode for this connection. The second NIC is configured in IB mode and connects to the client data network.

    • Both networks run on IB in isolation. For this configuration, both NICs per CNode are configured in IB mode. One is connected to an IB switch that is dedicated to the VAST internal network and connected to the DNodes. The other NIC per CNode is connected to the client data network.
 

Related articles

Comments

0 comments

Please sign in to leave a comment.