Home > Store

Essential Virtual SAN (VSAN): Administrator's Guide to VMware Virtual SAN

Register your product to gain access to bonus material or receive a coupon.

Essential Virtual SAN (VSAN): Administrator's Guide to VMware Virtual SAN

Book

  • This product currently is not for sale.
Not for Sale

About

Features

  • The first book on VMware Virtual SAN -- from two of VMware's "superstar" experts, Cormac Hogan and Duncan Epping
  • How Virtual SAN works, and what it offers
  • How to architect Virtual SAN environments for maximum value
  • How to avoid potential "gotchas" and troubleshoot problems

Description

  • Copyright 2015
  • Edition: 1st
  • Book
  • ISBN-10: 0-13-385499-X
  • ISBN-13: 978-0-13-385499-2

Understand and implement VMware Virtual SAN: the heart of tomorrow’s Software-Defined Datacenter (SDDC)

VMware’s breakthrough Software-Defined Datacenter (SDDC) initiative can help you virtualize your entire datacenter: compute, storage, networks, and associated services. Central to SDDC is VMware Virtual SAN (VSAN): a fully distributed storage architecture seamlessly integrated into the hypervisor and capable of scaling to meet any enterprise storage requirement.

Now, the leaders of VMware’s wildly popular Virtual SAN previews have written the first authoritative guide to this pivotal technology. You’ll learn what Virtual SAN is, exactly what it offers, how to implement it, and how to maximize its value.

Writing for administrators, consultants, and architects, Cormac Hogan and Duncan Epping show how Virtual SAN implements both object-based storage and a policy platform that simplifies VM storage placement. You’ll learn how Virtual SAN and vSphere work together to dramatically improve resiliency, scale-out storage functionality, and control over QoS.

Both an up-to-the-minute reference and hands-on tutorial, Essential Virtual SAN uses realistic examples to demonstrate Virtual SAN’s most powerful capabilities. You’ll learn how to plan, architect, and deploy Virtual SAN successfully, avoid gotchas, and troubleshoot problems once you’re up and running.

Coverage includes

  • Understanding the key goals and concepts of Software-Defined Storage and Virtual SAN technology
  • Meeting physical and virtual requirements for safe Virtual SAN implementation
  • Installing and configuring Virtual SAN for your unique environment
  • Using Storage Policy Based Management to control availability, performance, and reliability
  • Simplifying deployment with VM Storage Policies
  • Discovering key Virtual SAN architectural details: caching I/O, VASA, witnesses, pass-through RAID, and more
  • Ensuring efficient day-to-day Virtual SAN management and maintenance
  • Interoperating with other VMware features and products
  • Designing and sizing Virtual SAN clusters
  • Troubleshooting, monitoring, and performance optimization

Sample Content

Online Sample Chapter

Administrator's Guide to VMware Virtual SAN: Introduction to VSAN

Sample Pages

Download the sample pages (includes Chapter 1 and Index)

Table of Contents

Foreword by Ben Fathi xvii

Foreword by Charles Fan xix

About the Authors xxi

About the Technical Reviewers xxiii

Acknowledgments xxv

Reader Services xxvii

Introduction xxix

Chapter 1 Introduction to VSAN 1

    Software-Defi ned Datacenter 1

    Software-Defi ned Storage 2

    Hyper-Convergence/Server SAN Solutions 3

    Introducing Virtual SAN 4

    What Is Virtual SAN? 5

    What Does VSAN Look Like to an Administrator? 8

    Summary 11

Chapter 2 VSAN Prerequisites and Requirements for Deployment 13

    VMware vSphere 5.5 13

        ESXi 5.5 U1 14

        ESXi Boot Considerations 14

    VSAN Requirements 15

        VMware Hardware Compatibility Guide 15

        VSAN Ready Nodes 15

        Storage Controllers 16

        Magnetic Disks 18

        Flash Devices 19

    Network Requirements 20

        Network Interface Cards 20

        Supported Virtual Switch Types 21

        VMkernel Network 21

        VSAN Network Traffi c 22

        Jumbo Frames 22

        NIC Teaming 23

        Network I/O Control 23

        Firewall Ports 23

    Summary 24

Chapter 3 VSAN Installation and Confi guration 25

    VSAN Networking 25

    VMkernel Network for VSAN 26

    VSAN Network Confi guration: VMware Standard Switch 27

    VSAN Network Confi guration: vSphere Distributed Switch 28

        Step 1: Create the Distributed Switch 28

        Step 2: Create a Distributed Port Group 29

        Step 3: Build VMkernel Ports 30

    Possible Network Confi guration Issues 33

    Network I/O Control Confi guration Example 35

    Design Considerations: Distributed Switch and Network I/O Control 38

        Scenario 1: Redundant 10GbE Switch Without “Link Aggregation” Capability 39

        Scenario 2: Redundant 10GbE Switch with Link Aggregation Capability 42

    Creating a VSAN Cluster 45

    The Role of Disk Groups 45

        Disk Group Maximums 46

        Why Confi gure Multiple Disk Groups in VSAN? 46

        SSD to Magnetic Disk Ratio 47

        Automatically Add Disks to VSAN Disk Groups 48

        Handling Is_local or Is_SSD Issues 48

        Manually Adding Disks to a VSAN Disk Group 50

        Disk Group Creation Example 50

        VSAN Datastore Properties 53

    Summary 53

Chapter 4 VM Storage Policies on VSAN 55

    Introducing Storage Policy-Based Management in a VSAN Environment 56

        Number of Failures to Tolerate 58

        Number of Disk Stripes Per Object 59

        Flash Read Cache Reservation 61

        Object Space Reservation 61

        Force Provisioning 61

    VASA Vendor Provider 62

        An Introduction to VASA 62

        Storage Providers 63

    VSAN Storage Providers: Highly Available 63

        Changing VM Storage Policy On-the-Fly 64

        Objects, Components, and Witnesses 68

    VM Storage Policies 68

        Enabling VM Storage Policies 69

        Creating VM Storage Policies 70

        Assigning a VM Storage Policy During VM Provisioning 70

    Summary 71

Chapter 5 Architectural Details 73

    Distributed RAID 73

    Objects and Components 74

        Component Limits 76

        Virtual Machine Storage Objects 77

        Virtual Machine Home Namespace 77

        Virtual Machine Swap 78

        VMDKs and Deltas 78

        Witnesses and Replicas 79

        Object Layout 79

    VSAN Software Components 82

        Component Management 83

        Data Paths for Objects 83

        Object Ownership 83

        Placement and Migration for Objects 84

        Cluster Monitoring, Membership, and Directory Services 85

        Host Roles (Master, Slave, Agent) 85

        Reliable Datagram Transport 86

    On-Disk Formats 86

        Flash Devices 86

        Magnetic Disks 86

    VSAN I/O Flow 87

        The Role of the SSD 87

        Anatomy of a VSAN Read 88

        Anatomy of a VSAN Write 90

        Retiring Writes to Magnetic Disks 91

        Data Locality 91

    Storage Policy-Based Management 92

    VSAN Capabilities 92

        Number of Failures to Tolerate Policy Setting 93

        Best Practice for Number of Failures to Tolerate 95

        Stripe Width Policy Setting 96

        Striping on VSAN Outside of Policy Setting 98

        Stripe Width Maximum 100

        Stripe Width Confi guration Error 101

        Stripe Width Chunk Size 102

        Stripe Width Best Practice 102

        Flash Read Cache Reservation Policy Setting 103

        Object Space Reservation Policy Setting 103

        VM Home Namespace Revisited 104

        Swap Revisited 104

        How to Examine the VM Swap Storage Object 104

        Delta Disk / Snapshot Caveat 106

        Verifying How Much Space Is Actually Consumed 106

        Force Provisioning Policy Setting 107

        Witnesses and Replicas: Failure Scenarios 107

        Recovery from Failure 110

        What About Stretching VSAN? 113

    Summary 115

Chapter 6 VM Storage Policies and Virtual Machine Provisioning 117

    Policy Setting: Number of Failures to Tolerate = 1 117

    Policy Setting: Failures to Tolerate = 1, Stripe Width = 2 124

    Policy Setting: Failures to Tolerate = 2, Stripe Width = 2 128

    Policy Setting: Failures to Tolerate = 1, Object Space Reservation = 50 Percent 132

    Policy Setting: Failures to Tolerate = 1, Object Space Reservation = 100 Percent 136

    Default Policy 138

    Summary 141

Chapter 7 Management and Maintenance 143

    Host Management 143

        Adding Hosts to the Cluster 143

        Removing Hosts from the Cluster 145

        ESXCLI VSAN Cluster Commands 145

    Maintenance Mode 146

    Recommended Maintenance Mode Option for Updates and Patching 148

    Disk Management 149

        Adding a Disk Group 149

    Removing a Disk Group 150

        Adding Disks to the Disk Group 152

        Removing Disks from the Disk Group 153

    Wiping a Disk 153

        ESXCLI VSAN Disk Commands 154

    Failure Scenarios 155

        Magnetic Disk Failure 156

        Flash Device Failure 157

        Host Failure 158

        Network Partition 159

        Disk Full Scenario 164

    Thin Provisioning Considerations 165

    vCenter Management 166

        vCenter Server Failure Scenario 167

        Running vCenter Server on VSAN 168

        Bootstrapping vCenter Server 168

    Summary 171

Chapter 8 Interoperability 173

    vMotion 174

    Storage vMotion 174

    vSphere HA 175

        vSphere HA Communication Network 175

        vSphere HA Heartbeat Datastores 176

        vSphere HA Metadata 177

        vSphere HA Admission Control 177

        vSphere HA Recommended Settings 177

        vSphere HA Protecting VSAN and Non-VSAN VMs 178

    Distributed Resource Scheduler 178

    Storage DRS 179

    Storage I/O Control 179

    Distributed Power Management 180

    VMware Data Protection 180

        Backup VMs from a VSAN Datastore Using VDP 181

        Restore VMs to a VSAN Datastore Using VDP 181

    vSphere Replication 183

        Replicate to VSAN at a Recovery Site 183

        Recover Virtual Machine 184

    Virtual Machine Snapshots 185

    vCloud Director 185

    VMware Horizon View 186

        VSAN Support for Horizon View 186

        VM Storage Policies on VMware View 187

        View Confi guration 187

        Changing the Default Policy 190

        Other View Considerations 190

    vCenter Operations 191

    vSphere 5.5 62TB VMDK 192

    Fault Tolerance 192

    Stretched/vSphere Metro Storage Cluster 193

    PowerCLI 193

    C# Client 193

    vCloud Automation Service 193

    Host Profi les 194

    Auto-Deploy 194

    Raw Device Mappings 195

    vSphere Storage APIs for Array Integration 195

    Microsoft Clustering Services 195

    Summary 195

Chapter 9 Designing a VSAN Cluster 197

    Sizing Constraints 197

    Failures to Tolerate = 1, Stripe Width = 1 199

    Flash to Magnetic Disk Ratio 200

    Designing for Performance 201

        Impact of the Disk Controller 202

    VSAN Performance Capabilities 206

        VMware View Performance 207

    Design and Sizing Tools 208

    Scenario 1: Where to Start 209

        Determining Your Host Confi guration 211

    Scenario 2 213

        Determining Your Host Confi guration 215

    Scenario 3 217

        Determining Your Host Confi guration 218

    Summary 220

Chapter 10 Troubleshooting, Monitoring, and Performance 221

    ESXCLI 221

        esxcli vsan datastore 222

        esxcli vsan network 223

        esxcli vsan storage 224

        esxcli vsan cluster 226

        esxcli vsan maintenancemode 227

        esxcli vsan policy 228

        esxcli vsan trace 230

        Additional Non-ESXCLI Commands for Troubleshooting VSAN 231

    Ruby vSphere Console 236

        VSAN Commands 237

        SPBM Commands 256

        PowerCLI for VSAN 259

    VSAN and SPBM APIs 261

        Enable/Disable VSAN (Automatic Claiming) 261

        Manual Disk Claiming 261

        Change the VM Storage Policy 262

        Enter Maintenance Mode 262

        Create and Delete Directories on a VSAN Datastore 262

        CMMDS 262

        SPBM 263

    Troubleshooting VSAN on the ESXi 263

        Log Files 263

        VSAN Traces 264

        VSAN VMkernel Modules and Drivers 264

    Performance Monitoring 265

        ESXTOP Performance Counters for VSAN 265

        vSphere Web Client Performance Counters for VSAN 266

        VSAN Observer 267

    Sample VSAN Observer Use Case 273

    Summary 276

TOC, 9780133854992, 7/3/14

More Information

InformIT Promotional Mailings & Special Offers

I would like to receive exclusive offers and hear about products from InformIT and its family of brands. I can unsubscribe at any time.

Overview


Pearson Education, Inc., 221 River Street, Hoboken, New Jersey 07030, (Pearson) presents this site to provide information about products and services that can be purchased through this site.

This privacy notice provides an overview of our commitment to privacy and describes how we collect, protect, use and share personal information collected through this site. Please note that other Pearson websites and online products and services have their own separate privacy policies.

Collection and Use of Information


To conduct business and deliver products and services, Pearson collects and uses personal information in several ways in connection with this site, including:

Questions and Inquiries

For inquiries and questions, we collect the inquiry or question, together with name, contact details (email address, phone number and mailing address) and any other additional information voluntarily submitted to us through a Contact Us form or an email. We use this information to address the inquiry and respond to the question.

Online Store

For orders and purchases placed through our online store on this site, we collect order details, name, institution name and address (if applicable), email address, phone number, shipping and billing addresses, credit/debit card information, shipping options and any instructions. We use this information to complete transactions, fulfill orders, communicate with individuals placing orders or visiting the online store, and for related purposes.

Surveys

Pearson may offer opportunities to provide feedback or participate in surveys, including surveys evaluating Pearson products, services or sites. Participation is voluntary. Pearson collects information requested in the survey questions and uses the information to evaluate, support, maintain and improve products, services or sites, develop new products and services, conduct educational research and for other purposes specified in the survey.

Contests and Drawings

Occasionally, we may sponsor a contest or drawing. Participation is optional. Pearson collects name, contact information and other information specified on the entry form for the contest or drawing to conduct the contest or drawing. Pearson may collect additional personal information from the winners of a contest or drawing in order to award the prize and for tax reporting purposes, as required by law.

Newsletters

If you have elected to receive email newsletters or promotional mailings and special offers but want to unsubscribe, simply email information@informit.com.

Service Announcements

On rare occasions it is necessary to send out a strictly service related announcement. For instance, if our service is temporarily suspended for maintenance we might send users an email. Generally, users may not opt-out of these communications, though they can deactivate their account information. However, these communications are not promotional in nature.

Customer Service

We communicate with users on a regular basis to provide requested services and in regard to issues relating to their account we reply via email or phone in accordance with the users' wishes when a user submits their information through our Contact Us form.

Other Collection and Use of Information


Application and System Logs

Pearson automatically collects log data to help ensure the delivery, availability and security of this site. Log data may include technical information about how a user or visitor connected to this site, such as browser type, type of computer/device, operating system, internet service provider and IP address. We use this information for support purposes and to monitor the health of the site, identify problems, improve service, detect unauthorized access and fraudulent activity, prevent and respond to security incidents and appropriately scale computing resources.

Web Analytics

Pearson may use third party web trend analytical services, including Google Analytics, to collect visitor information, such as IP addresses, browser types, referring pages, pages visited and time spent on a particular site. While these analytical services collect and report information on an anonymous basis, they may use cookies to gather web trend information. The information gathered may enable Pearson (but not the third party web trend services) to link information with application and system log data. Pearson uses this information for system administration and to identify problems, improve service, detect unauthorized access and fraudulent activity, prevent and respond to security incidents, appropriately scale computing resources and otherwise support and deliver this site and its services.

Cookies and Related Technologies

This site uses cookies and similar technologies to personalize content, measure traffic patterns, control security, track use and access of information on this site, and provide interest-based messages and advertising. Users can manage and block the use of cookies through their browser. Disabling or blocking certain cookies may limit the functionality of this site.

Do Not Track

This site currently does not respond to Do Not Track signals.

Security


Pearson uses appropriate physical, administrative and technical security measures to protect personal information from unauthorized access, use and disclosure.

Children


This site is not directed to children under the age of 13.

Marketing


Pearson may send or direct marketing communications to users, provided that

  • Pearson will not use personal information collected or processed as a K-12 school service provider for the purpose of directed or targeted advertising.
  • Such marketing is consistent with applicable law and Pearson's legal obligations.
  • Pearson will not knowingly direct or send marketing communications to an individual who has expressed a preference not to receive marketing.
  • Where required by applicable law, express or implied consent to marketing exists and has not been withdrawn.

Pearson may provide personal information to a third party service provider on a restricted basis to provide marketing solely on behalf of Pearson or an affiliate or customer for whom Pearson is a service provider. Marketing preferences may be changed at any time.

Correcting/Updating Personal Information


If a user's personally identifiable information changes (such as your postal address or email address), we provide a way to correct or update that user's personal data provided to us. This can be done on the Account page. If a user no longer desires our service and desires to delete his or her account, please contact us at customer-service@informit.com and we will process the deletion of a user's account.

Choice/Opt-out


Users can always make an informed choice as to whether they should proceed with certain services offered by InformIT. If you choose to remove yourself from our mailing list(s) simply visit the following page and uncheck any communication you no longer want to receive: www.informit.com/u.aspx.

Sale of Personal Information


Pearson does not rent or sell personal information in exchange for any payment of money.

While Pearson does not sell personal information, as defined in Nevada law, Nevada residents may email a request for no sale of their personal information to NevadaDesignatedRequest@pearson.com.

Supplemental Privacy Statement for California Residents


California residents should read our Supplemental privacy statement for California residents in conjunction with this Privacy Notice. The Supplemental privacy statement for California residents explains Pearson's commitment to comply with California law and applies to personal information of California residents collected in connection with this site and the Services.

Sharing and Disclosure


Pearson may disclose personal information, as follows:

  • As required by law.
  • With the consent of the individual (or their parent, if the individual is a minor)
  • In response to a subpoena, court order or legal process, to the extent permitted or required by law
  • To protect the security and safety of individuals, data, assets and systems, consistent with applicable law
  • In connection the sale, joint venture or other transfer of some or all of its company or assets, subject to the provisions of this Privacy Notice
  • To investigate or address actual or suspected fraud or other illegal activities
  • To exercise its legal rights, including enforcement of the Terms of Use for this site or another contract
  • To affiliated Pearson companies and other companies and organizations who perform work for Pearson and are obligated to protect the privacy of personal information consistent with this Privacy Notice
  • To a school, organization, company or government agency, where Pearson collects or processes the personal information in a school setting or on behalf of such organization, company or government agency.

Links


This web site contains links to other sites. Please be aware that we are not responsible for the privacy practices of such other sites. We encourage our users to be aware when they leave our site and to read the privacy statements of each and every web site that collects Personal Information. This privacy statement applies solely to information collected by this web site.

Requests and Contact


Please contact us about this Privacy Notice or if you have any requests or questions relating to the privacy of your personal information.

Changes to this Privacy Notice


We may revise this Privacy Notice through an updated posting. We will identify the effective date of the revision in the posting. Often, updates are made to provide greater clarity or to comply with changes in regulatory requirements. If the updates involve material changes to the collection, protection, use or disclosure of Personal Information, Pearson will provide notice of the change through a conspicuous notice on this site or other appropriate way. Continued use of the site after the effective date of a posted revision evidences acceptance. Please contact us if you have questions or concerns about the Privacy Notice or any objection to any revisions.

Last Update: November 17, 2020