CSE 124 Lecture Notes - Lecture 27: European Cooperation In Science And Technology, Lawrence Berkeley National Laboratory, Pci Express
6 Jun 2018
School
Department
Course
Professor
Building Blocks of Modern Data Centers
- servers are put on a “rack”, each containing ~40 servers per rack!!!
- racks are organized into “clusters”
Network switch - decides which ports these “packets” should go through
- Usually exist at the TOP of the rack
Cluster Switch - connects to the rest of the network
Top-of-Rack Architecture
- ANY data that you send to a server is sent through the TOR network switch, and THEN sent
back down to a node
- not ALWAYS the case that there’s enough bandwidth for ALL servers to be sending data!!!
- you see “non-uniform” bandwidth → slower performance!
Extreme Modularity
- take shipping containers and FILL them with racks of servers
- can ship to an “outdoor” data center!
Host Virtualization
- multiple VMs to one physical machine
- can get each customer “one’ of these VMs!
- VMM (virtual machine monitor): “emulates” a server
- exposes the ISA from hardware to EACH of the VMs!
- can decide WHICH of the hardware resources to give to EACH VM!
- “Base” OS + multiple “Guest” OS
- takes longer to boot up the actual hardware than a VM!
- applications run “unmodified” as on real machine
VMM Virtual Switches
- software that is responsible for connecting EACH of your VMs (guest OS) to the physical
network
- allows the provider to ensure that traffic to-and-from is separated from other traffic!
Host Virtualization
- VMs date back ALL the way to the 1950s (IBM)
The Storage Hierarchy
PCI Express - connects components together (CPU, GPU, MEM, Disk, NET, etc.)
Speed network card - WAY slower than PCI express
- Accessing resources INSIDE of the server is WAY higher than outside of the server
One Server
DRAM: 16 GB
Disk: 2 TB
Document Summary
Usually exist at the top of the rack. Servers are put on a rack , each containing ~40 servers per rack!! Network switch - decides which ports these packets should go through. Cluster switch - connects to the rest of the network. Any data that you send to a server is sent through the tor network switch, and then sent back down to a node. Not always the case that there"s enough bandwidth for all servers to be sending data!! Take shipping containers and fill them with racks of servers. Can ship to an outdoor data center! You see non-uniform bandwidth slower performance! Can get each customer one" of these vms! Vmm (virtual machine monitor) : emulates a server. Exposes the isa from hardware to each of the vms! Can decide which of the hardware resources to give to each vm! Takes longer to boot up the actual hardware than a vm! Applications run unmodified as on real machine.
