18/08/2021
CRICOS code 00025BCRICOS code 00025B
Copyright By PowCoder代写 加微信 powcoder
• Cloud Delivery Models
• Cloud Deploy Models
• Cloud-Enabling Technologies
– Broadband Networks and Internet Architecture
– Virtualisation Technology (VT)
– Data Centre Technology
– Web Technology
– Multitenant Technology
• Goals and Benefits
• Risks and Challenges
• Cloud-based Applications in the World
Cloud Computing
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• Networking and Virtual Private Cloud
• Load Balancing
– What & Why Load Balancing
– Algorithms
– LB in Cloud Architecture
– LB in Distributed Systems
– LB in Network Communications
– LB in Cloud Product
• Cloud Architecture
– Workload Distribution Architecture & Resource Pooling Architecture
– Dynamic Scalability Architecture & Elastic Resource Capacity Architecture
– Service Load Balancing Architecture & Cloud Bursting Architecture
– Elastic Disk Provisioning Architecture & Redundant Storage Architecture
• Advanced Cloud Architecture
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Course Overview – Lectures
Introduction
topics&appl
VT: Docker I
VT: Docker II Spark I
DBs in Cloud
Networks &
Load Balancing
Security &
Lecture 11
Lecture 12
Lecture 10
VT: Docker III
Lecture 13
Concepts Orchestration Storage Computation Others
• More GCP Coupons available with a new link (updated)
• No teaching activities on Wednesday (Ekka)
• Release A1 on Friday 13/8 （due on Friday 3/9, 3 weeks)
• No medical certificates needed for extensions or deferred exams until 31
August (possibly to be extended) – students can use a statement of
circumstances
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Cloud Networking
https://en.wikipedia.org/wiki/Domain_Name_System
https://en.wikipedia.org/wiki/Domain_Name_System
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Virtual Private Cloud (VPC)
Cloud Deployment models:
• Public Cloud (e.g. AWS, GCP) vs. Private Cloud (UQCloud)
• Human Resource department vs. Finance department in one
A virtual private cloud (VPC) is a virtualized private cloud within a
public cloud (GCP, AWS) for an organization
Advantages of VPC: Better Security + All benefits of public cloud
HR Management
Finance Services
Public Cloud
Public Cloud
Private Cloud
HR Management
Finance Services
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Virtual Private Cloud (VPC)
The key technologies for isolating a VPC from the rest of the public cloud are:
• Subnets:
– A subnet (a range of IP addresses) is reserved (not available to everyone) within the network – for private use.
– In a VPC, cloud providers will allocate private IP addresses (not accessible via the public Internet).
• VLAN (Virtual Local Area Network):
– A VLAN is a virtual LAN and it’s used to partition a network.
– A virtual private network (VPN) uses encryption to create a private network.
– VPN traffic passes through publicly shared Internet infrastructure – routers, switches, etc.
• NAT (Network Address Translation):
– NAT matches private IP addresses to a public IP address for connections with the public Internet.
– With NAT, a public-facing website or application could run in a VPC.
https://www.cloudflare.com/learning/dns/glossary/what-is-my-ip-address/
https://www.cloudflare.com/learning/vpn/what-is-a-vpn/
https://www.cloudflare.com/learning/ssl/what-is-encryption/
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Regions and Zones
• Cloud Providers organize IT resources by regions and
• Availability Regions
– the geographic locations of the data centres
E.g. China, North America, Southeast Asia, East
Asia, Europe, Middle East, etc.
– collection of zones
– Specific location to run resources
• Availability Zones
– one or more discrete data centers with redundancy in
– Multiple zones are interconnected with encryption
• Prices of IT resources in different zones and regions could
be very different!
https://aws.amazon.com/about-aws/global-infrastructure/regions_az/?nc1=h_ls
https://aws.amazon.com/about-aws/global-infrastructure/regions_az/?nc1=h_ls
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Subnets and VPC in GCP and AWS
Subnets and VPC in GCP and AWS are differently organized:
• VPC in GCP is global (automatic routing for traffic), but regional in AWS (needs VPC peering setup);
• Subnet is zonal and regional in GCP, but confined in zones in AWS (needs routing setup)
VPC Network (Global)
Region 1 Region 2
Zone1 Zone2 Zone3
Region 1 Region 2
Zone1 Zone2 Zone3
VPC A VPC B
Zone1 Zone2
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Demo – Create VPC Network in GCP
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Virtual Private Cloud (VPC)
VPC Network (Global)
South-east asia Europe
Zone1 Zone2 Zone3
Subnet 1 Subnet 2
VPN Gateway
InternetOn Premises
Zone1 Zone2
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Routes and Firewall Rules
• Routes define paths for packets leaving instances.
• Routes in Google Cloud are divided into two categories:
– system-generated and custom.
• Firewall rules aim to protect your VPCs.
• Firewall rules apply to both outgoing (egress) and incoming (ingress) traffic in the network.
• Firewall rules control traffic even if it is entirely within the network.
• In GCP, every VPC network has implied firewall rules;
– two implied IPv4 firewall rules,
– two implied IPv6 firewall rules.
– the implied egress rules allow most egress traffic, and the implied ingress rules deny all ingress
– you cannot delete the implied rules, but you can override them with your own rules.
• To monitor which firewall rule allowed or denied a particular connection, see Firewall Rules Logging.
https://cloud.google.com/vpc/docs/firewalls#default_firewall_rules
https://cloud.google.com/vpc/docs/using-firewalls
https://cloud.google.com/vpc/docs/firewall-rules-logging
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Other Networking Products
• Load Balancing
• Cloud DNS
• Cloud CDN
• Cloud NAT
• Traffic Director
• Service Directory
• Cloud Domains
• Private Service Connect
• And more…
Have some quizzes in Ripple!
https://ripple.uqcloud.net/#/offering/808/profile/overview
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• Networking and Virtual Private Cloud
• Load Balancing
– What & Why Load Balancing
– Algorithms
– LB in Cloud Architecture
– LB in Distributed Systems
– LB in Network Communications
– LB in Cloud Product
• Cloud Architecture
– Workload Distribution Architecture & Resource Pooling Architecture
– Dynamic Scalability Architecture & Elastic Resource Capacity Architecture
– Service Load Balancing Architecture & Cloud Bursting Architecture
– Elastic Disk Provisioning Architecture & Redundant Storage Architecture
• Advanced Cloud Architecture
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Load Balancing
Picture: https://avinetworks.com/docs/17.2/aws-reference-architecture/
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Example: Three-Tier Client/Server Network
Electronic Commerce, Sixth Edition
18/08/2021
CRICOS code 00025BCRICOS code 00025B
What is load balancing ?
• Load balancing improves the distribution of workloads across multiple
computing resources, such as computers, a computer
cluster, network links, central processing units, or disk drives.
• Load balancing aims to optimize resource use, maximize throughput,
minimize response time, and avoid overload of any single resource.
• Using multiple components with load balancing instead of a single
component may increase reliability and availability
through redundancy.
• Load balancing usually involves dedicated software or hardware, such
as a multilayer switch or a Domain Name System server process.
Why should be load balanced ?
• Improve resource utilization
• Improve system performance
• Improve energy efficiency
Load Balancing
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Server computing capacity problem – The thin clients waged too many applications.
Single-point Data Storage Problem – When a single data resource is (unexpected) demanded by an
overwhelming number of clients, (i.e., a single data item is to be requested by many users).
Traffic Problem – When a destination Web Server is to be visited by too many clients.
Storage and Traffic Problem – When a server needs to maintain far too many incoming data streams
(upstream) or outgoing data streams (down streams) for file exchanges.
Network Congestion Problem – When the demands of the (web) services is over the server’s capacity.
Dynamic Change of the Clients Demands – The clients’ demands of services are unpredictable and may
change dramatically.
Load Balancing Problems
Capacity of
Storing Networking
Load balancing is the process of finding overloaded nodes
and then transferring the extra load to other nodes.
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.429.996&rep=rep1&type=pdf
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• Networking and Virtual Private Cloud
• Load Balancing
– What & Why Load Balancing
– Algorithms
– LB in Cloud Architecture
– LB in Distributed Systems
– LB in Network Communications
– LB in Cloud Product
• Cloud Architecture
– Workload Distribution Architecture & Resource Pooling Architecture
– Dynamic Scalability Architecture & Elastic Resource Capacity Architecture
– Service Load Balancing Architecture & Cloud Bursting Architecture
– Elastic Disk Provisioning Architecture & Redundant Storage Architecture
• Advanced Cloud Architecture
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Round-robin load balancing is one of the simplest
methods for distributing client requests across a group
of servers.
Going down the list of servers in the group, the round-
robin load balancer forwards a client request to each
server in turn.
When it reaches the end of the list, the load balancer
loops back and goes down the list again (sends the
next request to the first listed server, the one after that
to the second server, and so on).
Load Balancing Algorithm – Round Robin
Singh, Navpreet, and Kanwalvir Singh Dhindsa. “Load Balancing in Cloud Computing Environment: A Comparative Study of Service Models and Scheduling
Algorithms.” International Journal of Advanced Networking and Applications8, no. 6 (2017): 3246.
Multiple clients
Two servers
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• Round-robin load balancing is suitable for some
• Not identified hardware specifications between
• Round-robin load balancing can result in
overloading of imbalanced cluster.
• Round-robin is best for clusters consisting of
servers with identical specs.
Load Balancing Algorithm – Round Robin
Singh, Navpreet, and Kanwalvir Singh Dhindsa. “Load Balancing in Cloud Computing Environment: A Comparative Study of Service Models and Scheduling
Algorithms.” International Journal of Advanced Networking and Applications8, no. 6 (2017): 3246.
4 vCore, 4G RAM
2 vCore, 2G RAM
Multiple clients
Two servers
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Weighted Round Robin load balancing is similar to
the Round Robin (cyclic distribution).
The node with the higher specs will be apportioned a
greater number of requests.
Set up the load balancer with assigned “weights” to
each node according to hardware specs.
Higher specs, higher weight.
For example, if Server 1’s capacity is 2x more than
Server 2’s, then you can assign Server 1 a weight of 2
and Server 2 a weight of 1.
Load Balancing Algorithm – Weighted Round Robin
Singh, Navpreet, and Kanwalvir Singh Dhindsa. “Load Balancing in Cloud Computing Environment: A Comparative Study of Service Models and Scheduling
Algorithms.” International Journal of Advanced Networking and Applications8, no. 6 (2017): 3246.
4 vCore, 4G RAM
2 vCore, 2G RAM
Multiple clients
Two servers
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Identical hardware specs, but different occupied
durations by client. E.g. clients connecting to Server 2
stay connected much longer than those connecting to
Congestion in Server 2 makes resources run out
Example: clients 1 and 3 already disconnect, while 2, 4,
5, and 6 are still connected.
Least Connections algorithm consider the number of
current connections each server has when load
balancing.
Less connection, higher priority for assignment.
Example, when using Least Connections algorithm,
client 6 will be directed to Server 1 instead of Server 2.
Load Balancing Algorithm – Least Connections
Multiple clients
Two servers
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• The Weighted Least Connections algorithm applies a
“weight” component based on the computing capacities
of each server.
• Similar with Weighted Round Robin, setup a weight for
each server.
• When directing an access request, a load balancer now
considers two things:
– the weights of each server
– the number of clients currently connected to each
Load Balancing Algorithm – Weighted Least Connections
4 vCore, 4G RAM
Multiple clients
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• As its name implies, this algorithm matches clients
and servers by random, i.e. using an underlying
random number generator.
• In cases wherein the load balancer receives a large
number of requests, a Random algorithm will be
able to distribute the requests evenly to the nodes.
• Like Round Robin, the Random algorithm is
suitable for clusters consisting of nodes with similar
configurations (CPU, RAM, etc).
Load Balancing Algorithm – Random
Multiple clients
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• Agent-based adaptive load balancing
• Chained failover load balancing
• Weighted response time load balancing
• Source IP hashing load balancing
• Layer 4-7 load balancing
Other Cloud Load Balancing Algorithms
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• Networking and Virtual Private Cloud
• Load Balancing
– What & Why Load Balancing
– Algorithms
– LB in Cloud Architecture
– LB in Distributed Systems
– LB in Network Communications
– LB in Cloud Product
• Cloud Architecture
– Workload Distribution Architecture & Resource Pooling Architecture
– Dynamic Scalability Architecture & Elastic Resource Capacity Architecture
– Service Load Balancing Architecture & Cloud Bursting Architecture
– Elastic Disk Provisioning Architecture & Redundant Storage Architecture
• Advanced Cloud Architecture
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Load Balanced Virtual Server Instances Architecture
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Load Balanced Virtual Server Instances Architecture
• The load balanced virtual server instances architecture establishes a capacity
watchdog system
– dynamically calculates virtual server instances and associated workloads,
– distributes the processing across available physical server hosts
• The capacity watchdog system has
– a usage monitor: tracks physical and virtual server usage and reports any
significant fluctuations to the capacity planner
– live VM migration program
– a capacity planner: is responsible for dynamically calculating physical
server computing capacities against virtual server capacity requirements.
• The hypervisor cluster architecture provides the foundation of load-balanced
virtual server architecture.
• Policies and thresholds are defined for the capacity watchdog
monitor (2), which compares physical server capacities with
virtual server processing (3).
• The capacity watchdog monitor reports an over-utilization to
the VIM (4).
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Load Balanced Virtual Server Instances Architecture
• The VIM signals the load balancer to redistribute
the workload based on pre-defined thresholds (5).
• The load balancer initiates the live VM migration
program to move the virtual servers (6).
• Live VM migration moves the selected virtual
servers from one physical host to another (7).
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Load Balanced Virtual Server Instances Architecture
• The workload is balanced across the physical
servers in the cluster (8).
• The capacity watchdog continues to monitor the
workload and resource consumption (9).
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• Networking and Virtual Private Cloud
• Load Balancing
– What & Why Load Balancing
– Algorithms
– LB in Cloud Architecture
– LB in Distributed Systems
– LB in Network Communications
– LB in Cloud Product
• Cloud Architecture
– Workload Distribution Architecture & Resource Pooling Architecture
– Dynamic Scalability Architecture & Elastic Resource Capacity Architecture
– Service Load Balancing Architecture & Cloud Bursting Architecture
– Elastic Disk Provisioning Architecture & Redundant Storage Architecture
• Advanced Cloud Architecture
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• Apache Hadoop was proposed in 2010 as a
collection of open-source software utilities to deal
with big data problem.
• The core of Apache Hadoop consists of a storage
part, known as Hadoop Distributed File System
(HDFS), and a processing part which is a
MapReduce programming model.
– Hadoop splits files into large blocks and
distributes them across nodes in a cluster.
– It then transfers packaged code into nodes
– It takes advantage of data locality.
– faster and more efficiently than a
conventional supercomputer architecture
Hadoop Distributed File System
Shvachko, Konstantin, , , and . “The hadoop distributed file system.” In MSST, vol. 10, pp. 1-10. 2010
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• Many inexpensive commodity hardware and failures are very common
• Many big files: millions of files, ranging from MBs to GBs
• Two types of reads
– Large streaming reads
– Small random reads
• Once written, files are seldom modified
– Random writes are supported but do not have to be efficient
• High sustained bandwidth is more important than low latency
Design Motivations (similar with GFS)
18/08/2021
CRICOS code 00025BCRICOS code 00025B
• Maintains meta-data in RAM
• maintains the namespace tree and the mapping of file
blocks to DataNodes
• Store data and replicas
• Send heartbeats to NameNode
• receives maintenance commands from the NameNode
indirectly (in replies to heartbeats).
– replicate blocks to other nodes;
– remove local block replicas;
– re-register or to shut down the node;
– send an immediate block report.
HDFS – Architecture Overview
18/08/2021
CRICOS code 00025BCRICOS code 00025B
Master/Slave architecture
HDFS – Architecture Overview
HDFS Client NameNode
DataNode DataNode DataNode DataNode DataNode
Replication, balancing, heartbeats, etc.
18/08/2021
程序代写 CS代考 加微信: powcoder QQ: 1823890830 Email: powcoder@163.com