Google Cloud Platform
Data Storage Services
GCP Data Storage Services Jumpstart
Joe Holbrook Cloudbursting Corp
Google Cloud Platform
Data Storage Overview
Lecture
Overview
Overview of Google Data Storage Overview
Structured or Unstructured
Managed or Unmanaged
GCP Storage Decision Tree
GCP Storage Portfolio
GCP Data Storage
• Google Cloud Platform delivers various storage
service offerings which remove much of the
burden of building and managing storage and
infrastructure.
• Like other cloud services, cloud storage will free
you to focus on doing what you do best and
differentiating at the application or service layer.
• Google Cloud Storage has flexible and strategic
pricing.
GCP Data
Storage
Requirements
• First is to understand do you need
Structured or Unstructured
• Second, consider the availability
and compliance requirements
• Third, consider costing models
• Fourth, consider performance
requirements (Latency)
• Fifth, determine migration
requirements
GCP Data Storage
Structured Data Services
Cloud SQL
Cloud Bigtable
Cloud BigQuery
Cloud Datastore
Cloud Spanner
Unstructured Data Services
Cloud Storage
Lets Define
Unstructured
Data
• Data Storage - Unstructured data
• Unstructured data is data that does not have a pre
determined sequence, data model or schema.
• Can be human generated or machine generated
• Examples are Email, documents, social media,
mobile, sensor data, satellite images, etc
• On GCP Cloud Storage is the only service built for
managing and maintaining you Unstructured Data
Lets Define Structured Data
• Data Storage - Structured data
• Structured data is data that does
have a pre determined
sequence, data model or
schema. Generally a database
(RDBMS)
• Can be human generated or
machine generated
• Examples are SQL.
Lets Define
Semi-
Structured
Data
Data Storage - Semi-
Structured data
Semi-Structured data is data
that contains semantic tags,
but does not conform to the
structure associated with
typical relational databases.
Can be human generated or
machine generated
Examples are XML, JSON and
NoSQL
Data Structures
Data Structure
Structured data is comprised of clearly defined data types
whose pattern makes them easily searchable usually in an
RDBMS
Unstructured data – “everything else” – is comprised of
data that is usually not as easily searchable, including
formats like audio, video, and social media postings.
Courtesy of
https://www.datamation.com/big-
data/structured-vs-unstructured-data.html
Managed or
Unmanaged Services
• Google Cloud Data Services come
in both managed and unmanaged
services.
• Managed services are for example
Cloud SQL or BigTable in GCP
• Unmanaged services are for
example Cloud Storage in GCP
Storage Integration
Storage Integration
Google Cloud Storage is tightly integrated with many of the Google Cloud
Platform products and services. Cloud Storage is often the ingestion point for data being
moved into the cloud, and is frequently the long-term storage location for data
Decision Tree
Lets look at GCP’s decision tree
https://cloud.google.com/storage-options/
GCP Portfolio
Storage Portfolio https://cloud.google.com/storage-options/
GCP Portfolio
Storage Portfolio
https://cloud.google.com/storage-options/
GCP Cloud Platform
Google Cloud Platform https://cloud.google.com/
GCP Console https://console.cloud.google.com/
GCP Storage
https://cloud.google.com/products/storage/
Documentation https://cloud.google.com/docs/
Pricing https://cloud.google.com/pricing/
Free Tier https://cloud.google.com/free/
Code Labs
https://codelabs.developers.google.com/
Qwiklabs https://qwiklabs.com/dashboard

Google Cloud Platform Data Storage

  • 1.
    Google Cloud Platform DataStorage Services GCP Data Storage Services Jumpstart Joe Holbrook Cloudbursting Corp
  • 2.
  • 3.
    Lecture Overview Overview of GoogleData Storage Overview Structured or Unstructured Managed or Unmanaged GCP Storage Decision Tree GCP Storage Portfolio
  • 4.
    GCP Data Storage •Google Cloud Platform delivers various storage service offerings which remove much of the burden of building and managing storage and infrastructure. • Like other cloud services, cloud storage will free you to focus on doing what you do best and differentiating at the application or service layer. • Google Cloud Storage has flexible and strategic pricing.
  • 5.
    GCP Data Storage Requirements • Firstis to understand do you need Structured or Unstructured • Second, consider the availability and compliance requirements • Third, consider costing models • Fourth, consider performance requirements (Latency) • Fifth, determine migration requirements
  • 6.
    GCP Data Storage StructuredData Services Cloud SQL Cloud Bigtable Cloud BigQuery Cloud Datastore Cloud Spanner Unstructured Data Services Cloud Storage
  • 7.
    Lets Define Unstructured Data • DataStorage - Unstructured data • Unstructured data is data that does not have a pre determined sequence, data model or schema. • Can be human generated or machine generated • Examples are Email, documents, social media, mobile, sensor data, satellite images, etc • On GCP Cloud Storage is the only service built for managing and maintaining you Unstructured Data
  • 8.
    Lets Define StructuredData • Data Storage - Structured data • Structured data is data that does have a pre determined sequence, data model or schema. Generally a database (RDBMS) • Can be human generated or machine generated • Examples are SQL.
  • 9.
    Lets Define Semi- Structured Data Data Storage- Semi- Structured data Semi-Structured data is data that contains semantic tags, but does not conform to the structure associated with typical relational databases. Can be human generated or machine generated Examples are XML, JSON and NoSQL
  • 10.
    Data Structures Data Structure Structureddata is comprised of clearly defined data types whose pattern makes them easily searchable usually in an RDBMS Unstructured data – “everything else” – is comprised of data that is usually not as easily searchable, including formats like audio, video, and social media postings. Courtesy of https://www.datamation.com/big- data/structured-vs-unstructured-data.html
  • 11.
    Managed or Unmanaged Services •Google Cloud Data Services come in both managed and unmanaged services. • Managed services are for example Cloud SQL or BigTable in GCP • Unmanaged services are for example Cloud Storage in GCP
  • 12.
    Storage Integration Storage Integration GoogleCloud Storage is tightly integrated with many of the Google Cloud Platform products and services. Cloud Storage is often the ingestion point for data being moved into the cloud, and is frequently the long-term storage location for data
  • 13.
    Decision Tree Lets lookat GCP’s decision tree https://cloud.google.com/storage-options/
  • 14.
    GCP Portfolio Storage Portfoliohttps://cloud.google.com/storage-options/
  • 15.
  • 16.
    GCP Cloud Platform GoogleCloud Platform https://cloud.google.com/ GCP Console https://console.cloud.google.com/ GCP Storage https://cloud.google.com/products/storage/ Documentation https://cloud.google.com/docs/ Pricing https://cloud.google.com/pricing/ Free Tier https://cloud.google.com/free/ Code Labs https://codelabs.developers.google.com/ Qwiklabs https://qwiklabs.com/dashboard