What Is Google Cloud Storage?

Google Cloud Storage is a cloud-based data lake used for secure storage of unstructured data within a performant and scalable environment. It allows businesses to store raw customer data events in a private, unstructured environment that offers flexibility in how data is retained and used. Data is processed through playbooks before reaching storage, giving control over how events are handled. When paired with identity syncs, addressable third-party IDs can be included within the data lake.

Product Type: Storage
Integration Type: Starter Kit
Event Source Type: Web, Mobile Browser, and Mobile App
Event Scope: Full-Funnel Events

Capabilities

Stores raw customer data events in an unstructured environment for flexibility.
Keeps data in a private stream that is never co-mingled with other customers' data.
Lets you control how data is processed before it reaches GCS through playbooks.
Provides addressable third-party IDs within your data lake when paired with the Sync Injector.

Considerations

A GCS bucket and service account credential JSON are required to authenticate and store data.
Compression is enabled for stored data by default.

Starter Kit Setup Guide

1. Gather Credentials

Create buckets to hold files
Select Browser in the lefthand menu.
Click CREATE BUCKET.
Enter a unique bucket name. Names must start and end with a letter or number. Full list of bucket name requirements
Pick a storage class. Storage class affects performance, cost, and location. All classes offer high availability and low latency. Learn more about storage classes
Pick a location to store your data. To reduce latency, pick a location that is close to the services that need access to your data.
Click Create.

2. Add a Google Cloud Storage Integration

From the integration library, add a Google Cloud Storage integration. Then, fill out the Connection Parameters:

Connection Parameter	Description
`bucket`	Name of the GCS bucket where event data is stored.
`credentialJSON`	Service account credential JSON used to authenticate with GCS.
`compression`	Enables compression of stored data.

3. Configure Event Mapping

MetaRouter provides all of the event mappings that Google Cloud Storage integrations typically require. You may add custom events, parameters, or mappings in accordance with Google Cloud Storage's API documentation.

4. Deploy to Pipeline

In the Pipelines tab, add your Google Cloud Storage integration.
Select the correct integration revision.
Click Add Integration to finalize deployment.

Event Mappings

Global

Global mappings will be applied to all events. If your parameter names do not match the Expected Inputs provided, you will need to overwrite the Inputs provided with your own.

Output Key	Description	Expected Input
Full Payload	Object: The complete event payload is stored as-is in GCS.	Expression – returns the full input event

Additional Google Cloud Storage Documentation