Note: The original feature called Shared Buckets is now integrated into our Data Catalog.
The data catalog represents an overview of data shared to and from the project. There are generally numerous options to share data (ranging from CSV exports to writing to a dedicated database). The data catalog allows you to share data in a very efficient, controlled and auditable way.
Sharing data via the data catalog is useful in numerous ways – for example:
The following terminology is used:
All changes and events in a shared bucket are propagated to its linked buckets; any tables you create in the shared bucket become immediately available in the destination projects. Data size and rows are counted only in the source project.
There are some constraints to how shared buckets can be used:
There are several options how you can share data:
To share data outside of your project, go to Catalog a click Share a bucket.
Next you can choose whether you want to share an existing bucket or create a new one. Both options are technically the same, the choice depends purely on whether you prepared the data in advance (an existing bucket) or not (create a new bucket).
Choose the Share existing bucket option:
Then, select the bucket and a sharing type:
The bucket is shared and instantly available to other projects in the organization depending on the sharing type you have chosen. Provide a description of the bucket so others know what to expect. To enter your description, click on the bucket:
To change a sharing type, share the existing bucket again. The newly selected sharing type will overwrite the old one.
Choose the Select tables option:
Select the tables and/or buckets you want to share:
Enter the bucket name and a sharing type. Optionally, enter the description:
A new bucket will be created for you, the selected tables will be linked to it using aliases.
To change a sharing type, share the newly created bucket again. The newly selected sharing type will overwrite the old one.
You can link a shared bucket into your project from Shared with you page:
Enter a name of the bucket as you’d like to see it in the current project and Link the bucket:
You’ll see that the bucket is available in your project:
You can see the contents of the shared bucket in Storage, with a link to the source project (if you have access to it).
The detail of the shared bucket in Storage also shows the linked buckets:
You can see the history of when and how a bucket was shared in the Bucket events:
To stop sharing a bucket, go to Data Catalog and Disable sharing:
Note: you can only disable sharing if the bucket is not linked to any project. To unlink a bucket, you have to go to the destination project and unlink it from the Catalog section:
Or, you can unlink the bucket from Storage: