BigQuery
By connecting Super with BigQuery, you can instantly search and ask about all your BigQuery tables directly in Super.
This guide will walk you through the key aspects of the Super and BigQuery connection.
Connecting BigQuery & Super
This is the first step to get started. This section covers how to set up the connection between Super and BigQuery.
Required Permissions for Setup
To connect Super and BigQuery, you must have the necessary permissions in both platforms.
- In Super: Permission to add or remove data sources depends on your team's settings. By default, only workspace admins or owners can set up a connection. However, a Super admin can enable a setting to allow all members to add and remove data sources.
- In BigQuery: The user must have the necessary permissions to create a service account; generate a service account key in the Google Cloud project; and allow this service account domain wide delegation in the Google workspace.
- If you don't have these permissions and need to connect to BigQuery, you can ask a Google Cloud admin to generate the service account key and send it to you. The Google Workspace admin will also need to set up the domain wide delegation.
Initial BigQuery Connection
1) Creating a Service Account
To begin, you need to create a service account in Google Cloud:
Visit the Google Cloud Console and navigate to your project.
Go to IAM & Admin > Service Accounts.
Click Create Service Account.
Provide a name and description for the service account, then click Create and Continue.
Grant the service account the BigQuery User and BigQuery Data Viewer permissions.
Click Continue and then Done.
2) Generating a Service Account Key
Once the service account is created, you need to generate a JSON key file:
In the Service Accounts list, find the service account you just created.
Click it, then go to the Keys tab.
Click Add Key > Create new key.
Select JSON as the key type and click Create.
The JSON key file will be downloaded to your computer.
3) Setting Up Domain-Wide Delegation
Then, you need to follow these steps to fetch Google Cloud groups permissions:
On the Details tab of the service account you created, select the Unique ID value and copy it.
Click Add new to create a domain wide delegation with the Client ID you pasted in the previous step.
Enter the following OAuth scope:
To copy it, click the block then click the Copy button that appears.
https://www.googleapis.com/auth/bigquery.readonly
Click Authorize.
4) Connecting BigQuery in Super
Finally, go to Super and follow these steps to connect BigQuery:
Click Data Sources in the left sidebar.
Find the BigQuery option and click Connect BigQuery.
A popup will appear. Paste the JSON service account key file you downloaded earlier.
Click Connect to BigQuery.
The initial data sync will begin.
Once the initial sync is complete, you can use BigQuery everywhere in Super as a Data Source.
5) Syncing BigQuery Datasets in Super
Once the initial sync has been completed, all the BigQuery tables you have access to will appear in the Available Sources section.
To sync a specific table, select it, then click Sync 1 Source.
To find a specific table quickly, you can start typing its name in the search bar at the top, where it says "Filter sources...".
If you don't see a specific table, you will need to ask your Google Cloud administrator for access before it shows up in Super.
How Super Indexes Your BigQuery Data
What We Sync
Super syncs table descriptions from your connected BigQuery projects, but doesn't sync the data itself.
Refresh Rate
New and updated tables will appear in Super every 24 hours, but you can always sync manually if needed.
Access Control & Privacy
Permissions are respected based on the BigQuery access.
Super members can only search and access BigQuery tables that the connected service account has permission to view.