Connect GCP
Overview
Connect Google Cloud to CloudPi to ingest BigQuery billing exports and enable cost analysis and reporting.
Prerequisites
BigQuery Billing Export Enabled
GCP billing export must be enabled to a BigQuery dataset containing detailed billing data.
IAM Permissions to Configure Access
Permissions to:
- Create a service account
- Assign IAM roles on the billing project
- Grant access to the BigQuery billing dataset
GCP Service Account with Credentials
- A customer-created GCP service account with the required IAM roles assigned
- A service account key file (credentials.json) generated from this account, which will be provided to CloudPi for authentication
Configuration Workflow
- Enable BigQuery billing export.
- Grant CloudPi access to the billing project.
- Grant CloudPi access to the BigQuery dataset.
- (Optional) Grant viewer access for active resources.
- Add GCP details in CloudPi.
- Validate ingestion and backfill if needed.
Step 1 - Enable BigQuery Billing Export
- Open Billing in GCP.
- Enable detailed billing export to a BigQuery dataset.
- Confirm dataset and project IDs.
Step 2 - Grant Project-Level Access
Grant the CloudPi service account BigQuery Job User on the billing project.
Step 3 - Grant Dataset Access
Grant the CloudPi service account BigQuery Data Viewer on the billing dataset.
Step 4 - Optional: Active Resource Access
If you want active resource visibility, grant the Viewer role on the relevant projects.
Step 5 - Connect in CloudPi
- Go to Integrations or Cloud Onboarding.
- Select GCP and enter:
- Billing project ID
- Dataset name
- Service account details (if required)
Step 6 - Validate and Backfill
- Confirm the integration status is Connected.
- Validate data in Billing Hub and Dashboards.
- If historical filtering is required, backfill older exports when available.
Troubleshooting
If data does not appear: - Verify billing export is active. - Confirm dataset permissions for the CloudPi service account.
For assistance, contact support@cloudpi.ai.