BigQuery
This guide describes how to connect Aporia to a BigQuery data source in order to monitor your ML Model in production.
We will assume that your model inputs, outputs and optionally delayed actuals can be queried with SQL. This data source may also be used to connect to your model's training set to be used as a baseline for model monitoring.
A separate materialization dataset location, to which query results will be written, must be designated for each project from which you want to query.
In order to provide access to BigQuery, you'll need to update your Aporia service account with the necessary API permissions.
Use the same service account used for the Aporia deployment. If someone else on your team has deployed Aporia, please reach out to them to obtain it.
- 1.
- 2.Find the Aporia service account you obtain in the previous step and click on 🖋 Edit Principle
- 3.In the "Edit access" window click on ADD ANOTHER ROLE
- 4.Add the
BigQuery Data ViewerandBigQuery Job Userroles and click Save
- 1.
- 2.In the left-hand panel, expand the relevant project and find the materialization dataset you created in the previous steps.
- 3.Click on "..." by the dataset name, then click on Share
- 4.In the "Share permissions" window click on Add Principal
- 5.In the "New principal" box, enter the email of the Aporia service account you have obtained. Choose the
BigQuery Data Editorrole and click Save.
Now Aporia has the permission it needs to connect to the BigQuery datasets and tables you have specified in the policy.
- 1.
- 2.Go to Integrations page and click on the Data Connectors tab
- 3.Scroll to Connect New Data Source section
- 4.Click Connect on the BigQuery card and follow the instructions
Bravo! now you can use the data source you've created across all your models in Aporia.
👏
Last modified 13d ago