Overview
The Lyftron Provider for Google Spanner offers the most natural way to access Google Spanner data from Lyftron with ease and also enables to connect with BI, MDM & ML tools, Data warehouses, Databases and other SAAS based applications with zero code and zero infrastructure requirements. The provider wraps the complexity of accessing Google Spanner data into easy-to-integrate relational fully managed ANSI Sql format. Make faster and better business decisions with Lyftron’s Google Spanner data provider and automatically build your data migration pipelines in minutes, not months
The provider hides the complexity of accessing data and provides additional powerful security features, smart caching, batching, socket management, and more.
Key Features
- Comprehensive Delta load mechanism.
- Real-time access to Google Spanner.
- Comprehensive full support of ANSI Sql to query data with ease.
- Collaborative query processing.
Prerequisites
The user must have credentials for Google Spanner, Lyftron and your destination data warehouse, lake or database to perform the data pipeline operation with Lyftron
Follow the steps below to authenticate with Google Spanner and obtain the OAuthVerifier connection property:
- Click the following link to open the GoogleSpanner OAuth endpoint in your browser.
- Log in and grant permissions to the provider. You are then redirected to the callback URL, which contains the verifier code.
- Save the value of the verifier code. You will set this in the OAuthVerifier connection property.
On the headless machine, set the following connection properties to obtain the OAuth authentication values.
- OAuthVerifier: Set this to the verifier code.
- InitiateOAuth: Set this to REFRESH.
- OAuthSettingsLocation: Set this to persist the encrypted OAuth authentication values to the specified file.
- InstanceId: Set this to the Id of the instance you want to connect to.
- Database: Set this to the name of the database you want to connect to.
- ProjectId: Set this to the Id of the project you want to connect to.
After the OAuth settings file is generated, set the following properties to connect to data:
- OAuthSettingsLocation: Set this to the file containing the encrypted OAuth authentication values. Make sure this file gives read and write permissions to the provider to enable the automatic refreshing of the access token.
- InitiateOAuth: Set this to REFRESH.
- InstanceId: Set this to the Id of the instance you want to connect to.
- Database: Set this to the name of the database you want to connect to.
- ProjectId: Set this to the Id of the project you want to connect to.
For more detailed information on service and user account connectivity click Google Spanner Advanced Settings
Establishing a Connection with Lyftron's Quickstart Steps
Create your Google Spanner connection with Lyftron by following the 5 easy steps show below:
Step1. Add your connection
Click on Connect section on the left panel → Click on Add Connection button
Step2. Select your connector
In the connector selection panel, search and click Google Spanner for your connection
Step3. Enter your connection details
In the Connection String section enter the values of the below parameters. The following connection string is required to establish Google Spanner connection with Lyftron.
"ProjectId='project1';InstanceId='instance1';Database='db1';OAuthClientId='757060765381';OauthClientSecret='abc';"Key | Value | Field |
Connection Name | Enter your connection details | Required |
ProjectId | project1 | Required |
InstanceId | instance1 | Required |
Database | db1 | Required |
OAuthClientId | 757060765381 | Required |
OauthClientSecret | abc | Required |
Logfile** | Use the logfile option to debug your job and provide your connection name to generate the log file. [ConnectionConfigurationPath]\Connection_name_log.tx | Optional |
Verbosity** | Choose verbosity 1-5 based on the severity of debugging | Optional |
** For more information, check the Lyftron logging and debugging section.
If you want more detailed information about how to establish a connection with Lyftron, click on Lyftron Connection Quick Start guide.
Step4. Test your connection
Once you are done entering your connection details, simply click on the Test Connection button to test the connectivity. In case your connection fails, add Logfile and Verbosity parameters and check the Lyftron logging and debugging section, to debug the error.
Step5. Save your connection
Hurray! Now you have successfully connected with the Lyftron Google Spanner connector and can utilize the connector to Extract, Warehouse, Analyze, Visualize and Share your data.
Advanced Settings
To view a detailed advanced settings options, go to Google Spanner Advanced Settings. Complete list of the parameters you can configure in the connection string can be found by clicking Connection String Parameters.