Overview
The LyftrondataProvider for Twitter offers the most natural way to access Twitter data from Lyftrondata with ease and also enables to connect with BI, MDM & ML tools, Data warehouses, Databases and other SAAS based applications with zero code and zero infrastructure requirements. The provider wraps the complexity of accessing Twitter data into easy-to-integrate relational fully managed ANSI Sql format. Make faster and better business decisions with Lyftrondata’s Twitter data provider and automatically build your data migration pipelines in minutes, not months.
The provider hides the complexity of accessing data and provides additional powerful security features, smart caching, batching, socket management, and more.
Key Features
- Comprehensive Delta load mechanism.
- Real-time access to Twitter.
- Comprehensive full support of ANSI Sql to query data with ease.
- Collaborative query processing.
Prerequisites
The user must have credentials for Twitter, Lyftrondata and your destination data warehouse, lake or database to perform the data pipeline operation with Lyftrondata.
Establishing a Connection with Lyftrondata's Quickstart Steps
Create your Twitter connection with Lyftrondata by following the 5 easy steps show below:
Step1. Add your connection
Click on Connect section on the left panel → Click on Add Connection button
Step2. Select your connector
In the connector selection panel, search and click Twitter for your connection
Step3. Enter your connection details
In the Connection String section enter the values of the below parameters. The following connection string is required to establish Twitter connection with Lyftrondata.
InitiateOAuth=GETANDREFRESH;OAuthClientId=[your_OAuthClientId]; OAuthClientSecret=[your_ServerName]; OAuthAccessToken=[your_User]; OAuthAccessTokenSecret=[your_Password];Key | Value | Field |
Connection Name | Enter your connection details | Required |
InitiateOAuth | GETANDREFRESH | Required |
Logfile** | Use the logfile option to debug your job and provide your connection name to generate the log file. [ConnectionConfigurationPath]\Connection_name_log.tx | Optional |
Verbosity** | Choose verbosity 1-5 based on the severity of debugging | Optional |
** For more information, check the Lyftrondata logging and debugging section.
If you want more detailed information about how to establish a connection with Lyftrondata, click on Lyftrondata Connection Quick Start guide.
Step4. Test your connection
Once you are done entering your connection details, simply click on the Test Connection button to test the connectivity. In case your connection fails, add Logfile and Verbosity parameters and check the Lyftrondata logging and debugging section, to debug the error.
Step5. Save your connection
Hurray! Now you have successfully connected with the Lyftrondata Twitter connector and can utilize the connector to Extract, Warehouse, Analyze, Visualize and Share your data.
Data Model
The Lyftrondata Provider for Twitter models entities in the Twitter API as tables, views, and stored procedures. These are defined in schema files, which are simple, text-based configuration files.
API limitations and requirements are documented in this section; you can use the SupportEnhancedSQL feature, set by default, to circumvent most of these limitations.
Tables
The Lyftrondata Provider for Twitter models Item Listings in tables so that they can be easily queried, updated, and deleted. You can list items on your Twitter store by calling the AddItem stored procedure.
Views
Views are tables that cannot be modified. Typically, read-only data are shown as views.
Name | Type | Description |
DirectMessages | Tables | Send direct messages and query messages sent and received by the authenticated user. |
Favorites | Tables | Create, delete, and query a list of favorite tweets of the authenticated user and allow the user to favorite new tweets or remove existing favorites. |
Following | Tables | Create, delete, and query a list of users that the current Twitter account is following, otherwise known as friends. |
Tweets | Tables | Create, delete, and query status updates and tweets from the authenticated user. |
AccountSettings | Views | Query account settings about the currently authenticated user. |
AdAccounts | Views | Retrieve all of the advertising-enabled accounts the authenticating user has access to. |
AdAvailableAudiences | Views | Query available audiences for this account. |
AdCampaigns | Views | Retrieve details for some or all campaigns associated with the current account. |
AdFundingInstruments | Views | Retrieve some or all funding instruments associated with the account specified in the path. |
AdInsights | Views | Provide qualitative information about various Twitter audiences. |
AdLineItems | Views | Retrieve some or all funding instruments associated with the account specified. |
AdPromotedTweets | Views | Retrieve all of the advertising-enabled Tweets the authenticating user has access to. |
AdStats | Views | Query information about all available metrics for a certain entity. |
Followers | Views | Query a list of users following the current Twitter account. |
ListMembers | Views | Query the members of a specified list. |
Lists | Views | Query Twitter list information based on a set of criteria. |
ListSubscribers | Views | Query the subscribers to a specified list. |
Mentions | Views | Query the most recent mentions (tweet containing @username) for the authenticating user. |
Retweets | Views | Query a list of retweets of the authenticated user. |
Trends | Views | Query the daily trending topics from Twitter. |
TweetStream | Views | Query public data flowing through Twitter. |
Users | Views | Query a list of users based on the SearchTerms, Id, or Screen_Name. |
Advanced Settings
To view a detailed advanced settings options, go to Twitter Advanced Settings. Complete list of the parameters you can configure in the connection string can be found by clicking Connection String Parameters.