AWS Management

The Lyftron Provider for AWS Management offers the most natural way to access AWS Management data from Lyftron with ease and also enables to connect with BI, MDM & ML tools, Data warehouses, Databases and other SAAS based applications with zero code and zero infrastructure requirements. The provider wraps the complexity of accessing AWS Management data into easy-to-integrate relational fully managed ANSI Sql format. Make faster and better business decisions with Lyftron’s AWS Management data provider and automatically build your data migration pipelines in minutes, not months

The provider hides the complexity of accessing data and provides additional powerful security features, smart caching, batching, socket management, and more.

Key Features

• Comprehensive Delta load mechanism.
• Real-time access to AWS Management.
• Comprehensive full support of ANSI Sql to query data with ease.
• Collaborative query processing.

Prerequisites

The user must have credentials for AWS Management, Lyftron and your destination data warehouse, lake or database to perform the data pipeline operation with Lyftron

Establishing a Connection with Lyftron's Quickstart Steps

Create your AWS Management connection with Lyftron by following the 5 easy steps show below:

Step1. Add your connection

Click on Connect section on the left panel →  Click on Add Connection button

Step2. Select your connector

In the connector selection panel, search and click AWS Management for your connection 

Step3. Enter your connection details

In the Connection String section enter the values of the below parameters. The following connection string is required to establish AWS Management connection with Lyftron.

"AccessKey=myAccessKey;Account=myAccountName;"

Key	Value	Field
Connection Name	Enter your connection details	Required
AccessKey	Your AWS Management AccessKey	Required
Account	Your AWS Management Account Name	Required
Logfile**	Use the logfile option to debug your job and provide your connection name to generate the log file.  [ConnectionConfigurationPath]\Connection_name_log.tx	Optional
Verbosity**	Choose verbosity 1-5 based on the severity of debugging	Optional

** For more information, check the Lyftron logging and debugging section.

If you want more detailed information about how to establish a connection with Lyftron, click on Lyftron Connection Quick Start guide.

Step4. Test your connection

Once you are done entering your connection details, simply click on the Test Connection button to test the connectivity. In case your connection fails, add Logfile and Verbosity parameters and check the Lyftron logging and debugging section, to debug the error.

 Step5. Save your connection

Hurray! Now you have successfully connected with the Lyftron AWS Management connector and can utilize the connector to Extract, Warehouse, Analyze, Visualize and Share your data.

Data Model

The provider models AWS services as relational views, or read-only tables. The service view definitions are dynamically generated. When you connect, the provider retrieves the metadata from AWSDataManagement and reflects any changes in the view schemas.

Views are composed of columns and pseudo columns. Views are similar to tables in the way that data is represented; however, views do not support updates. Entities that are represented as views are typically read-only entities. Often, a stored procedure is available to update the data if such functionality is applicable to the data source. Queries can be executed against a view as if it were a normal table, and the data that comes back is similar in that regard.

Name	Type	Description
Budgets	Views	Lists the budgets that are associated with an account.
CostAndUsage	Views	Retrieves cost and usage metrics for your account.
DimensionValues	Views	Retrieves all available filter values for a specified filter over a period of time.
Services	Views	Returns the metadata for one service or a list of the metadata for all services.
Service_AlexaTopSites	Views	Retrieve information about the service AlexaTopSites.
Service_AlexaWebInfoService	Views	Retrieve information about the service AlexaWebInfoService.
Service_AmazonApiGateway	Views	Retrieve information about the service AmazonApiGateway.
Service_AmazonAppStream	Views	Retrieve information about the service AmazonAppStream.
Service_AmazonAthena	Views	Retrieve information about the service AmazonAthena.
Service_AmazonChime	Views	Retrieve information about the service AmazonChime.
Service_AmazonChimeDialin	Views	Retrieve information about the service AmazonChimeDialin.
Service_AmazonCloudDirectory	Views	Retrieve information about the service AmazonCloudDirectory.
Service_AmazonCloudFront	Views	Retrieve information about the service AmazonCloudFront.
Service_AmazonCloudSearch	Views	Retrieve information about the service AmazonCloudSearch.
Service_AmazonCloudWatch	Views	Retrieve information about the service AmazonCloudWatch.
Service_AmazonCognito	Views	Retrieve information about the service AmazonCognito.
Service_AmazonCognitoSync	Views	Retrieve information about the service AmazonCognitoSync.
Service_AmazonConnect	Views	Retrieve information about the service AmazonConnect.
Service_AmazonDAX	Views	Retrieve information about the service AmazonDAX.
Service_AmazonDynamoDB	Views	Retrieve information about the service AmazonDynamoDB.
Service_AmazonEC2	Views	Retrieve information about the service AmazonEC2.
Service_AmazonECR	Views	Retrieve information about the service AmazonECR.
Service_AmazonECS	Views	Retrieve information about the service AmazonECS.
Service_AmazonEFS	Views	Retrieve information about the service AmazonEFS.
Service_AmazonEKS	Views	Retrieve information about the service AmazonEKS.
Service_AmazonElastiCache	Views	Retrieve information about the service AmazonElastiCache.
Service_AmazonES	Views	Retrieve information about the service AmazonES.
Service_AmazonETS	Views	Retrieve information about the service AmazonETS.
Service_AmazonGameLift	Views	Retrieve information about the service AmazonGameLift.
Service_AmazonGlacier	Views	Retrieve information about the service AmazonGlacier.
Service_AmazonGuardDuty	Views	Retrieve information about the service AmazonGuardDuty.
Service_AmazonInspector	Views	Retrieve information about the service AmazonInspector.
Service_AmazonKinesis	Views	Retrieve information about the service AmazonKinesis.
Service_AmazonKinesisAnalytics	Views	Retrieve information about the service AmazonKinesisAnalytics.
Service_AmazonKinesisFirehose	Views	Retrieve information about the service AmazonKinesisFirehose.
Service_AmazonLex	Views	Retrieve information about the service AmazonLex.
Service_AmazonLightsail	Views	Retrieve information about the service AmazonLightsail.
Service_AmazonMacie	Views	Retrieve information about the service AmazonMacie.
Service_AmazonML	Views	Retrieve information about the service AmazonML.
Service_AmazonMQ	Views	Retrieve information about the service AmazonMQ.
Service_AmazonNeptune	Views	Retrieve information about the service AmazonNeptune.
Service_AmazonPinpoint	Views	Retrieve information about the service AmazonPinpoint.
Service_AmazonPolly	Views	Retrieve information about the service AmazonPolly.
Service_AmazonQuickSight	Views	Retrieve information about the service AmazonQuickSight.
Service_AmazonRDS	Views	Retrieve information about the service AmazonRDS.
Service_AmazonRedshift	Views	Retrieve information about the service AmazonRedshift.
Service_AmazonRekognition	Views	Retrieve information about the service AmazonRekognition.
Service_AmazonRoute53	Views	Retrieve information about the service AmazonRoute53.
Service_AmazonS3	Views	Retrieve information about the service AmazonS3.
Service_AmazonSageMaker	Views	Retrieve information about the service AmazonSageMaker.
Service_AmazonSES	Views	Retrieve information about the service AmazonSES.
Service_AmazonSimpleDB	Views	Retrieve information about the service AmazonSimpleDB.
Service_AmazonSNS	Views	Retrieve information about the service AmazonSNS.
Service_AmazonStates	Views	Retrieve information about the service AmazonStates.
Service_AmazonSWF	Views	Retrieve information about the service AmazonSWF.
Service_AmazonVPC	Views	Retrieve information about the service AmazonVPC.
Service_AmazonWAM	Views	Retrieve information about the service AmazonWAM.
Service_AmazonWorkDocs	Views	Retrieve information about the service AmazonWorkDocs.
Service_AmazonWorkMail	Views	Retrieve information about the service AmazonWorkMail.
Service_AmazonWorkSpaces	Views	Retrieve information about the service AmazonWorkSpaces.
Service_AWSAppSync	Views	Retrieve information about the service AWSAppSync.
Service_AWSBudgets	Views	Retrieve information about the service AWSBudgets.
Service_AWSCertificateManager	Views	Retrieve information about the service AWSCertificateManager.
Service_AWSCloudTrail	Views	Retrieve information about the service AWSCloudTrail.
Service_AWSCodeCommit	Views	Retrieve information about the service AWSCodeCommit
Service_AWSCodeDeploy	Views	Retrieve information about the service AWSCodeDeploy.
Service_AWSCodePipeline	Views	Retrieve information about the service AWSCodePipeline.
Service_AWSConfig	Views	Retrieve information about the service AWSConfig.
Service_AWSCostExplorer	Views	Retrieve information about the service AWSCostExplorer.
Service_AWSDatabaseMigrationSvc	Views	Retrieve information about the service AWSDatabaseMigrationSvc.
Service_AWSDataTransfer	Views	Retrieve information about the service AWSDataTransfer.
Service_AWSDeveloperSupport	Views	Retrieve information about the service AWSDeveloperSupport.
Service_AWSDeviceFarm	Views	Retrieve information about the service AWSDeviceFarm.
Service_AWSDirectConnect	Views	Retrieve information about the service AWSDirectConnect.
Service_AWSDirectoryService	Views	Retrieve information about the service AWSDirectoryService.
Service_AWSElementalMediaConvert	Views	Retrieve information about the service AWSElementalMediaConvert.
Service_AWSElementalMediaLive	Views	Retrieve information about the service AWSElementalMediaLive.
Service_AWSElementalMediaPackage	Views	Retrieve information about the service AWSElementalMediaPackage.
Service_AWSElementalMediaStore	Views	Retrieve information about the service AWSElementalMediaStore.
Service_AWSElementalMediaTailor	Views	Retrieve information about the service AWSElementalMediaTailor.
Service_AWSEvents	Views	Retrieve information about the service AWSEvents.
Service_AWSGlue	Views	Retrieve information about the service AWSGlue.
Service_AWSGreengrass	Views	Retrieve information about the service AWSGreengrass.
Service_AWSIoT	Views	Retrieve information about the service AWSIoT.
Service_AWSkms	Views	Retrieve information about the service AWSkms.
Service_AWSLambda	Views	Retrieve information about the service AWSLambda.
Service_AWSQueueService	Views	Retrieve information about the service AWSQueueService.
Service_AWSSecretsManager	Views	Retrieve information about the service AWSSecretsManager.
Service_AWSServiceCatalog	Views	Retrieve information about the service AWSServiceCatalog.
Service_AWSShield	Views	Retrieve information about the service AWSShield.
Service_AWSStorageGateway	Views	Retrieve information about the service AWSStorageGateway.
Service_AWSSupportBusiness	Views	Retrieve information about the service AWSSupportBusiness.
Service_AWSSupportEnterprise	Views	Retrieve information about the service AWSSupportEnterprise.
Service_AWSwaf	Views	Retrieve information about the service AWSwaf.
Service_AWSXRay	Views	Retrieve information about the service AWSXRay.
Service_CloudHSM	Views	Retrieve information about the service CloudHSM.
Service_CodeBuild	Views	Retrieve information about the service CodeBuild.
Service_ContactCenterTelecomm	Views	Retrieve information about the service ContactCenterTelecomm.
Service_Datapipeline	Views	Retrieve information about the service Datapipeline.
Service_ElasticMapReduce	Views	Retrieve information about the service ElasticMapReduce.
Service_IngestionService	Views	Retrieve information about the service IngestionService.
Service_IngestionServiceSnowball	Views	Retrieve information about the service IngestionServiceSnowball.
Service_OpsWorks	Views	Retrieve information about the service OpsWorks.
Service_SnowballExtraDays	Views	Retrieve information about the service SnowballExtraDays.