Amazon SQS

Overview of Amazon SQS managed source connector.

The Amazon Simple Queue Service (SQS) connector allows you to publish events directly to the GlassFlow pipeline from the Amazon SQS service.

Connector Details

To configure the AWS SQS connector, you will need the following details:

  • AWS Access Key ID: Your AWS access key ID.

  • AWS Secret Access Key: Your AWS secret access key.

  • AWS Region: The AWS region where your SQS queue is located.

  • SQS Queue URL: The URL of the SQS queue where the events will be published.

Obtaining Connection Credentials

To obtain your AWS credentials, follow these steps:

  1. Log in to the AWS Management Console.

  2. Navigate to the IAM Dashboard and create a new user or use an existing one with the required permissions. For more details, refer to the AWS IAM Documentation.

  3. Attach the necessary policies (e.g., AmazonSQSFullAccess).

  4. Generate Access Keys and note down the Access Key ID and Secret Access Key. For instructions about how to create a user using the IAM Console, see Creating IAM users. Once the user has been created, see Managing access keys to learn how to create and retrieve the keys used to authenticate the user.

  5. Create a new SQS queue on the AWS Management Console. To create a queue, follow the Getting started with Amazon SQS guide.

Setting Up the AWS SQS Connector

  1. Log in to the GlassFlow WebApp and navigate to the "Pipelines" section.

  2. Create a new pipeline.

  3. Configure the Data Souce:

    • Choose "Amazon SQS" as the data source type.

    • Enter your Amazon Access Key ID, Secret Access Key, Region, and SQS Queue URL.

  4. Click Next Step and confirm your pipeline data source settings.

Once configured, your GlassFlow pipeline will start consume events from the specified Amazon SQS queue.

Last updated

Logo

© 2023 GlassFlow