Manage pipeline

This page explains how to manage pipelines in GlassFlow.

Get Pipeline Credentials

You need pipeline credentials to publish or consume data using the Python SDK. This section will guide you on getting pipeline credentials using the GlassFlow WebApp or CLI.

Get Pipeline Credentials Using the WebApp

  1. Go to the app.glassflow.dev and log in with your account credentials.

  2. Choose the existing pipeline, click, and open the pipeline view.

  3. Copy its credentials such as Pipeline ID and Access Token.

GlassFlow pipeline copy pipeline credentials

You'll set them as environment variables when you publish or consume data.

Get Pipeline Credentials Using the CLI

Prerequisites

  1. Open your terminal and log in to your GlassFlow account:

glassflow login
  1. Run the following command to retrieve Pipeline ID and Space ID:

glassflow pipeline list

You will get a message on the terminal with the Pipeline ID and Space ID:

ID               | Name                    | Space ID      | Space Name      |
------------------------------------------------------------------------------
your_pipeline_id | your_pipeline_name      | your_space_id | your_space_name |
  1. To get the pipeline access token, run the List Access Tokens CLI command:

glassflow pipeline tokens {pipeline_id}
Name    | ID                            | Token     |
-----------------------------------------------------
default | your_pipeline_access_token_id | **********|
-----------------------------------------------------

Note down the Pipeline ID and Access Token. You'll set them as environment variables when you publish or consume data.

Last updated

Logo

© 2023 GlassFlow