octopipe source
Command Reference
The octopipe source
command is used to manage data sources within your Octopipe project. It allows you to add, list, update, and remove data sources that serve as the entry points for your pipelines.
Purpose
- Data Ingestion: Configure how and from where Octopipe retrieves data.
- Central Management: Maintain a consistent and standardized list of sources across your pipelines.
Usage
--name <source_name>
: Unique name for the data source.
• --type <source_type>
: Type of source (e.g., api, database, file).
• --config-file <path>
: Path to a configuration file for complex setups.
• --option <key>=<value>
: Additional options; can be repeated for multiple key-value pairs.
list
• Purpose: List all configured data sources.
• Usage Example: