A Meerschaum pipe represents a data stream into a table and the necessary parameters to sync new data.
Pipes are identified by three primary components in a hierarchy:
- 🔌 Connector (data source)
- 📊 Metric (label)
- 📍 Location (optional tag)
In the above screenshot, three pipes are represented according to their keys (you can see this view with
show pipes). The three pipes share a connector (
plugin:noaa) and metric (
weather) but have different locations.
The three keys of any pipe are labels that represent the pipe's connector, metric, and location. Below are brief descriptions of what these keys mean, and you can read about these keys when you bootstrap a pipe.
Selecting Your Pipes¶
As you add new data streams, the number of pipes you maintain can quickly grow. You'll need a way to apply the your commands to multiple pipes at a time (e.g.
delete pipes, etc.).
To filter by these keys, use the arguments
-l (connector, metric, and location).
For example, the screenshot mentioned above may be created by any of these commands, or any combination of the three:
1 2 3
In addition to filtering by the above keys, you can also select a custom group of pipes with tags:
You can select pipes which don't have a certain key by prefacing the key with an underscore (
Every pipe has a parameters dictionary where you can store and retrieve metadata.
The screenshots below show the
clemson pipe's parameters. On the left, you can edit the parameters with
edit pipe -l clemson, and on the right, you can directly access this dictionary with
pipe.parameters. These values are set by the
noaa plugin during registration to determine which data to fetch, and you can even add your own metadata.
Meerschaum pipes are time-series focused. In order to properly sync your data, you need to specify the name of the datetime column.
To set the column names for your pipes, run the command
columns key, define the name of your
datetime column. You may also define
1 2 3 4 5 6 7