Pipelines

Step 1: Create Pipeline

First step is to create a pipeline. You should do this through the UX or using our API.


Step 2: Add Data

After creating a pipeline, you need to add data that are required to interact with. The file naming convention is the following

Filename:

  • location_MM:DD:YY.csv: files stored by the "date" + “.csv”

Timestamps:

  • “HH:MM: SS”: column for the time stamps else. It will default to the current time.

You upload csv data using the following command. (See our API for more detail, we have REST as well)

account.add_csv("01-01-01.csv")


Step 3: Train Models and Add Widgets

Next, we must create objects for the end users to interact with.

pipeline.train_model(conn, **params)

An example of possible training parameters might be the following (look at the API for more information)

"models": { "next-item": { params: { "timeseries": True, "x": {}, "y": {}, "pipeline": "2890379nvjs" "user_secret": "lkjho823hikuwn" } }

After some time for training, say 15 minutes, you can add widgets to those models.

pipeline.add_widdet(conn, **params)


Step 4: Monitor Events

Lastly, we can create events to track events such as data drift. (This may indicate that there is a problem that needs to be addressed).

pipeline.add_alert(conn, **params)

This will be triggered based on whatever your metrics you defined.