Frame 4734 (2).png

This is a tutorial for creating a Dify LLM agent with RAG on Shakudo platform.

It will use Kubernetes documentation as the knowledge base.

It will use the following Shakudo stack components and features:

Step 1: Ingest data from MinIO to Qdrant

Source

  1. Log in to MinIO with the admin account

  2. Create a bucket kubernetes-documentation in Administration > Buckets and change the access policy to public

  3. Download the folders from ‣ and upload them to the bucket in User > Object Browser

    The directory should look like this:

    kubernetes-documentation/
    ├── docs/
    │   ├── concepts/
    │   │   ├── _index.md
    │   │   ├── architecture/
    │   │   └── .../
    │   ├── tutorials/
    │   │   ├── _index.md
    │   │   ├── configuration/
    └── └── └── .../
    
  4. Create access key and secret key in User > Access Keys, and save them to your local laptop or password manager

  5. Create a source connector in Airbyte with the following settings

    Use the access key and secret key to test and save the connection

Destination

  1. Create an empty collection in Qdrant console

    PUT /collections/kubernetes_documentation 
    {
      "vectors": {
        "size": 1536,
        "distance": "Cosine"
      }
    }