diff --git a/404.html b/404.html index da0422356..15e6a79b9 100644 --- a/404.html +++ b/404.html @@ -82,7 +82,7 @@ diff --git a/contributing.html b/contributing.html index 4162dc391..ce0514f10 100644 --- a/contributing.html +++ b/contributing.html @@ -81,7 +81,7 @@ diff --git a/development.html b/development.html index 6d58a828f..b0d56af6d 100644 --- a/development.html +++ b/development.html @@ -81,7 +81,7 @@ diff --git a/development/development.html b/development/development.html index 7355ece6f..910c9e7b2 100644 --- a/development/development.html +++ b/development/development.html @@ -81,7 +81,7 @@ diff --git a/development/webview-development.html b/development/webview-development.html index 117f240ec..047ef01b4 100644 --- a/development/webview-development.html +++ b/development/webview-development.html @@ -81,7 +81,7 @@ diff --git a/features/aks-compare-cluster.html b/features/aks-compare-cluster.html index bd61b30aa..a9291676c 100644 --- a/features/aks-compare-cluster.html +++ b/features/aks-compare-cluster.html @@ -81,7 +81,7 @@ diff --git a/features/aks-diagnostics.html b/features/aks-diagnostics.html index 6828381eb..83dbfa82a 100644 --- a/features/aks-diagnostics.html +++ b/features/aks-diagnostics.html @@ -81,7 +81,7 @@ diff --git a/features/aks-periscope.html b/features/aks-periscope.html index 89afb6009..d1b0bb2cd 100644 --- a/features/aks-periscope.html +++ b/features/aks-periscope.html @@ -81,7 +81,7 @@ diff --git a/features/aks-plugins-github-copilot.html b/features/aks-plugins-github-copilot.html index b55c09bbf..b2ef6c4c8 100644 --- a/features/aks-plugins-github-copilot.html +++ b/features/aks-plugins-github-copilot.html @@ -81,7 +81,7 @@ @@ -198,7 +198,7 @@

- @@ -212,7 +212,7 @@

- diff --git a/features/create-gh-workflow.html b/features/create-gh-workflow.html index 96ba7123a..bd9e26708 100644 --- a/features/create-gh-workflow.html +++ b/features/create-gh-workflow.html @@ -81,7 +81,7 @@ diff --git a/features/draft-integration.html b/features/draft-integration.html index b2c6701f9..f24db07c6 100644 --- a/features/draft-integration.html +++ b/features/draft-integration.html @@ -81,7 +81,7 @@ diff --git a/features/features.html b/features/features.html index 64e804e05..25ea397e6 100644 --- a/features/features.html +++ b/features/features.html @@ -81,7 +81,7 @@ diff --git a/features/image-cleaner-eraser-tool.html b/features/image-cleaner-eraser-tool.html index eb0b4ea91..881d41217 100644 --- a/features/image-cleaner-eraser-tool.html +++ b/features/image-cleaner-eraser-tool.html @@ -81,7 +81,7 @@ diff --git a/features/inspektor-gadget.html b/features/inspektor-gadget.html index afaf1c9a1..6527d5370 100644 --- a/features/inspektor-gadget.html +++ b/features/inspektor-gadget.html @@ -81,7 +81,7 @@ diff --git a/features/install-azureserviceoperator.html b/features/install-azureserviceoperator.html index 6aecc8187..de570c4da 100644 --- a/features/install-azureserviceoperator.html +++ b/features/install-azureserviceoperator.html @@ -81,7 +81,7 @@ diff --git a/features/k8s-api-health-points.html b/features/k8s-api-health-points.html index 1f28e0763..599e29a34 100644 --- a/features/k8s-api-health-points.html +++ b/features/k8s-api-health-points.html @@ -81,7 +81,7 @@ diff --git a/features/kaito-integration.html b/features/kaito-install-deploy.html similarity index 83% rename from features/kaito-integration.html rename to features/kaito-install-deploy.html index 566efc8c4..c8c4149ae 100644 --- a/features/kaito-integration.html +++ b/features/kaito-install-deploy.html @@ -3,7 +3,7 @@ - Install & Deploy KAITO Models - Visual Studio Code AKS Tools + Install and Deploy KAITO Models - Visual Studio Code AKS Tools @@ -81,7 +81,7 @@ @@ -145,21 +145,20 @@

Visual Studio Code AKS Tools

-

Install and deploy KAITO models

-

The KAITO integration allows you to

- +

Install and Deploy KAITO models

+

The KAITO integration enables seamless installation of KAITO onto your clusters, empowering you to deploy AI models, manage workflows, and test deployments with ease and precision.

Install KAITO

-

Right click on your AKS cluster and select Deploy an LLM with KAITO and then click on Install KAITO to open up the KAITO installation page.

-

Installation Page

-

Once on the page, click Install and the KAITO installation progress will begin. You will be notified when KAITO has been successfully installed.

+

Right click on your desired AKS cluster and select Deploy an LLM with KAITO and then click on Install KAITO to open up the KAITO installation page.

+

Installation Page

+

Once on the page, click Install KAITO and the KAITO installation process will begin. Once KAITO has been successfully installed, you will be prompted with a “Generate Workspace” button that will redirect you to the model deployment page.

+

Successfull Installation

Deploy a model

-

Right click on an AKS cluster that has KAITO installed and select Deploy an LLM with KAITO and then click on Create KAITO Workspace to open the KAITO model deployment page.

+

Right click on an AKS cluster that has KAITO successfully installed and select Deploy an LLM with KAITO and then click on Create KAITO Workspace to open the KAITO model deployment page.

Deployment Page

Once on this page, you can click any of the models to open up the side panel, which will present you with the option to either Deploy Default workspace CRD or Customize Workspace CRD.

-

Click Deploy Default workspace CRD to deploy the model. It will track the progress of the model and notify you once the model has been successfully deployed. It will also notify you if the model was already previously unsucessfully onto your cluster.

+

Click Deploy Default workspace CRD to deploy the model. It will track the progress of the model and notify you once the model has been successfully deployed. It will also notify you if the model was already previously unsucessfully onto your cluster. Upon successful deployment, you will be prompted with a “View Deployed Models” button that will redirect you to the deployment management page.

+

Phi-2 Model Being Deployed +Phi-2 Model Successfully Deployed

Click Customize Workspace CRD to open up a CRD file pre-populated with the infromation necessary to deploy the model. You can alter this file to your desires and save it locally.

@@ -170,7 +169,7 @@

Deploy a model< - @@ -184,7 +183,7 @@

Deploy a model< - diff --git a/features/kaito-manage-test.html b/features/kaito-manage-test.html new file mode 100644 index 000000000..a430effee --- /dev/null +++ b/features/kaito-manage-test.html @@ -0,0 +1,212 @@ + + + + + + Manage and Test KAITO Deployments - Visual Studio Code AKS Tools + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + +
+ +
+ + + + + + + + +
+
+

Manage and Test KAITO Deployments

+

Actively monitor the the status of all KAITO deployments on the cluster, retrieve logs, test the inference servers, and delete/redeploy models.

+

Manage KAITO Deployments

+

Right click on your desired AKS cluster and select Deploy an LLM with KAITO and then click on Manage KAITO Models.

+

Manage Page

+

Once on this page, you will see all existing KAITO deployments on the cluster, alongside their status (ongoing, successful, or failed).

+

For your selected deployment, click Get Logs to access the latest logs from the KAITO workspace pods. This action will generate a new text file containing the most recent 500 lines of logs.

+

To delete a model, select Delete Workspace (or Cancel for ongoing deployments). For failed deployments, choose Re-deploy Default CRD to remove the current deployment and restart the model deployment process from scratch.

+

Test a Model

+

On your desired model, select Test to access the model testing page.

+

Test Page

+

Once on the testing page, you can modify the parameters and enter a prompt for submsission. Click Reset Params to reset all configurable parameters to their default values. Click Submit Prompt to submit your query.

+

Query Response

+ +
+ + +
+
+ + + +
+ + + + + + + + + + + + + + + + + + +
+ + diff --git a/features/manage-cluster-operations.html b/features/manage-cluster-operations.html index df379e74f..04de06452 100644 --- a/features/manage-cluster-operations.html +++ b/features/manage-cluster-operations.html @@ -81,7 +81,7 @@ diff --git a/features/merge-save-kubeconfig.html b/features/merge-save-kubeconfig.html index 2da870605..b9c962b9c 100644 --- a/features/merge-save-kubeconfig.html +++ b/features/merge-save-kubeconfig.html @@ -81,7 +81,7 @@ diff --git a/features/retina-capture.html b/features/retina-capture.html index 845b4ffcb..214087e6e 100644 --- a/features/retina-capture.html +++ b/features/retina-capture.html @@ -81,7 +81,7 @@ diff --git a/features/run-kubectl-command.html b/features/run-kubectl-command.html index 13420b08b..7fa48c3a7 100644 --- a/features/run-kubectl-command.html +++ b/features/run-kubectl-command.html @@ -81,7 +81,7 @@ diff --git a/features/show-properties-azureportal-start-stop.html b/features/show-properties-azureportal-start-stop.html index 11810d873..baa3f8f34 100644 --- a/features/show-properties-azureportal-start-stop.html +++ b/features/show-properties-azureportal-start-stop.html @@ -81,7 +81,7 @@ diff --git a/features/tcp-dumps.html b/features/tcp-dumps.html index d8d409a69..1d3d1d2c0 100644 --- a/features/tcp-dumps.html +++ b/features/tcp-dumps.html @@ -81,7 +81,7 @@ diff --git a/index.html b/index.html index 19b48a74b..903819508 100644 --- a/index.html +++ b/index.html @@ -81,7 +81,7 @@ @@ -168,7 +168,8 @@

Features

  • Run Image Cleaner Eraser Tool
  • Run Retina Capture
  • Run Automated Deployments Commands
    • -
  • Install & Deploy KAITO Models
    • +
  • Install and Deploy KAITO Models
    • +
  • Manage and Test KAITO Deployments

    • Development and Release

    Development and Release

    Install and deploy KAITO models

    -

    The KAITO integration allows you to

    - +

    Install and Deploy KAITO models

    +

    The KAITO integration enables seamless installation of KAITO onto your clusters, empowering you to deploy AI models, manage workflows, and test deployments with ease and precision.

    Install KAITO

    -

    Right click on your AKS cluster and select Deploy an LLM with KAITO and then click on Install KAITO to open up the KAITO installation page.

    -

    Installation Page

    -

    Once on the page, click Install and the KAITO installation progress will begin. You will be notified when KAITO has been successfully installed.

    +

    Right click on your desired AKS cluster and select Deploy an LLM with KAITO and then click on Install KAITO to open up the KAITO installation page.

    +

    Installation Page

    +

    Once on the page, click Install KAITO and the KAITO installation process will begin. Once KAITO has been successfully installed, you will be prompted with a “Generate Workspace” button that will redirect you to the model deployment page.

    +

    Successfull Installation

    Deploy a model

    -

    Right click on an AKS cluster that has KAITO installed and select Deploy an LLM with KAITO and then click on Create KAITO Workspace to open the KAITO model deployment page.

    +

    Right click on an AKS cluster that has KAITO successfully installed and select Deploy an LLM with KAITO and then click on Create KAITO Workspace to open the KAITO model deployment page.

    Deployment Page

    Once on this page, you can click any of the models to open up the side panel, which will present you with the option to either Deploy Default workspace CRD or Customize Workspace CRD.

    -

    Click Deploy Default workspace CRD to deploy the model. It will track the progress of the model and notify you once the model has been successfully deployed. It will also notify you if the model was already previously unsucessfully onto your cluster.

    +

    Click Deploy Default workspace CRD to deploy the model. It will track the progress of the model and notify you once the model has been successfully deployed. It will also notify you if the model was already previously unsucessfully onto your cluster. Upon successful deployment, you will be prompted with a “View Deployed Models” button that will redirect you to the deployment management page.

    +

    Phi-2 Model Being Deployed +Phi-2 Model Successfully Deployed

    Click Customize Workspace CRD to open up a CRD file pre-populated with the infromation necessary to deploy the model. You can alter this file to your desires and save it locally.

    +

    Manage and Test KAITO Deployments

    +

    Actively monitor the the status of all KAITO deployments on the cluster, retrieve logs, test the inference servers, and delete/redeploy models.

    +

    Manage KAITO Deployments

    +

    Right click on your desired AKS cluster and select Deploy an LLM with KAITO and then click on Manage KAITO Models.

    +

    Manage Page

    +

    Once on this page, you will see all existing KAITO deployments on the cluster, alongside their status (ongoing, successful, or failed).

    +

    For your selected deployment, click Get Logs to access the latest logs from the KAITO workspace pods. This action will generate a new text file containing the most recent 500 lines of logs.

    +

    To delete a model, select Delete Workspace (or Cancel for ongoing deployments). For failed deployments, choose Re-deploy Default CRD to remove the current deployment and restart the model deployment process from scratch.

    +

    Test a Model

    +

    On your desired model, select Test to access the model testing page.

    +

    Test Page

    +

    Once on the testing page, you can modify the parameters and enter a prompt for submsission. Click Reset Params to reset all configurable parameters to their default values. Click Submit Prompt to submit your query.

    +

    Query Response

    Release

    How to Release

    To make a new release and publish it to the marketplace you have to follow the following steps.

    diff --git a/release.html b/release.html index 275780d3e..4ca28c681 100644 --- a/release.html +++ b/release.html @@ -81,7 +81,7 @@ @@ -151,7 +151,7 @@

    Release