iam-veeramalla

Run LLMs Locally Using llama.cpp

This tutorial shows how to run Large Language Models locally on your laptop using llama.cpp and GGUF models.

It works on:

• macOS
• Linux
• Windows

iam-veeramalla

VIND Tutorial

Prerequisites

• Docker
• Kubectl
• Login to ghcr.io (docker login ghcr.io) - create and github token as password/

Install VCluster CLI

iam-veeramalla

Run Claude with the power of Local LLMs using Ollama

Install Ollama

curl -fsSL https://ollama.com/install.sh | sh

Pull the Model

ollama pull glm-4.7-flash # or gpt-oss:20b (for better performance)

iam-veeramalla

OpenClaw configuration with Ollama

Install OpenClaw

curl -fsSL https://openclaw.ai/install.sh | bash

Install Ollama

curl -fsSL https://ollama.com/install.sh | sh

iam-veeramalla

Forward Proxy vs Reverse Proxy

In this tutorial, You will learn:

• Forward Proxy using Tinyproxy (simple, lightweight).
• Reverse Proxy using NGINX with two Python backends.

---

0 — Prepare the Instance

iam-veeramalla

Installation of Kubeflow Pipelines

The best guide to install Kubeflow or any of its components is the official documentation.

https://www.kubeflow.org/docs/started/

In this tutorial, we will learn how to Install, Configure and Use the most popular component of Kubeflow that is KFP (Kubeflow Pipelines).

Step 1: Install Docker Desktop

iam-veeramalla

Headless Kubernetes Service

Service

apiVersion: v1
kind: Service
metadata:
  name: my-db-headless-service
spec:

iam-veeramalla

import redis
import time
import random
import string
import statistics

# Redis connection details
REDIS_HOST = "redisval-bu8xv7.serverless.use1.cache.amazonaws.com"
REDIS_PORT = 6379  # TLS port (verify if TLS supported on this port!)
REDIS_PASSWORD = None

iam-veeramalla

#!/bin/bash

# Variables
JENKINS_HOME="/var/lib/jenkins"  # Replace with your Jenkins home directory
S3_BUCKET="s3://your-s3-bucket-name"  # Replace with your S3 bucket name
DATE=$(date +%Y-%m-%d)  # Today's date

# Check if AWS CLI is installed
if ! command -v aws &> /dev/null; then
    echo "AWS CLI is not installed. Please install it to proceed."

iam-veeramalla

# Create EKS Cluster

eksctl create cluster --name=observability \
                      --region=us-east-1 \
                      --zones=us-east-1a,us-east-1b \
                      --without-nodegroup
                  
eksctl utils associate-iam-oidc-provider \
    --region us-east-1 \
    --cluster observability \