AI ENGINEERING
RAG Engineering / 09Evaluate Retrieval and Gate Regressions
Separate retrieval coverage, context quality, and answer support. Calculate ranking metrics and design reproducible regression gates.
Tag / 6 articles
#llmops
Blog posts tagged with llmops
AI ENGINEERING
RAG in 2026: From Vector Search Demo to Reliable Evidence System
A system-level guide to the twelve classic RAG failure modes, the techniques now used to address them, and the limits that still remain.
LARGE LANGUAGE MODELS
vllm throughput
vLLM pre-allocates a block of GPU memory for KV-cache based on the --gpu_memory_utilization parameter. By increasing this parameter, you free up more contiguous space for KV...
LARGE LANGUAGE MODELS
Ollama Import GGUF Models
If you're looking to experiment with various models easily, importing GGUF might be your go-to method. Here's how it works:
LARGE LANGUAGE MODELS
Local LLM Setup
This guide will walk you through setting up a local language model (LLM) using Ollama. Ollama is an open-source, lightweight language model that can be run locally on your machine...
AI ENGINEERING
Gradio with Ollama
Notes on processing unstructured PDF content and a demo architecture connecting a Gradio interface to models served by Ollama.