Home
>
AI Assistant
>
KoboldCPP

KoboldCPP

GitHub - LostRuins/koboldcpp: A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
Introduction:
A simple one-file way to run various GGML and GGUF models with KoboldAI's UI - LostRuins/koboldcpp
KoboldCPP Product Information

What is KoboldCPP ?

KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models. It's a single self contained distributable from Concedo, that builds off llama.cpp, and adds a versatile Kobold API endpoint, additional format support, Stable Diffusion image generation, backward compatibility, as well as a fancy UI with persistent stories, editing tools, save formats, memory, world info, author's note, characters, scenarios and everything Kobold and Kobold Lite have to offer.

KoboldCPP's Core Features

Easy-to-use AI text-generation software

Supports GGML and GGUF models

Single self-contained distributable

Builds off llama.cpp

Versatile Kobold API endpoint

Additional format support

Stable Diffusion image generation

Backward compatibility

Fancy UI with persistent stories, editing tools, save formats, memory, world info, author's note, characters, scenarios

FAQ from KoboldCPP