Main Github
Hugging Face Integration
Community Discord
Main Github
Hugging Face Integration
Community Discord
  • RWKV Language Model
  • Getting Started
    • How to Experience RWKV
    • RWKV Decoding Parameters
    • Integrate with your application
    • Frequently Asked Questions
  • RWKV Prompting
    • Prompting Format Guidelines
    • Chat Prompt Examples
    • Completion Prompt Examples
  • Advanced
    • Fine-tuning
    • Preparing The Training Datasets
    • RWKV Training Environment
    • RWKV Architecture History
    • RWKV pip Usage Guide
  • Inference Tutorials
    • llama.cpp Inference
    • Ollama Inference
    • Silly Tavern Inference
    • Text Generation WebUI Inference
    • KoboldCpp Inference
    • Ai00 Inference
  • Fine Tune Tutorials
    • State Tuning Tutorial
    • LoRA Fine-Tuning Tutorial
    • PiSSA Fine-Tuning Tutorial
    • DiSHA Fine-Tuning Tutorial
    • FAQ about Fine-Tuning
  • Community
    • Code Of Conduct
    • Contributing to RWKV
    • Various RWKV related links

Integrate with your application

If you would like to integrate RWKV into your existing application. You can use the following

Official python bindings

  • RWKV
  • rwkvstic

Running via hugging face

  • Hugging face docs
  • Hugging face blog on RWKV

RWKV.cpp / RWKV.cpp cuda project

These are cpp based libraries, which can be built, and integrated into your application as a C style library

  • RWKV.cpp
  • RWKV-cpp-cuda

X language bindings

The .cpp / cpp-cuda libraries has the following project wrappers for other languages

  • Javascript : rwkv-cpp-node
  • GoDot : godot-rwkv
  • Golang : go-rwkv

Deploy as an API

If you wish to deploy RWKV as an API, you can use the following projects

  • LocalAI : OpenAI style API
  • Flask based API
Edit this page
Last Updated:
Contributors: luoqiqi, manjuan
Prev
RWKV Decoding Parameters
Next
Frequently Asked Questions