Various RWKV related links
The following are various other RWKV links to community project, for specific use cases and/or references.
Official RWKV links
- Main RWKV project : https://github.com/BlinkDL/RWKV-LM
- Hugging face doc : https://huggingface.co/docs/transformers/model_doc/rwkv
- RWKV paper : https://arxiv.org/abs/2305.13048
Model links
- https://huggingface.co/BlinkDL/rwkv-4-raven
- https://huggingface.co/BlinkDL/rwkv-4-world
- https://huggingface.co/BlinkDL/rwkv-4-pileplus
Trainer projects
Main cpp / cpp cuda project
- https://github.com/harrisonvanderbyl/rwkv-cpp-cuda
- https://github.com/saharNooby/rwkv.cpp
- https://github.com/RWKV/RWKV-cpp-node
- https://github.com/RWKV/rwkv-onnx
Chat bots / demos
- RWKV runner : https://github.com/josStorer/RWKV-Runner
- AI00 RWKV server : https://github.com/cgisky1980/ai00_rwkv_server
- Chatbot demo : https://github.com/harrisonvanderbyl/rwkv_chatbot
- Hugging face UI : https://huggingface.co/spaces/Hazzzardous/RWKV-Instruct
- (thai) chatbot : https://github.com/telexyz/symato
- gradio example : https://github.com/gururise/rwkv_gradio
- web chat UI : https://github.com/hizkifw/WebChatRWKVstic
- QQ chatbot : https://github.com/cryscan/eloise
- Another web UI : https://github.com/oobabooga/text-generation-webui
- QQ bot / webapi : https://github.com/TkskKurumi/rwkv_webapi
- Web inference : https://github.com/timestretch/rwkv-web-inference
- (chinese) role play chatbot : https://github.com/shengxia/RWKV_Role_Playing
- (chinese) web UI : https://github.com/wenda-LLM/wenda
- RWKV web : https://github.com/iacore/rwkv-web
- ESpirit university chatbot : https://github.com/karim-aloulou/Espitchatbot-RASA-RAVEN
- Shady.ai : https://github.com/BrutalCoding/shady.ai
RWKV servers
- https://github.com/go-skynet/LocalAI
- https://github.com/ZeldaHuang/rwkv-cpp-server
- https://github.com/Atome-FE/llama-node
- https://github.com/cgisky1980/ai00_rwkv_server
Android port
Python libraries
RWKV in the browser
GO lang rewrites
Onnx implementations
GGML implmentation
JAX implementations
Rust rewrites
- https://github.com/mrsteyk/rwkvk-rs
- https://github.com/KerfuffleV2/smolrsrwkv
- https://github.com/cryscan/web-rwkv
Tiny grad rewrites
VSCode integration
Other rwkv.cpp implmentation
WebGPU implementation
ALEXA integration
Tensorflow integration
PaddlePaddle integration
Pico implementation
RWKV music ??
- playing the paino : https://huggingface.co/brianflakes/rwkv-midi-piano/tree/main
Distributed inference
Finetuning / Training forks
- Another LoRa / Finetuning fork : https://github.com/m8than/RWKV-LM-LoRA
- DeepSpeed Stage 3 : https://github.com/mrsteyk/RWKV-LM-deepspeed
- LoRa : https://github.com/Blealtan/RWKV-LM-LoRA
- Finetuning : https://github.com/Durham/RWKV-finetune-script
- 4bit finetuning : https://blog.kinglycrow.com/rwkv-qlora-4bit/
Prompt / Notebook collections
- Various notebooks : https://github.com/resloved/RWKV-notebooks
- Chatbot notebook : https://colab.research.google.com/github/harrisonvanderbyl/rwkvstic/blob/master/notebooks/chatbot.ipynb
- Interprability research : https://github.com/UnstoppableCurry/RWKV-LM-Interpretability-Research
- Langchain prompts : https://github.com/jiamingkong/RWKV_chains
Spike GPT
- AI Model inspired by RWKV : https://github.com/ridgerchu/SpikeGPT
Educational (RWKV < X lines)
RWKV paper : https://arxiv.org/abs/2305.13048
Yannic Kilcher break the paper down step by step on youtube : https://www.youtube.com/watch?v=x8pW19wKfXQ&pp=ygUEUldLVg%3D%3D
150 lines explained
RWKV deconstructed : https://github.com/cwhy/rwkv-decon
RWKV math breakdown : https://ben.bolte.cc/rwkv
RWKV model math: https://ben.bolte.cc/rwkv-model
RWKV explained: https://fullstackdeeplearning.com/blog/posts/rwkv-explainer/
How RWKV works: https://johanwind.github.io/2023/03/23/rwkv_details.html
RWKV training cost estimate (outdated): https://johanwind.github.io/2023/03/23/rwkv_overview.html
Tooling
- JSONL to binidx : https://github.com/Abel2076/json2binidx_tool