README.md

metadata

language:
  - en
  - zh
  - fr
  - es
  - de
  - pt
  - ru
  - it
  - ja
  - ko
  - vi
  - ar
tags:
  - pytorch
  - text-generation
  - causal-lm
  - rwkv
license: apache-2.0
datasets:
  - HuggingFaceFW/fineweb-edu
  - mlfoundations/dclm-baseline-1.0
  - cerebras/SlimPajama-627B
  - EleutherAI/pile
  - bigcode/starcoderdata
  - oscar-corpus/OSCAR-2301

RWKV7-G1 "GooseOne" pure RNN reasoning model

More info & Gradio demo: https://rwkv.com/

For developers: https://github.com/BlinkDL/RWKV-LM

Use rwkv pip package 0.8.28+ for RWKV-7 inference: https://pypi.org/project/rwkv/