#rwkv7 — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #rwkv7, aggregated by home.social.
-
Thing I've been experimenting with the past few days -- "diegetic role based prompting" for a local State Space Model ( #RWKV7 currently).
Tiny llama.cpp Python runner for the model and "composer" GUI for stepping and half-stepping through input only or input and generated role specified output, with saving and restoring of KV checkpoints.
Planning to write runners for #XLSTM 7B & #Falcon #MAMBA 7B to compare.
Started 'cause no actual #SSM saving, resuming examples.