home.social

#rwkvstic — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #rwkvstic, aggregated by home.social.

  1. CW: language model, food, being silly with rwkv-4-pile-3b-instruct-test2-20230209 on a cpu
    > Q: what is a good recipe for bbq ribs?
    >
    > A: 1. Make the garlic herb rub.
    > 2. Preheat oven to 200°F (93°C).
    > 3. Soak the ribs in water for 1 hour.
    > 4. Soak in 5% salt for 1 hour.
    > 5. Rinse ribs, pat dry, and rub with olive oil.
    > 6. Season the ribs with salt and pepper.
    > 7. Place the ribs on a wire rack and roast for 45 minutes.

    5/7, had my oven at 93C for two hours while the ribs were soaking in water and... saline? :blobfoxbreadsnootgoogly:

    interestingly, #rwkvstic does not get any faster if i torch.set_num_threads(8) and torsh.set_num_interop_threads(8) compared to single-threaded, but uses a whole lot more cpu. but with bfloat16 instead of float32 it doesn't even use more cpu!

    #rwkv #pytorch #llm