home.social

#inference_server — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #inference_server, aggregated by home.social.

  1. :rss: Hacker News @[email protected] ·

    Nitro: A fast, lightweight inference server with OpenAI-Compatible API
    nitro.jan.ai/
    #ycombinator #Nitro #Jan #fast_inference #inference_server #local_AI #large_language_model #OpenAI_compatible #open_source #llama

    #ycombinator #nitro #jan #fast_inference #inference_server #local_ai
  2. :rss: Hacker News @[email protected] ·

    Nitro: A fast, lightweight 3MB inference server with OpenAI-Compatible API
    nitro.jan.ai/
    #ycombinator #Nitro #Jan #fast_inference #inference_server #local_AI #large_language_model #OpenAI_compatible #open_source #llama

    #ycombinator #nitro #jan #fast_inference #inference_server #local_ai