WebLLM: high-performance in-browser LLM inference engine

 (github.com)

14 points | by saikatsg 1 hour ago

2 comments

  • TekMol 1 minute ago
    This seems to be the demo:

    https://chat.webllm.ai/

    I am getting:

        WebGPUNotAvailableError: WebGPU is not supported in
    your current environment, but it is necessary to
    run the WebLLM engine.
    On both, FireFox and Chromium on Linux.
  • refulgentis 29 minutes ago
    Project is de facto dead, used it for many years and had to rip it out 6 months ago, don't waste your time.
    [-]