WebGPU in Chrome Canary now supports float16 for faster local LLM inference

by NiekvdMaas on 9/5/2023, 4:29:10 AM with 5 comments

  • by no_time on 9/5/2023, 6:55:05 AM

    I hope they gate webGPU behind a per domain allow/deny notification like they do with location and camera access.

    This whole thing is just begging to be exploited by cryptominers.

  • by NiekvdMaas on 9/5/2023, 4:31:58 AM

    To test, run Chrome Canary with:

      --enable-dawn-features=allow_unsafe_apis,disable_robustness
    Then, open: https://webllm.mlc.ai/#chat-demo