I built webgpu-inference, a small experimental ML inference runtime for Android using Kotlin and AndroidX WebGPU.

I also wrote a walkthrough of how it works, from model conversion to GPU execution.

  • Github: https://github.com/l2hyunwoo/webgpu-inference
  • Medium: https://medium.com/@l2hyunwoo/build-own-ml-inference-runtime-with-androidx-webgpu-e90131007d71

I’d love to hear your feedback on the project or the article!

submitted by /u/Junior_Android_
[link] [comments]