MicroLLM Lab runs seven tiny language models entirely in your browser
MicroLLM Lab – Try 7 tiny LLM's in the browser
MicroLLM Lab lets you run, benchmark, and compare seven small language models — from a 26M MiniMind2 up to a 362M SmolLM2 — directly in the browser via WebGPU, with Q4 quantization shrinking them to 15–216 MB. Everything stays on-device through IndexedDB caching, with no servers or accounts. The lab also generates shareable benchmark certificates and supports custom JavaScript evals.
A 135M model is allowed to fail — that is the measurement.
- demibabs
Cool project, but I'd really suggest looking at the UI.
The text is too small and it's way too dense with information in general. Considering how simple this product is to use, it's kinda crazy that I have to scroll through over a page length of (mostly useless, AI-generated) information before getting to the actual interface.
Also what is going on with the footer (why does it link back to the site itself, why is it telling me to "serve over HTTP").
- langurmonkey
It's not loading for me on Firefox (v156.0.1, Arch Linux), works fine on Chromium.
Uncaught ReferenceError: GPUShaderStage is not defined
<anonymous> https://stateofutopia.com/experiments/microllmlab/engine/web...
webgpu-metal.js:24:17
<anonymous> https://stateofutopia.com/experiments/microllmlab/engine/web...
[MicroLLM lab] App loader failsafe triggered after 6s microllmlab:55:21
- mgaunard
> how would you compare your capabilities to that of claude fable 5.1 by anthropic
> Comparing your capabilities to that of claude fable 5.1 would be very similar. Both are stories about a clown who is a cunning and manipulative animal. They both have problems and challenges, and they face challenges to overcome them. However, they have different goals and approaches. The clown
I think that tells you all you need to know.
- tolugenius
I did the default arithmetic with PetitGPT research-v1
>What is 2+2?
Answer
> To find 2 + 2, we need to add 2 to both sides of the equation.
> 2 + 2 = 4
> So, 2 + 2 = 4 + 2.
Brilliant
- beschizza
Smol was the only one to answer a basic question about javascript correctly, but I loved this answer from L20 Edu:
Prompt: I'm writing a vanilla javascript and HTML text adventure game. The player will use the keyboard to switch between screens or to choose storylet options in the main screen. Game is turn-based. What is the the best method in javascript to detect keypresses?"
Answer: I'm a good player. Anyway, I'm a good player. Anyway, I'm a good player. Anyway, I'm a good player. Anyway, I'm a good player. Anyway, I'm a good player. Anyway, I'm a good player. Anyway, I'm a good player. Anyway,
- botanrice
Can someone help me understand whether these models are supposed to be good enough to be useful? I am asking these for a breakfast recipe and most of them are repeating text and giving me strange combinations of like chicken & parmesan or milk and like 8 cups of cheese. I really would love to use MicroLLMs and have been eagerly awaiting the day they could be useful, or at least run local LLMs for that matter, but these don't seem useful.
They don't even consistently pass the benchmarks included in the site, so what are they good for?
Edit: or is the purpose to just showcase that these small LLMs can run on WebGPU?
- atobe
Similar, simpler: https://tiny.tobelabs.com/
Small LM trained on Tiny Stories. My first goal was to get people to see tokens from the model ASAP, the second was to demo Tiny Stories for those who may be unfamiliar. Oh and play with ternary models. https://arxiv.org/abs/2305.07759
There's larger QA model on the same page too.
- touchme
> Is a cat an animal? Answer yes or no.
>> Cats are not animals. Cats are warm-blooded animals that have a backbone and a heart. They are not mammals.
Good job PetitGPT research-v1.