Hey HN! I'm Gaurav, an AI Engineer from Toronto. I graduated from UofT (Comp Eng) 3 years ago and have been a long time Hacker News lurker. This is my first post :)
My project is called "Glaux" (after the owl of Minerva). It's a Next JS application that (tries it's best) to download, validate, and inference HuggingFace ONNX Community models utilizing Browser Storage/WebGPU via ONNX web runtime and Transformers.js
The project started when me and my friends wanted to build our own AI workstation to experiment in the field of ML systems engineering. Unfortunately, we didn't realize how expensive and complicated it is to set that kind of rig up for a frontier OSS model. However, that made me wonder what I could run on my personal laptop, which led me to discover a whole plethora of browser ML system libraries/technology such as ONNX, Transformers.js, WebGPU, etc.
Since then, I've spent about a month hacking (prompting) away at Glaux and I'm pretty proud of the build so far. The design philosophy is relatively simple: No accounts, analytics, external inference servers, and best effort transparency. But the implementation was a lot tricker than I thought.
The GitHub contains more context on the technical specs, including architecture diagrams, technical limitations, and a more in depth explanation of some of the implementation details. I'd really appreciate and am very open to hearing your thoughts and technical feedback!
Thanks! I've got a lot of different feedback from different people. My boss said they'd find it useful when they're offline camping haha. Another one of my friends thought it'd be a cool "incognito" chat interface.
Personally, I see it as an educational tool for ML systems, I'd love for people to try and build features that get it closer in parity to Big AI applications.
Hey HN! I'm Gaurav, an AI Engineer from Toronto. I graduated from UofT (Comp Eng) 3 years ago and have been a long time Hacker News lurker. This is my first post :)
Here's a quick demo of Glaux on YT: https://youtu.be/Uf8GytVp5sw?si=yebS0mmSUjt0EuO7
My project is called "Glaux" (after the owl of Minerva). It's a Next JS application that (tries it's best) to download, validate, and inference HuggingFace ONNX Community models utilizing Browser Storage/WebGPU via ONNX web runtime and Transformers.js
The project started when me and my friends wanted to build our own AI workstation to experiment in the field of ML systems engineering. Unfortunately, we didn't realize how expensive and complicated it is to set that kind of rig up for a frontier OSS model. However, that made me wonder what I could run on my personal laptop, which led me to discover a whole plethora of browser ML system libraries/technology such as ONNX, Transformers.js, WebGPU, etc.
Since then, I've spent about a month hacking (prompting) away at Glaux and I'm pretty proud of the build so far. The design philosophy is relatively simple: No accounts, analytics, external inference servers, and best effort transparency. But the implementation was a lot tricker than I thought.
You can check out the GitHub here: https://github.com/rangan39/glaux
The GitHub contains more context on the technical specs, including architecture diagrams, technical limitations, and a more in depth explanation of some of the implementation details. I'd really appreciate and am very open to hearing your thoughts and technical feedback!
- GR
This is so cool and congrats on the first post!
Looks really impressive. What would you like to see people build with this?
Thanks! I've got a lot of different feedback from different people. My boss said they'd find it useful when they're offline camping haha. Another one of my friends thought it'd be a cool "incognito" chat interface.
Personally, I see it as an educational tool for ML systems, I'd love for people to try and build features that get it closer in parity to Big AI applications.
Glaux, love the name!
Gaurav it’s great to see you posting here - sweet tool.
Modeling running from browser is awesome.
Thanks man, took a couple iterations haha. It used to be called Sophon, there might still be some remanent css names in the source code LOL