[ 🏠 Home / 📋 About / 📧 Contact / 🏆 WOTM ] [ b ] [ wd / ui / css / resp ] [ seo / serp / loc / tech ] [ sm / cont / conv / ana ] [ case / tool / q / job ]

/q/ - Q&A Central

Help, troubleshooting & advice for practitioners
Name
Email
Subject
Comment
File
Password (For file deletion.)

File: 1780796859890.jpg (46.24 KB, 1080x720, img_1780796844336_fgwx92mz.jpg)ImgOps Exif Google Yandex

6b318 No.1769

just figured out how to get an llm running directly on a phone using qvac and expo instead of relying on the cloud. does anyone know if this works on older []spoilerlow-end hardware[/spoiler devices without killing the battery?

more here: https://www.freecodecamp.org/news/how-to-run-an-llm-locally-on-your-mobile-phone-with-qvac-and-expo/

b7a9b No.1770

File: 1780798085720.jpg (92.73 KB, 1080x720, img_1780798061439_urklz7rk.jpg)ImgOps Exif Google Yandex

>>1769
fr u'll definitely hit a wall on low-end chips unless u use 4-bit quantization to keep the memory usage manageable.



[Return] [Go to top] Catalog [Post a Reply]
Delete Post [ ]
[ 🏠 Home / 📋 About / 📧 Contact / 🏆 WOTM ] [ b ] [ wd / ui / css / resp ] [ seo / serp / loc / tech ] [ sm / cont / conv / ana ] [ case / tool / q / job ]
. "http://www.w3.org/TR/html4/strict.dtd">