BrikoX@lemmy.zipM to Technology@lemmy.zipEnglish · 6 days agoResearchers upend AI status quo by eliminating matrix multiplication in LLMsarstechnica.comexternal-linkmessage-square8fedilinkarrow-up147arrow-down11file-textcross-posted to: [email protected][email protected][email protected]
arrow-up146arrow-down1external-linkResearchers upend AI status quo by eliminating matrix multiplication in LLMsarstechnica.comBrikoX@lemmy.zipM to Technology@lemmy.zipEnglish · 6 days agomessage-square8fedilinkfile-textcross-posted to: [email protected][email protected][email protected]
minus-squarePennomi@lemmy.worldlinkfedilinkEnglisharrow-up2·6 days agoOnly for maximum efficiency. LLMs already run tolerably well on normal CPUs and this technique would make it much more efficient there as well.
Only for maximum efficiency. LLMs already run tolerably well on normal CPUs and this technique would make it much more efficient there as well.