Testing the Raspberry Pi AI HAT+ 2
Leave Your AI HAT On
© Lead Image © lightwise, 123RF.com
Chatbots are all the rage. A new AI HAT+ 2 for the Raspberry Pi 5 lets you run large language models.
Artificial intelligence (AI) assistants can be used in many areas of daily life and claim to make our workdays easier by handling routine tasks on their own. Of course, commercial AI assistants usually run in the cloud with fees attached for professional use. On top of this, data privacy is often sadly neglected.
Instead an online service, you can use an AI language model that runs on your local infrastructure and does not require cloud access. That approach has a downside: The models often require serious compute power of the kind that only outrageously expensive graphics cards or specialized high-performance processors designed for AI applications can provide. While conventional PCs can run chatbots and minor, application-specific language models, they often fail to achieve satisfactory speeds. In many cases, use is very limited.
AI on the Pi
While earlier Raspberry Pi models were not powerful enough, the Pi 5 finally has the hardware capabilities that you need to run more complex AI language models at a good speed. The RAM and interface limitations found in the older versions of the British microcomputer have now been eliminated. Armed with 8GB RAM and the long-awaited PCIe interface, the single-board computer is up to more demanding AI tasks.
[...]
Buy this article as PDF
(incl. VAT)
Buy Linux Magazine
Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters
Support Our Work
Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.
News
-
New KORA Linux Distro to Harness the Power of Local AI
The development team behind CyanogenMod, Android, and Playtron unveils KORA, a Linux distribution built specifically for AI nerds.
-
Epic Games Targets Linux for New Launcher
The Epic Games new launcher is still in preview, but it looks to land on several Linux distributions.
-
Fedora 45 Now Available
The latest iteration of Fedora has arrived with Gnome 51 and KDE Plasma 6.8.
-
Linux 7.4 is "Much Healthier" Thanks to AI
At nearly 42 million lines, Linux 7.4 is the largest merge in the kernel’s history.
-
Working Exploit for a Linux Kernel Flaw Made Public
Even before a bug received its CVE identifier or an upstream fix, the local privilege escalation vulnerability exploit found its way into the wild.
-
r/opensource Bans AI-Assisted and AI-Related Projects
The de facto subreddit for all things open source has not only banned AI-related projects but also users who "don't speak English."
-
Bottlenecks Discovered by Meta Engineers Lead to Scalability Improvements
Thanks to a small group of engineers at Meta, the Linux kernel module kernfs has been improved, which has led to some serious gains.
-
PwnEscape Poses VM Vulnerability
A guest-to-host escape flaw in Linux KVM, named PwnEscape, might be yet another means of attacking Linux.
-
Linux Mint 27 Set for a Christmas Release
The developers behind Linux Mint have announced a Christmas release, and it looks like Santa's sack will be brimming with features.
-
Is Linus Torvalds Vibe Coding?
The creator of Linux has added AI into his process for Linux kernel development, and it's more than just for debugging.