Testing the Raspberry Pi AI HAT+ 2
Leave Your AI HAT On
© Lead Image © lightwise, 123RF.com
Chatbots are all the rage. A new AI HAT+ 2 for the Raspberry Pi 5 lets you run large language models.
Artificial intelligence (AI) assistants can be used in many areas of daily life and claim to make our workdays easier by handling routine tasks on their own. Of course, commercial AI assistants usually run in the cloud with fees attached for professional use. On top of this, data privacy is often sadly neglected.
Instead an online service, you can use an AI language model that runs on your local infrastructure and does not require cloud access. That approach has a downside: The models often require serious compute power of the kind that only outrageously expensive graphics cards or specialized high-performance processors designed for AI applications can provide. While conventional PCs can run chatbots and minor, application-specific language models, they often fail to achieve satisfactory speeds. In many cases, use is very limited.
AI on the Pi
While earlier Raspberry Pi models were not powerful enough, the Pi 5 finally has the hardware capabilities that you need to run more complex AI language models at a good speed. The RAM and interface limitations found in the older versions of the British microcomputer have now been eliminated. Armed with 8GB RAM and the long-awaited PCIe interface, the single-board computer is up to more demanding AI tasks.
[...]
Buy this article as PDF
(incl. VAT)
Buy Linux Magazine
Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters
Support Our Work
Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.
News
-
Bottlenecks Discovered by Meta Engineers Lead to Scalability Improvements
Thanks to a small group of engineers at Meta, the Linux kernel module kernfs has been improved, which has led to some serious gains.
-
PwnEscape Poses VM Vulnerability
A guest-to-host escape flaw in Linux KVM, named PwnEscape, might be yet another means of attacking Linux.
-
Linux Mint 27 Set for a Christmas Release
The developers behind Linux Mint have announced a Christmas release, and it looks like Santa's sack will be brimming with features.
-
Is Linus Torvalds Vibe Coding?
The creator of Linux has added AI into his process for Linux kernel development, and it's more than just for debugging.
-
openKylin 3.0 Released with Expanded AI Integration
The latest release features a pre-installed AI agent to help perform tasks.
-
DigitalOcean Ends Open Source Credits Program
In a change that has surprised many open source developers, DigitalOcean has decided to sunset its Open Source Credits Program.
-
Office 365 Available for Testing on Linux via Bottles
Linux users can now test the official Office 365, thanks to Mirko Brombin's work on Bottles.
-
Dutch Government Turns to Open Source for Digital Sovereignty
Following in the footsteps of other European countries, the Netherlands is looking to increase its sovereign digital infrastructure with open source software.
-
Linux May Soon Work on Snapdragon X2-Based PCs
If you're thinking about buying a Snapdragon X2-based desktop or laptop, Linux may soon be an option.
-
KDE for People Initiative Calls for AI Ban in Plasma
A new community of KDE wants the project to adopt a strict no-AI policy for KDE Plasma.