Intel and Phison Collaborate to Enhance Local AI Capabilities on PCs
Intel and Phison want to solve local AI’s biggest limitation
Image: Pcworld
Intel and Phison are addressing the limitations of running sophisticated AI models locally on PCs. Their aiDAPTIV solution enables a 26 billion parameter model to operate on laptops with 16GB of RAM, enhancing productivity and allowing larger models to run without monopolizing system resources.
- 01Phison's aiDAPTIV allows a 26 billion parameter AI model to run on laptops with only 16GB of RAM, compared to the usual 32GB requirement.
- 02The solution improves productivity by freeing up system resources for other tasks while running AI.
- 03aiDAPTIV utilizes high-performance NAND flash as an AI cache, intelligently managing data between RAM and SSD.
- 04The collaboration is focused on Intel AI PC platforms powered by Intel Core Ultra processors and supports the OpenVINO toolkit.
- 05A successful implementation may require specific SSDs, such as Phison's Pascari AI100E, which is priced at $2,516 for 1TB.
Advertisement
In-Article Ad
Intel and Phison are tackling a significant challenge in local AI deployment on PCs, where sophisticated models often exceed memory and storage capabilities. Their joint effort introduces Phison's aiDAPTIV solution, allowing a 26 billion parameter AI model to run on laptops with just 16GB of RAM, instead of the typical 32GB. This advancement not only broadens access to local AI on more devices but also enables more powerful laptops to handle larger models or multitask effectively. The aiDAPTIV technology functions by using high-performance NAND flash as an AI cache, which stores tokens for later use, thus optimizing performance without burdening system resources. The collaboration targets Intel's AI PC platforms with Core Ultra processors and aims to demonstrate this technology for software vendors. However, the success of this implementation may hinge on the adoption of specific SSDs, such as Phison's Pascari AI100E, which currently retails for $2,516 for 1TB. This raises questions about consumer demand and the potential for reliance on a single supplier.
Advertisement
In-Article Ad
The collaboration between Intel and Phison could significantly enhance the capability of local AI on consumer laptops, potentially changing how users interact with AI technology.
Advertisement
In-Article Ad
Reader Poll
Would you prefer to run AI models locally on your PC instead of using cloud services?
Connecting to poll...
More about Intel
Read the original article
Visit the source for the complete story.