Craft is an innovative and aesthetically pleasing document application that incorporates AI capabilities chiefly through ChatGPT. Recently, Craft has released an AI-centric update that demonstrates the capabilities of on-device, offline AI…
Craft features an AI assistant designed to simplify document management for users. This assistant is versatile, allowing users to select between models from various providers.
Over the past weekend, Craft introduced an experimental option allowing users to test a local version of DeepSeek’s R1 model with the Craft AI assistant.
Currently, Craft operates using the smallest R1 model, which occupies under 1GB of storage and comprises 1.5 billion parameters. Utilizing this model is entirely optional, requiring users to download it manually to access its features.
With initial feedback in mind, Craft is gearing up to launch an update that will enable users to leverage the more advanced R1 model, boasting 7 billion parameters. This model necessitates approximately 4GB of local storage but significantly enhances accuracy.
Both models function entirely offline once installed, ensuring that Craft does not transmit your data to Chinese servers. These local solutions are distinctly separate from the cloud-based models utilized by the DeepSeek app and website.
The exploration of a local, offline AI model has inspired Craft to take an intriguing new direction. Consequently, Craft will also offer two installable models from Meta: LLaMa models with 1 billion and 3 billion parameters, consuming under 700MB and 2GB of storage each.
The Craft AI assistant remains capable of utilizing server-connected AI models such as ChatGPT. Nevertheless, these new local, offline models suggest an exciting future for generative AI operating on our iPhones, iPads, and Macs — including Apple Vision Pro, which currently lacks Apple Intelligence!
For further details on this latest development, check out Craft’s blog post:
By default, the DeepSeek model is not pre-installed in Craft. Should you opt to download and activate R1, your data will remain on your device. This is ideal for routine activities where convenience is key, such as jotting down quick notes, organizing tasks, or summarizing brief text segments. It also enables basic reasoning capabilities without needing an internet connection.
On-device AI models function somewhat like electric vehicles. They deliver immediate performance, avoid frequent refueling, and are particularly well-suited for shorter tasks. However, for longer, more complex endeavors, a conventional gas-powered engine might still be more dependable. Notably, many high-performance vehicles today are hybrids, combining electric motors and gasoline engines to optimize both efficiency and power.
We believe the future of AI will resemble this model. On-device systems like the smaller R1 or Apple Intelligence can manage quick, day-to-day tasks, while advanced, cloud-powered systems like ChatGPT excel in more demanding, intricate tasks. Our goal is to provide both options, allowing users to effortlessly switch between these “engines” within Craft’s AI Assistant.
Discover more about Craft here.
Recommended iPhone Accessories
FTC: We utilize income-generating auto affiliate links. More.
