[Update: Now comes with new models and is also available for Mac.]
Craft is a powerful and visually appealing document application that integrates AI functionalities primarily via ChatGPT. Recently, Craft has introduced an AI-centric update that highlights the capabilities of on-device, offline AI technology…
Included in Craft is an AI assistant designed to streamline document management for users. This assistant is adaptable, offering flexibility to select models from various providers.
Over the weekend, Craft rolled out an experimental feature allowing users to test a local version of DeepSeek’s R1 model as an option for its AI assistant.
At present, Craft utilizes the smallest R1 model, which requires less than 1GB of storage and encompasses 1.5 billion parameters. Usage of this model is entirely optional, with users needing to download it manually to enable it.
Based on preliminary feedback, Craft is preparing for an update that will facilitate the use of the expanded R1 model featuring 7 billion parameters. This model will occupy around 4GB of local storage, significantly improving accuracy.
Both models function entirely offline post-installation; Craft ensures that your data is not transmitted to Chinese servers. These local models remain distinct from the cloud-based options offered by the DeepSeek app and website.
The exploration of a local, offline model has guided Craft into a fascinating avenue. Consequently, Craft will now offer two installable models from Meta: the LLaMa models with 1 billion and 3 billion parameters, requiring less than 700MB and 2GB of storage, respectively.
The Craft AI assistant remains capable of leveraging server-based AI models like ChatGPT. However, these new local, offline models signal a progressive shift toward generative AI functionalities on devices such as iPhones, iPads, and Macs — and even on Apple Vision Pro, where Apple’s own intelligence has yet to appear!
For additional insights on this latest development, refer to Craft’s blog:
By default, the DeepSeek model is not pre-installed in Craft. Should you opt to download and activate R1, your data will reside solely on your device. This feature is ideal for routine tasks that prioritize convenience—like jotting down quick notes, sorting to-do lists, or summarizing brief texts. It also enables basic reasoning abilities without needing an internet connection.
On-device AI models are reminiscent of electric vehicles. They provide immediate acceleration, eliminate the need for frequent charging stations, and are perfect for shorter commutes. For extensive trips across varied landscapes, though, a conventional gas engine may still offer greater reliability. Interestingly, some of the highest-performing vehicles worldwide are hybrids—melding electric motors with gas engines to optimize both performance and efficiency.
We believe AI development follows a similar trajectory. On-device models, like the smaller R1 or Apple Intelligence, excel at handling quick, daily tasks, while more sophisticated, cloud-based models such as ChatGPT are still better suited for heavy-duty processing and complex reasoning. Our goal is to provide both options, allowing users to effortlessly toggle between different “engines” within Craft’s AI Assistant.
Discover more about Craft here.
Essential iPhone Accessories
FTC: We utilize income-generating automated affiliate links. More.
