I’m a big believer in “Local AI”, i.e. running an AI model embedded on your phone or other device, instead of accessing it through the cloud.
Why?
<ul>
<li>🔌 Availability: Works offline, not dependent on internet connectivity.</li>
<li>🔒 Privacy: sensitive data never leaves your device.</li>
<li>⚡️ “Speed”: less latency by processing data directly on the device, BUT a smaller device is also slower at loading and running a large language model.</li>
<li>☘️ Environment: less power usage, less CO₂.</li>
</ul>
As an example, compare:
<ul>
<li>Humane AI Pin (cloud): <a href="https://www.youtube.com/watch?v=_w1vv7_dU2Y">https://www.youtube.com/watch?v=_w1vv7_dU2Y</a></li>
<li>Rabbit R1 (local): <a href="https://www.youtube.com/watch?v=aqb3u5mXcl4">https://www.youtube.com/watch?v=aqb3u5mXcl4</a></li>
</ul>
<a href="https://www.theverge.com/2023/9/6/23861763/apple-ai-language-models-ajax-gpt-training-spending">Apple is working on their “Ajax” model</a> and <a href="https://www.xda-developers.com/openai-make-own-ai-hardware">OpenAI are working on their own hardware</a>. Exciting times ahead!
If you want to try a Local AI on iPhone, try <a href="https://apps.apple.com/app/id6448106860">Private LLM</a>.

I’m a big believer in “Local AI”, i.e. running an AI model embedded on your phone or other device, instead of accessing it through the cloud.