Vanessa - Personal, Portable, Offline LLM on your device.

With the rise of LLM's like ChatGPT, the demand for AI models has been higher than ever, becoming a part of our daily lives. Vanessa allows you to run LLM(s) right on your cpu and gpu utilizing Llama.cpp and Metal to help it run. Vanessa ensures complete privacy by always running the model offline and deleting your previous chat logs on the apps next launch.

Although the app is already released on the app store, joining the TestFlight group is appreciated and will help me improve future versions as beta future versions will be released there.

All feedback, whether good or bad, is appreciated!

Sadly, due to the memory requirements of LLMs, the following devices will not be able to run the LLMs through the app but is not limited to:

Unsupported iPhone Models

  • iPhone4
  • iPhone5
  • iPhone6
  • iPhone7
  • iPhone8
  • iPhoneX
  • iPhoneSE2
  • iPhoneSE

Unsupported iPad Models

  • iPad2

  • iPad3

  • iPad4

  • iPad5

  • iPad6

  • iPad7

  • iPad8

  • iPad9

  • iPadMini

  • iPadMini2

  • iPadMini3

  • iPadMini4

  • iPadMini5

  • iPadAir

  • iPadAir2

  • iPadAir3

  • iPadPro9Inch