AIKit - My open source Xojo module for interfacing with LLMs

General
13

Version 1.2.0

Another update for AIKit. Thanks to all here who have made suggestions.

New

  • Added supported for Google Gemini LLMs (text and image input).

Due to limitations with the Gemini API, asynchronous responses will not appear in chunks of tokens as they do with other providers. This is due to the internal use of the URLConnection.ContentReceived() event for better stability. I am working on a solution to this.

Improvements

  • The Ollama provider returns a subclass of ModelDescription containing additional information about models (such as parameter size).

Fixed

  • Chat history is preserved when switching between providers in the demo.

Notes

It’s been pointed out on another thread that doing processing in the URLConnection.ReceivingProgressed() event is re-entrant and could be buggy. I will look at refactoring this for existing providers in a subsequent update. So far it’s been fine for me (tested only on macOS however).

1 Like