Simple GTK3 LLM chat application written using .NET powered by Phi-3-mini.
Uses:
- .NET 9
- GTK# for Linux and Windows (bundles GTK# Runtime for Windows)
- ONNX Runtime GenAI
Supports:
- Windows and Linux on x64
- Windows on Arm only functions via emulation due to a limitation in GTK#
- Linux on Arm requires building QNNX dependencies from source
huggingface-cli download microsoft/Phi-3-mini-4k-instruct-onnx --include cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/* --local-dir Phi-3-mini-4k-instruct-onnx
dotnet restore
dotnet build
dotnet run