Commit Graph

7 Commits (54a0e66ea0ed3248e6c95a070a2da0bf5c6d4817)

Author SHA1 Message Date
Georgi Gerganov 54a0e66ea0
Check for vdotq_s32 availability 2 years ago
Georgi Gerganov 543c57e991
Ammend to previous commit - forgot to update non-QRDMX branch 2 years ago
Georgi Gerganov 113a9e83eb
10% performance boost on ARM 2 years ago
Sebastián A eb062bb012
Windows fixes (#31)
* Apply fixes suggested to build on windows

Issue: https://github.com/ggerganov/llama.cpp/issues/22

* Remove unsupported VLAs

* MSVC: Remove features that are only available on MSVC C++20.

* Fix zero initialization of the other fields.

* Change the use of vector for stack allocations.
2 years ago
Georgi Gerganov f1eaff4721 Add AVX2 support for x86 architectures thanks to @Const-me ! 2 years ago
Georgi Gerganov 007a8f6f45
Support all LLaMA models + change Q4_0 quantization storage 2 years ago
Georgi Gerganov 26c0846629
Initial release 2 years ago