Thomas Klausner
41be0a3b3d
Add NetBSD support. ( #90 )
2 years ago
Georgi Gerganov
84d9015c4a
Use vdotq_s32 to improve performance ( #67 )
...
* 10% performance boost on ARM
* Back to original change
2 years ago
Georgi Gerganov
c80e2a8f2a
Revert "10% performance boost on ARM"
...
This reverts commit 113a9e83eb
.
There are some reports for illegal instruction.
Moved this stuff to vdotq_s32 branch until resolve
2 years ago
Georgi Gerganov
54a0e66ea0
Check for vdotq_s32 availability
2 years ago
Georgi Gerganov
543c57e991
Ammend to previous commit - forgot to update non-QRDMX branch
2 years ago
Georgi Gerganov
113a9e83eb
10% performance boost on ARM
2 years ago
Sebastián A
eb062bb012
Windows fixes ( #31 )
...
* Apply fixes suggested to build on windows
Issue: https://github.com/ggerganov/llama.cpp/issues/22
* Remove unsupported VLAs
* MSVC: Remove features that are only available on MSVC C++20.
* Fix zero initialization of the other fields.
* Change the use of vector for stack allocations.
2 years ago
Georgi Gerganov
f1eaff4721
Add AVX2 support for x86 architectures thanks to @Const-me !
2 years ago
Georgi Gerganov
007a8f6f45
Support all LLaMA models + change Q4_0 quantization storage
2 years ago
Georgi Gerganov
26c0846629
Initial release
2 years ago