You cannot select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
38de86a711
* Multi-threading quantization. Not much gain for simple quantizations, bit it will be important for quantizations that require more CPU cycles. * Multi-threading for quantize-stats It now does the job in ~14 seconds on my Mac for Q4_0, Q4_1 and Q4_2. Single-threaded it was taking more than 2 minutes after adding the more elaborate version of Q4_2. * Reviewer comments * Avoiding compiler confusion After changing chunk_size to const int as suggested by @ggerganov, clang and GCC starting to warn me that I don't need to capture it in the lambda. So, I removed it from the capture list. But that makes the MSVC build fail. So, making it a constexpr to make every compiler happy. * Still fighting with lambda captures in MSVC --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> |
1 year ago | |
---|---|---|
.. | ||
benchmark | 1 year ago | |
embedding | 1 year ago | |
main | 1 year ago | |
perplexity | 1 year ago | |
quantize | 1 year ago | |
quantize-stats | 1 year ago | |
CMakeLists.txt | 1 year ago | |
Miku.sh | 1 year ago | |
alpaca.sh | 1 year ago | |
chat-13B.bat | 1 year ago | |
chat-13B.sh | 1 year ago | |
chat.sh | 1 year ago | |
common.cpp | 1 year ago | |
common.h | 1 year ago | |
gpt4all.sh | 1 year ago | |
reason-act.sh | 1 year ago |