You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Kawrakow 38de86a711 llama : multi-threaded quantization (#1075) ... * Multi-threading quantization. Not much gain for simple quantizations, bit it will be important for quantizations that require more CPU cycles. * Multi-threading for quantize-stats It now does the job in ~14 seconds on my Mac for Q4_0, Q4_1 and Q4_2. Single-threaded it was taking more than 2 minutes after adding the more elaborate version of Q4_2. * Reviewer comments * Avoiding compiler confusion After changing chunk_size to const int as suggested by @ggerganov, clang and GCC starting to warn me that I don't need to capture it in the lambda. So, I removed it from the capture list. But that makes the MSVC build fail. So, making it a constexpr to make every compiler happy. * Still fighting with lambda captures in MSVC --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>		1 year ago
..
benchmark	benchmark : fix result validation in benchmark-q4_0-matmult (#987)	1 year ago
embedding	examples: add missing <ctime> include for time() (#1011)	1 year ago
main	Add LoRA support (#820)	1 year ago
perplexity	Add LoRA support (#820)	1 year ago
quantize	llama : multi-threaded quantization (#1075)	1 year ago
quantize-stats	llama : multi-threaded quantization (#1075)	1 year ago
CMakeLists.txt	Add quantize-stats command for testing quantization (#728)	1 year ago
Miku.sh	Fix whitespace, add .editorconfig, add GitHub workflow (#883)	1 year ago
alpaca.sh	examples : add -n to alpaca and gpt4all scripts (#706)	1 year ago
chat-13B.bat	Create chat-13B.bat (#592)	1 year ago
chat-13B.sh	Move chat scripts into "./examples"	1 year ago
chat.sh	If n_predict == -1, generate forever	1 year ago
common.cpp	Add LoRA support (#820)	1 year ago
common.h	Add LoRA support (#820)	1 year ago
gpt4all.sh	examples : add -n to alpaca and gpt4all scripts (#706)	1 year ago
reason-act.sh	add example of re-act pattern (#583)	1 year ago