You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
llama.cpp/examples
Ivan Stepanov dd7eff57d8
llama : new sampling algorithms (#1126)
* Sample interface, new samplers.

New samplers:
- locally typical sampling
- tail free sampling
- frequency and presence penalty
- mirostat

Ignore EOS fix: -inf should be used.

* mirostat

* Added --logit-bias and --no-penalize-nl, removed std::span

* Use C++11, clarify llama API documentation, rename Mirostat parameters to --mirostat_lr and --mirostat_ent, add temperature sampling for Mirostat, simplify Mirostat sampling API parameters (removed N and *k)

Use C++11, clarify llama API documentation, rename Mirostat parameters to --mirostat_lr and --mirostat_ent, add temperature sampling for Mirostat, simplify Mirostat sampling API parameters (removed N and *k)

* Save and load example adjust

* Tests

* Windows build fix

* Windows test fix
1 year ago
..
benchmark benchmark : fix result validation in benchmark-q4_0-matmult (#987) 1 year ago
embedding examples: add missing <ctime> include for time() (#1011) 1 year ago
jeopardy examples : add Jeopardy example (#1168) 1 year ago
main llama : new sampling algorithms (#1126) 1 year ago
perplexity Show perplexity ETA in hours and minutes (#1096) 1 year ago
quantize Remove Q4_3 which is no better than Q5 (#1218) 1 year ago
quantize-stats llama : multi-threaded quantization (#1075) 1 year ago
save-load-state llama : new sampling algorithms (#1126) 1 year ago
CMakeLists.txt examples : add save_load_state example (#1150) 1 year ago
Miku.sh Fix whitespace, add .editorconfig, add GitHub workflow (#883) 1 year ago
alpaca.sh examples : Improve Alpaca Default Repeat Penalty: Better Match Alpaca.cpp Experience (#1107) 1 year ago
chat-13B.bat Create chat-13B.bat (#592) 2 years ago
chat-13B.sh llama : add session file format and saved sessions in main (#1169) 1 year ago
chat.sh If n_predict == -1, generate forever 2 years ago
common.cpp llama : new sampling algorithms (#1126) 1 year ago
common.h llama : new sampling algorithms (#1126) 1 year ago
gpt4all.sh examples : add -n to alpaca and gpt4all scripts (#706) 1 year ago
reason-act.sh add example of re-act pattern (#583) 2 years ago