Commit Graph

6 Commits (b9bd1d014113b7498f04ad4d28e6021d5f4cddad)

Author SHA1 Message Date
beiller 129c7d1ea8
Add repetition penalty (#20)
* Adding repeat penalization

* Update utils.h

* Update utils.cpp

* Numeric fix

Should probably still scale by temp even if penalized

* Update comments, more proper application

I see that numbers can go negative so a fix from a referenced commit

* Minor formatting

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2 years ago
Georgi Gerganov 7d9ed7b25f
Bump memory buffer 2 years ago
Georgi Gerganov 007a8f6f45
Support all LLaMA models + change Q4_0 quantization storage 2 years ago
Georgi Gerganov 70bc0b8b15
Fix a bug in the rope calculation 2 years ago
Georgi Gerganov 319cdb3e1f
Final touches 2 years ago
Georgi Gerganov 26c0846629
Initial release 2 years ago