aditya/llama.cpp
1
0
Fork 0
mirror of https://git.adityakumar.xyz/llama.cpp.git synced 2025-02-23 08:00:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
722 commits 1 branch 0 tags 4.1 MiB
Commit graph

52 commits

Author SHA1 Message Date
Luciano
8d4a855c24
Add embedding mode with arg flag. Currently working (#282) 
* working but ugly

* add arg flag, not working on embedding mode

* typo

* Working! Thanks to @nullhook

* make params argument instead of hardcoded boolean. remove useless time check

* start doing the instructions but not finished. This probably doesnt compile

* Embeddings extraction support

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-24 17:05:13 +02:00
Georgi Gerganov
f5a77a629b
Introduce C-style API (#370) 
* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning
 2023-03-22 07:32:36 +02:00