4 commits

Author	SHA1	Message	Date
Mack Straight	074bea2eb1	sentencepiece bpe compatible tokenizer (#252) ... * potential out of bounds read * fix quantize * style * Update convert-pth-to-ggml.py * mild cleanup * don't need the space-prefixing here rn since main.cpp already does it * new file magic + version header field * readme notice * missing newlines Co-authored-by: slaren <2141330+slaren@users.noreply.github.com>	2023-03-20 03:17:23 -07:00
Thomas Klausner	41be0a3b3d	Add NetBSD support. (#90)	2023-03-13 18:40:54 +02:00
Georgi Gerganov	7211862c94	Update Makefile var + add comment	2023-03-11 12:27:02 +02:00
Georgi Gerganov	26c0846629	Initial release	2023-03-10 20:56:40 +02:00