From a17a2683d8fdb899ba497d0c28ccafb28c62efb6 Mon Sep 17 00:00:00 2001 From: tslmy Date: Thu, 6 Jul 2023 09:17:50 -0700 Subject: [PATCH] alpaca.sh : update model file name (#2074) The original file name, `ggml-alpaca-7b-q4.bin`, implied the first-generation GGML. After the breaking changes (mentioned in https://github.com/ggerganov/llama.cpp/issues/382), `llama.cpp` requires GGML V3 now. Those model files are named `*ggmlv3*.bin`. We should change the example to an actually working model file, so that this thing is more likely to run out-of-the-box for more people, and less people would waste time downloading the old Alpaca model. --- examples/alpaca.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/examples/alpaca.sh b/examples/alpaca.sh index aef207f..8d2bae6 100755 --- a/examples/alpaca.sh +++ b/examples/alpaca.sh @@ -7,7 +7,7 @@ cd `dirname $0` cd .. -./main -m ./models/ggml-alpaca-7b-q4.bin \ +./main -m ./models/alpaca.13b.ggmlv3.q8_0.bin \ --color \ -f ./prompts/alpaca.txt \ --ctx_size 2048 \