63 commits

Author	SHA1	Message	Date
Sergey Alirzaev	cc9cee8e9e	Do not crash when it has nothing to say. (#796) ... Otherwise observing this in the interactive mode: /usr/lib/gcc/x86_64-pc-linux-gnu/12/include/g++-v12/bits/stl_vector.h:1230: reference std::vector<int>::back() [_Tp = int, _Alloc = std::allocator<int>]: Assertion '!this->empty()' failed.	2023-04-06 17:59:11 +02:00
mgroeber9110	53dbba7695	Windows: reactive sigint handler after each Ctrl-C (#736)	2023-04-03 18:00:55 +02:00
anzz1	7f4c5c6651	llama : fix linkage with mingw (#551) ... * Revert 7e53955 (#542) Still needs to be fixed properly * Fix linking on mingw32	2023-03-28 21:23:09 +03:00
Stephan Walter	436e561931	all : be more strict about converting float to double (#458) ... * Be more strict about converting float to double * Test equivalence of round, SILU implementations Test module is commented out in CMakeLists.txt because the tests may take a long time, depending on how much the compiler optimizes. * Fix softmax in perplexity.cpp * all : prefer float over double where appropriate * perplexity : add <cmath> --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2023-03-28 19:48:20 +03:00
anzz1	7b8dbcb78b	main.cpp fixes, refactoring (#571) ... - main: entering empty line passes back control without new input in interactive/instruct modes - instruct mode: keep prompt fix - instruct mode: duplicate instruct prompt fix - refactor: move common console code from main->common	2023-03-28 17:09:55 +03:00
Marco Matthies	7e5395575a	Fix missing ggml link in cmake for examples/* on w64-mingw32 (#542)	2023-03-27 07:55:26 +03:00
anzz1	7a87d31f4f	[main] fix infinite generation (-n == -1) (#523)	2023-03-26 16:06:10 +03:00
Harald Fernengel	33e35b8fe8	Exit from interactive mode if input stream is bad (#491) ... Allow exiting the interactive prompt also with CTRL-D on Unix and CTRL-Z on Windows.	2023-03-26 08:25:46 +03:00
anzz1	34ab526843	(Windows) Set console to UTF-8 on init (#420) ... Sets console codepage to 65001 (CP_UTF8) on start for both input and output, should fix problems with UTF-8 characters.	2023-03-25 22:29:22 +02:00
Georgi Gerganov	c2b25b6912	Fix colors enabling on WIN32	2023-03-25 21:53:39 +02:00
Georgi Gerganov	79b2b266db	If n_predict == -1, generate forever	2023-03-25 21:51:41 +02:00
Georgi Gerganov	e2d490dafd	Inifinite generation via context swapping (#71)	2023-03-25 21:36:22 +02:00
Georgi Gerganov	a316a425d0	Overhaul the examples structure ... - main -> examples - utils -> examples (renamed to "common") - quantize -> examples - separate tools for "perplexity" and "embedding" Hope I didn't break something !	2023-03-25 20:26:40 +02:00