zrm b853d45601 ggml : add NUMA support (#1556) ... * detect NUMA systems and pin work threads to nodes (linux) * disable mmap prefetch/readahead for NUMA systems * avoid sending finalize op to thread pool if it does nothing * silence robot * fix args * make --numa a param * recommendation that n_nodes evenly divide n_threads did not warrant such aggressive enforcement * lower synchronization overhead * statically allocate * move numa state to g_state * add description for --numa * ggml : minor style changes * ggml : minor style + try fix sanitizer build * llama : allow to initialize backend with NUMA support * llama : avoid ggml include in llama-util.h * ggml : style / formatting * ggml : fix handling of ops with n_threads > n_tasks > 1 * server : utilize numa parameter --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>		2023-06-26 20:57:59 +03:00
..
CMakeLists.txt	examples : add "simple" (#1840)	2023-06-16 21:58:09 +03:00
simple.cpp	ggml : add NUMA support (#1556)	2023-06-26 20:57:59 +03:00