mirror of
https://git.adityakumar.xyz/llama.cpp.git
synced 2025-02-22 15:40:02 +00:00

By using `pip install torch --index-url https://download.pytorch.org/whl/cpu` instead of `pip install torch` we can specify we want to install a CPU-only version of PyTorch without any GPU dependencies. This reduces the size of the Docker image from 7.32 GB to 1.62 GB
18 lines
398 B
Docker
18 lines
398 B
Docker
ARG UBUNTU_VERSION=22.04
|
|
|
|
FROM ubuntu:$UBUNTU_VERSION as build
|
|
|
|
RUN apt-get update && \
|
|
apt-get install -y build-essential python3 python3-pip
|
|
|
|
RUN pip install --upgrade pip setuptools wheel \
|
|
&& pip install numpy requests sentencepiece tqdm \
|
|
&& pip install torch --index-url https://download.pytorch.org/whl/cpu
|
|
|
|
WORKDIR /app
|
|
|
|
COPY . .
|
|
|
|
RUN make
|
|
|
|
ENTRYPOINT ["/app/.devops/tools.sh"]
|