llama.cpp/.devops/full.Dockerfile

ARG UBUNTU_VERSION=22.04

FROM ubuntu:$UBUNTU_VERSION as build

RUN apt-get update && \
    apt-get install -y build-essential python3 python3-pip

RUN pip install --upgrade pip setuptools wheel \
    && pip install numpy requests sentencepiece tqdm \
    && pip install torch --index-url https://download.pytorch.org/whl/cpu

WORKDIR /app

COPY . .

RUN make

ENTRYPOINT ["/app/.devops/tools.sh"]
🚀 Dockerize llamacpp (#132) * feat: dockerize llamacpp * feat: split build & runtime stages * split dockerfile into main & tools * add quantize into tool docker image * Update .devops/tools.sh Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> * add docker action pipeline * change CI to publish at github docker registry * fix name runs-on macOS-latest is macos-latest (lowercase) * include docker versioned images * fix github action docker * fix docker.yml * feat: include all-in-one command tool & update readme.md --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> 2023-03-17 09:47:06 +00:00			`ARG UBUNTU_VERSION=22.04`

			`FROM ubuntu:$UBUNTU_VERSION as build`

			`RUN apt-get update && \`
			`apt-get install -y build-essential python3 python3-pip`

			`RUN pip install --upgrade pip setuptools wheel \`
Remove torch GPU dependencies from the Docker.full image (#665) By using `pip install torch --index-url https://download.pytorch.org/whl/cpu` instead of `pip install torch` we can specify we want to install a CPU-only version of PyTorch without any GPU dependencies. This reduces the size of the Docker image from 7.32 GB to 1.62 GB 2023-04-02 22:13:03 +00:00			`&& pip install numpy requests sentencepiece tqdm \`
			`&& pip install torch --index-url https://download.pytorch.org/whl/cpu`
🚀 Dockerize llamacpp (#132) * feat: dockerize llamacpp * feat: split build & runtime stages * split dockerfile into main & tools * add quantize into tool docker image * Update .devops/tools.sh Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> * add docker action pipeline * change CI to publish at github docker registry * fix name runs-on macOS-latest is macos-latest (lowercase) * include docker versioned images * fix github action docker * fix docker.yml * feat: include all-in-one command tool & update readme.md --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> 2023-03-17 09:47:06 +00:00
			`WORKDIR /app`

			`COPY . .`

			`RUN make`

Add tqdm to Python requirements (#293) * Add tqdm to Python requirements * Remove torchvision torchaudio, add requests 2023-03-20 08:24:11 +00:00			`ENTRYPOINT ["/app/.devops/tools.sh"]`