WARNING: THIS SITE IS A MIRROR OF GITHUB.COM / IT CANNOT LOGIN OR REGISTER ACCOUNTS / THE CONTENTS ARE PROVIDED AS-IS / THIS SITE ASSUMES NO RESPONSIBILITY FOR ANY DISPLAYED CONTENT OR LINKS / IF YOU FOUND SOMETHING MAY NOT GOOD FOR EVERYONE, CONTACT ADMIN AT ilovescratch@foxmail.com
Skip to content

What is minimum resource requirement to fine-tuning Llama-2-7B-32K-beta model. #176

New issue
New issue
Open
Open
What is minimum resource requirement to fine-tuning Llama-2-7B-32K-beta model.#176
@zzbin0

Description

@zzbin0
zzbin0
opened on Mar 25, 2024

Hi,
What is minimum resource requirement to fine-tuning Llama-2-7B-32K-beta model with finetune_llama-2-7b-32k-mqa.sh script. Such as disk, memory and vRAM.
Look forward to your response.
Best regards.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions