2
$\begingroup$

https://arxiv.org/abs/2304.01933 shows that the best performing adapter-based parameter-efficient fine-tuning depends on the language model being fine-tuned:

enter image description here

E.g., LORA is the best adapter for LlaMa-7B, while S-adapter is the best adapter for BLOOM-7.1B.

Why does the best performing adapter-based parameter-efficient fine-tuning depend on the language model being fine-tuned?

Improve this question
$\endgroup$

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.