It's worth it if a) you have a decent sample size of data for your problem and b... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		minimaxir 4 days ago \| parent \| context \| favorite \| on: Ask HN: When is fine-tuning a small LLM worth it? It's worth it if a) you have a decent sample size of data for your problem and b) you have a cost-effective infra to host it. Notably the latter is more of the bottleneck, particularly with the price race-to-zero with models such as GPT-6 Luna.
		help

verdverm 4 days ago [–]

There are allegedly multi-tenant LoRA offerings in the works which would change the hosting-pricing constraints considerably. Keeping my fingers crossed they materialize

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact