Not really. These are slightly better for memory during pre-training and fine tu...

		llm_trw on Feb 29, 2024 \| parent \| context \| favorite \| on: The Era of 1-bit LLMs: ternary parameters for cost... Not really. These are slightly better for memory during pre-training and fine turning but not enough to make a 4090 usable even for a 7b model.