

01·
14 days agoI just stick to AMD, especially on Linux. The official AMD driver is open source on Linux, included in mainline kernel, and performance is better than their Windows diver now
I just stick to AMD, especially on Linux. The official AMD driver is open source on Linux, included in mainline kernel, and performance is better than their Windows diver now
Ummm… did you try /set parameter num_ctx #
and /set parameter num_predict #
? Are you using a model that actually supports the context length that you desire…?
A negative one that brought only Reddit energy and vibe to this place