cerebro: num_ctx 6144 (cabe el prompt largo + RAG, whisper sigue en GPU)
This commit is contained in:
parent
0c6ea3e7bb
commit
29860fac86
2 changed files with 2 additions and 2 deletions
|
|
@ -15,4 +15,4 @@
|
|||
FROM qwen3.5:4b
|
||||
|
||||
PARAMETER num_gpu 24
|
||||
PARAMETER num_ctx 8192
|
||||
PARAMETER num_ctx 6144
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue