Skip to content
GitLab
Explore
Projects
Groups
Snippets
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
Memri
plugins
llm_api
Merge requests
!2
Update to mistral preset. Double context size
Code
Review changes
Check out branch
Download
Email patches
Plain diff
Merged
Alp Deniz Ogut
requested to merge
mistral
into
dev
1 year ago
Overview
0
Commits
1
Pipelines
1
Changes
3
0
0
Compare
dev
dev (base)
and
latest version
latest version
5c8483e1
1 commit,
1 year ago
3 files
+
4
-
4
Expand all files
Preferences
Preferences
File browser
List view
Tree view
Compare changes
Inline
Side-by-side
Show whitespace changes
Show one file at a time
Search (e.g. *.vue) (Ctrl+P)
llm
_api
consta
nts.py
+2
-2
db
.py
+1
-1
mode
l.py
+1
-1
llm_api/constants.py
+
2
-
2
Options
View file @ 5c8483e1
Edit in single-file editor
Open in Web IDE
Show full file
import
os
CONTEXT_SIZE
=
2048
CONTEXT_SIZE_LIMIT
=
CONTEXT_SIZE
-
2
00
CONTEXT_SIZE
=
4096
CONTEXT_SIZE_LIMIT
=
CONTEXT_SIZE
-
4
00
REDIS_HOST
=
os
.
getenv
(
"REDIS_HOST"
,
"localhost"
)
REDIS_PORT
=
os
.
getenv
(
"REDIS_PORT"
,
6379
)
REDIS_PASSWORD
=
os
.
getenv
(
"REDIS_PASSWORD"
,
None
)
llm_api/db.py
+
1
-
1
Options
View file @ 5c8483e1
Edit in single-file editor
Open in Web IDE
Show full file
@@ -13,7 +13,7 @@ r_db = redis.Redis(
socket_connect_timeout
=
REDIS_SOCKET_CONNECT_TIMEOUT
,
)
DEFAULT_MODEL
=
"
llama-2-13b-chat.ggmlv3.q4_0
"
DEFAULT_MODEL
=
"
mistral-7b-instruct-v0.1.Q4_K_M
"
def
make_request_stack_key
(
model
:
str
=
DEFAULT_MODEL
):
llm_api/model.py
+
1
-
1
Options
View file @ 5c8483e1
Edit in single-file editor
Open in Web IDE
Show full file
@@ -12,7 +12,7 @@ class Message(BaseModel):
class
Chat
(
BaseModel
):
system
:
str
=
"You are a helpful assistant."
model
:
str
=
"
llama-2-13b-chat.ggmlv3.q4_0
"
model
:
str
=
"
mistral-7b-instruct-v0.1.Q4_K_M
"
messages
:
list
[
Message
]
def
as_llm_query
(
self
):
Menu
Explore
Projects
Groups
Snippets