Skip to content

Commit

Permalink
r0903
Browse files Browse the repository at this point in the history
  • Loading branch information
nlueem committed Aug 3, 2024
1 parent 1ae8493 commit b94eb13
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions app.py
Original file line number Diff line number Diff line change
Expand Up @@ -72,12 +72,14 @@
logger.info("Model is loaded")

# Data model for making POST requests to /chat
# pylint: disable=R0903
class ChatRequest(BaseModel):
"""Class representing the data-model"""
messages: list
temperature: Union[float, None] = None
top_p: Union[float, None] = None
max_new_tokens: Union[int, None] = None
# pylint: enable=R0903


def generate(messages: list,
Expand Down

0 comments on commit b94eb13

Please sign in to comment.