Spaces:
Sleeping
Sleeping
Deploying Pythonic RAG
Browse files
README.md
CHANGED
@@ -168,6 +168,10 @@ Simply put, this downloads the file as a temp file, we load it in with `TextFile
|
|
168 |
|
169 |
Why do we want to support streaming? What about streaming is important, or useful?
|
170 |
|
|
|
|
|
|
|
|
|
171 |
### On Chat Start:
|
172 |
|
173 |
The next scope is where "the magic happens". On Chat Start is when a user begins a chat session. This will happen whenever a user opens a new chat window, or refreshes an existing chat window.
|
|
|
168 |
|
169 |
Why do we want to support streaming? What about streaming is important, or useful?
|
170 |
|
171 |
+
#### :check_mark: ANSWER #1:
|
172 |
+
|
173 |
+
Streaming is important because it allows us to send the response to the user as soon as it is available. LLM responses can be quite slow, especially when there are a large number of input tokens. Streaming provides a much more responsive experience for the user.
|
174 |
+
|
175 |
### On Chat Start:
|
176 |
|
177 |
The next scope is where "the magic happens". On Chat Start is when a user begins a chat session. This will happen whenever a user opens a new chat window, or refreshes an existing chat window.
|