Rsr2425 commited on
Commit
9178758
·
1 Parent(s): 5de257c

Deploying Pythonic RAG

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -168,6 +168,10 @@ Simply put, this downloads the file as a temp file, we load it in with `TextFile
168
 
169
  Why do we want to support streaming? What about streaming is important, or useful?
170
 
 
 
 
 
171
  ### On Chat Start:
172
 
173
  The next scope is where "the magic happens". On Chat Start is when a user begins a chat session. This will happen whenever a user opens a new chat window, or refreshes an existing chat window.
 
168
 
169
  Why do we want to support streaming? What about streaming is important, or useful?
170
 
171
+ #### :check_mark: ANSWER #1:
172
+
173
+ Streaming is important because it allows us to send the response to the user as soon as it is available. LLM responses can be quite slow, especially when there are a large number of input tokens. Streaming provides a much more responsive experience for the user.
174
+
175
  ### On Chat Start:
176
 
177
  The next scope is where "the magic happens". On Chat Start is when a user begins a chat session. This will happen whenever a user opens a new chat window, or refreshes an existing chat window.