how large can database schemas be ?
Hi team , thanks a lot for the model . I want to know if we want to use this in production how large database schem context can it handle ? Since we are talking about production grade applications we can expect min of 30-40 tables in a small - mid size organization . Thanks for reading !
Hi,
You can dramatically reduce the context size for most queries by only including a subset of the original schema in the prompt. That is, you can generate this subset by embedding the field descriptions and doing similarity search with the user prompt. Then just generate the schema by containing only fields relevant to the user input.
@JohnBound , I'm not a SQL developer, but I'm building a text-2-sql application. Just wanted to understand about your suggestion. what does it mean "field descriptions" does it mean that table will have description for it self and each column in the table will have description of itself. Like explaining what that table is and each columns is and represent.