We’re thinking about a context spanning several
requests of a conversation so it can do
version checking
----|---look----|------------think---------------|--update--|----
Tx1:10 ms 2
min Tx2:10 ms
Expensive in memory, however, since the context
must be kept alive between requests,
while the user thinks: above 20 ms vs 2020 ms, factor of 100
Rather than holding a whole context for a
conversation, we can condense it down to a
usually-small dataset as part of “session data”, save nearly a factor of 100
This can be held in the common database, but as
unshared data, has other possibilities
too