You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
What is the benefit to store hidden states and attention weights? #100
Thanks for your project! After reading your paper, I find that MemOS can store KV cache, hidden states and attention weights. I get that KV cache can be used to reload the conversation history. However, I cannot understand the usage of storing hidden states and attention weights. Can you help explain that? Thanks!
Activity