The 256-token limit in all-MiniLM-L6-v2
Three config files disagree about how long a MiniLM input can be. sentence-transformers uses 256 tokens, everything past that is dropped silently, and extending the window is not the fix.
Read more1 post
Three config files disagree about how long a MiniLM input can be. sentence-transformers uses 256 tokens, everything past that is dropped silently, and extending the window is not the fix.
Read more