Perverformer Telegram

: Go to web.telegram.org and log in with your phone number.

Standard Transformers rely heavily on positional encodings to understand the order of words. However, in certain data streams (like sensor sets or chaotic chat logs), the absolute position may not be as important as the relationship between elements. The Pervormer modifies the attention mechanism to be permutation invariant, making it more robust against noise and data scrambling. perverformer telegram