# General Representation Learning

- [2021 ArXiv] **An Attention Free Transformer**, [[paper]](https://arxiv.org/pdf/2105.14103.pdf), [[bibtex]](/Bibtex/An%20Attention%20Free%20Transformer.bib), sources: [[rish-16/aft-pytorch]](https://github.com/rish-16/aft-pytorch).
- [2021 ICML] **Perceiver: General Perception with Iterative Attention**, [[paper]](https://proceedings.mlr.press/v139/jaegle21a/jaegle21a.pdf), [[bibtex]](/Bibtex/Perceiver%20-%20General%20Perception%20with%20Iterative%20Attention.bib), sources: [[lucidrains/perceiver-pytorch]](https://github.com/lucidrains/perceiver-pytorch).
- [2021 ICML] **Evolving Attention with Residual Convolutions**, [[paper]](https://arxiv.org/pdf/2102.12895.pdf), [[bibtex]](/Bibtex/Evolving%20Attention%20with%20Residual%20Convolutions.bib).
- [2022 ArXiv] **data2vec: A General Framework for Self-supervised Learning in Speech, Vision
and Language**, [[paper]](https://arxiv.org/pdf/2202.03555.pdf), [[bibtex]](/Bibtex/data2vec.bib), sources: [[pytorch/fairseq/data2vec]](https://github.com/pytorch/fairseq/tree/main/examples/data2vec).