VAriational Methods for Pretraining In Resource-limited Environments
Journal: Annual Meeting of the Association for Computational Linguistics
Languages: All Languages
Programming languages: Python
Project website: https://github.com/allenai/vampire
We introduce VAMPIRE, a lightweight pretraining framework for effective text classification when data and computing resources are limited.