This is a Pytorch implementation of Reformer. It includes LSH attention, reversible network, and chunking. It has been validated with an auto-regressive task (enwik8).
Features
- Positional Embeddings
- Masking
- Documentation available
- Examples available
- Reformer Encoder Decoder Architecture
- Product Key Memory
- Customize Feedforward
- Helpers for training auto-regressive models
Categories
Machine LearningLicense
MIT LicenseFollow Reformer PyTorch
Other Useful Business Software
The AI-powered unified PSA-RMM platform for modern MSPs.
SuperOps.ai is the only PSA-RMM platform powered by intelligent automation and thoughtfully crafted for the new-age MSP. The platform also helps MSPs manage their projects, clients, and IT documents from a single place.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Reformer PyTorch!