GitHub

Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)

†Work done during an internship at LG AI Research. *Equal contribution. ‡Corresponding authors. To try out our pretrained Block Transformer models, install ...
GitHub

Searchformer: Beyond a* Better Planning with Transformers via Search Dynamics

Official code base for the paper titled Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping. This repository contains code for accessing the generated datasets and trained ...
Bloomberg L.P.

China Transformer Exports Hit Record Value on Global Shortage

China reaped record gains from rising exports of power transformers last year, as the rapid buildout of data centers and accelerating electrification squeeze supplies and raise prices worldwide. The ...
IEEE

RF-OnlineHAR: A Real-Time RFID Activity Recognition Framework with Memory-Augmented Transformer

Abstract: Radio Frequency Identification (RFID)-based human activity recognition (HAR) holds strong potential for ubiquitous sensing due to its capabilities of identity-awareness, privacy-preservation ...
IEEE

ViA: A Novel Vision-Transformer Accelerator Based on FPGA

Abstract: Since Google proposed Transformer in 2017, it has made significant natural language processing (NLP) development. However, the increasing cost is a large amount of calculation and parameters ...