長いシーケンス処理

書いてみる

関連タグ

#Arxivデータセット (1)
#BPTT (2)
#ERNIE (9)
#GPUメモリ (4)
#K (396)
#LoRa (1,171)
#ParallelAdapter (1)

Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges

Ikemen Mas Kot
9か月前

Scaling Transformer to 1M tokens and beyond with RMT

Ikemen Mas Kot
9か月前