Paper - Tag - MartinLwx's Blog

Paper

2025

Transformer architecture variation: RMSNorm 05-11

Weight Tying in Language Models: A Technique to Parameter efficiency 03-11

The Flow of GraphRAG 02-12

Reading Notes: Outrageously Large Neural Networks-The Sparsely-Gated Mixture-of-Experts Layer 02-02

2024

Reading Notes: Generalization through Memorization: Nearest Neighbor Language Models 12-23

Reading Notes: In-Context Retrieval-Augmented Language Models 12-04

Reading Notes: REALM: Retrieval-Augmented Language Model Pre-Training 11-30

2023

LoRA fine-tuning 09-14

Understanding GAT throught MPNN 05-21