All Posts - MartinLwx's Blog

All Posts

Recently Updated

Tree-sitter and its Query 04-26

2025

Transformer architecture variation: RMSNorm 05-11

Kosaraju's Algorithm Explained 04-26

One for all: the torch.einsum API 04-14

Two different APIs related to Process Pool in Python 03-30

Class Hierarchy Analysis: a quick way to generate call graph 03-19

Prefix Sum Array: the secret to fast range sum query and more 03-15

Weight Tying in Language Models: A Technique to Parameter efficiency 03-11

What is Multi-Head Attention (MHA) 03-04

An Explanation of Self-Attention mechanism in Transformer 03-02

From Basic Block to Control Flow Graph 02-20

What is Three-Address Code (3AC/TAC) 02-18

The Flow of GraphRAG 02-12

Reading Notes: Outrageously Large Neural Networks-The Sparsely-Gated Mixture-of-Experts Layer 02-02

What is the Python decorator really? 01-20

2024

Reading Notes: Generalization through Memorization: Nearest Neighbor Language Models 12-23

How KNN Algorithm Works 12-15

What is Phantom type in OCaml 12-08

Reading Notes: In-Context Retrieval-Augmented Language Models 12-04

Reading Notes: REALM: Retrieval-Augmented Language Model Pre-Training 11-30

Use Polymorphic Variant Type in Ocaml 11-24

1
2
3
5