https://pwaabdullah.github.io/tags/nlp/ Recent content in Nlp on Abdullah Al Mamun https://pwaabdullah.github.io/og-default.png https://pwaabdullah.github.io/og-default.png Hugo en newabdullah 2025 Fri, 18 Sep 2026 00:00:00 +0000 https://pwaabdullah.github.io/posts/what-you-must-know-about-nlp-llm/ Fri, 18 Sep 2026 00:00:00 +0000 https://pwaabdullah.github.io/posts/what-you-must-know-about-nlp-llm/ The architecture story of NLP: one-hot, bag of words, n-grams and TF-IDF, then word2vec and GloVe, then RNNs, LSTMs and seq2seq, then attention and the transformer, then every variant that matters (MQA, GQA, sliding window, RoPE, ALiBi, pre-LN, RMSNorm, SwiGLU, MoE, Mamba) and what each one fixed and broke.