Posts tagged with 'nlp'
How a computer reads text - from counting words to vectors
From tokenization through TF-IDF and Markov chains, to Word2Vec. How a computer turns text into numbers so that language models can process it. read more →
Linguistic features - what you need to know before you understand how an LLM thinks
Five layers of language - phonetics, morphology, syntax, semantics, pragmatics - and how an LLM handles each of them. read more →