/ Recent content on Mathieu René Hugo -- gohugo.io en-us Sat, 03 Apr 2021 19:29:31 -0400 /about/ Sat, 03 Apr 2021 18:04:29 -0400 /about/ I’m a cofounder at HumanFirst where I work on a data engineering solution for natural language applications (where companies have tons of small texts and need to find structure and build models). /posts/text-tokenization/ Sat, 03 Apr 2021 17:49:19 -0400 /posts/text-tokenization/ A friend of mine asked me to explain how one went from words to tokens, to eventually represent text in a way that can be understood by machine learning algorithms.