AG-BPE: Attention-Guided Tokenization Achieving State-of-the-Art Compression with 12x Smaller Vocabularies

It is about Gottfried Wilhelm Leibniz for me.

He envisioned a “Thought Alphabet” that we would use to “Calculate” an answer. I have the mechanics but that leaves meaning.

So that is what I am interested in lately and I thought, hey what genius am I –eh not so much but, I can see about that idea the honorable Leibniz had.

Mind you; I am a newbie to AI so, that is what interests me however; I am learning about AI at the same time so everything everyone says and all the papers , videos and ChatGPT (the cheap plan) is my classroom.

I am aiming to set up a small hobby lab here made out of odds and ends I have around here, in a month or two.

So I do have “Secret Knowledge” but yes the size of the phrase scales to infinity and the idea I have is the CU and CR of Leibniz.

Here is my first Topic when I joined LINK

Here is the second Topic on Leibniz here in Research.

1 Like