Comment on Why don't these code-writing AIs just output straight up machine code?

<- View Parent
TauZero@mander.xyz ⁨1⁩ ⁨day⁩ ago

Only because it’s English and the model is already trained on a large corpus of English text, so it has some idea of what a “table row” is for example. It could learn the concept from reading assembly code from scratch, it would just take longer. Hell, even Lego bricks can be trained on! avalovelace1.github.io/LegoGPT/

Our system tokenizes a LEGO design into a sequence of text tokens, ordered in a raster-scan manner from bottom to top. … At inference time, LegoGPT generates LEGO designs incrementally by predicting one brick at a time given a text prompt.

source
Sort:hotnewtop