“If you can replace a semicolon or hyphen with a comma/period, you probably should”. Writing advice I received at age ~10 and it never stopped being relevant in literature contexts

CRAM is an utterly goated name

I was never that into the open source community, but I did admire it from afar.

I don’t see how anyone would ever contribute to open source now, knowing it will just be thrown into the meat processor.

GPT is basically a machine that builds machines.

We understand how the machine builder works. We don’t understand how the output of the machine works. Like mechanically we understand each individual sub-component works e.g. a single matrix multiplication, but we don’t understand why specific weights are the value they are, or the broader macrostructure.

I don’t think you realize that acting like “No we actually do understand how it works” just reveals that you don’t understand the question, it does not show that the question has an answer.

Please explain what this one specific weight is, and why that value shouldn’t be higher or lower.

It’s just a series of 10 trillion floats. And we don’t really know what the individual floats represent and changing them degrades performance but hey

Technically. It’s just if statements.

Great edit. I love this.