I don't know what that means. There is nothing "mental" happening in the circuit...

GaggiX · 2024-07-06T21:47:56

In the context of AI, it's a term that I borrow from human cognition to describe rapid calculations without external aids.

soloist11 · 2024-07-07T00:08:51

The comparison still makes no sense. What would be an external aid for a computer?

GaggiX · 2024-07-07T01:49:41

Well for the LLM would be a calculator.

soloist11 · 2024-07-07T03:03:53

The LLM is a calculator. Think about it.

fragmede · 2024-07-07T03:30:23

The LLM is an LLM. It runs on computer hardware which has an ALU, but that doesn't make the LLM a calculator. The LLM can, however, call out to a calculator to do addition when it deems necessary.

soloist11 · 2024-07-07T04:58:14

The LLM is not doing anything other than arithmetic calculations. Every operation an LLM is doing can be done with a calculator.

fragmede · 2024-07-07T05:34:40

Typically we don't refer to matrix multiplication as arithmetic calculations, but you do you.

Jensson · 2024-07-07T08:52:16

> Typically we don't refer to matrix multiplication as arithmetic calculations

You don't? Didn't you do them in school? Everyone calls that arithmetic's, you are just adding up and multiplying a bunch of numbers.

fragmede · 2024-07-08T07:48:31

do you really multiply numbers but call that arithmetic? I must sincerely ask, where are you?

soloist11 · 2024-07-07T05:40:25

I'm pretty sure it's all arithmetic for an LLM but you do you too.

GaggiX · 2024-07-07T04:39:59

It's not.

soloist11 · 2024-07-07T04:58:30

Are you sure?

GaggiX · 2024-07-07T05:10:00

soloist11 · 2024-07-07T05:40:50

So the LLM is not doing arithmetic?