Hacker News new | past | comments | ask | show | jobs | submit | cherioo's comments login

What hardware are you able to run this on?

If your job or hobby in any way likes LLMs, and you like to "Work Anywhere", it's hard not to justify the MBP Max (e.g. M3 Max, now M4 Max) with 128GB. You can run more than you'd think, faster than you'd think.

See also Hugging Face's MLX community:

https://huggingface.co/mlx-community

QwQ 32B is featured:

https://huggingface.co/collections/mlx-community/qwq-32b-pre...

If you want a traditional GUI, LM Studio beta 0.3.x is iterating on MLX: https://lmstudio.ai/beta-releases


Works well for me on an MBP with 36GB ram with no swapping (just).

I've been asking it to perform relatively complex integrals and it either manages them (with step by step instructions) or is very close with small errors that can be rectified by following the steps manually.


I am running it on a 32G memory mac mini with an M2 Pro using Ollama. It runs fine, faster than I expected. The way it explains plans for solving problems, then proceeding step by step is impressive.

How many tokens per second?

Sorry for the random question, I wonder if you know, what's the status of running LLMs non-NVIDIA GPUs nowadays? Are they viable?

Apple silicon is pretty damn viable.

Pretty sure they meant AMD

Yeah, but if you buy ones with enough RAM, you're not really saving money compared to NVIDIA, and you're likely behind in perf.

I run llama on 7900XT 20GB, works just fine.

M2 MacBook Pro with 64GB of RAM.

They would run from Mac when nvidia offers a 128gb or 512gb laptop offering.

Until then it’s meaningless to even consider windows (laptop)


I think this is to make human /user experience better. If you use accessibility features, then user need to know how to use those features. Similar to another comment in here, the UX they shoot for is “click the red button with cancel on it”, and ship that ASAP.


I don’t have iphone 16, and this article puzzles me.

Is apple only using jxl for their “raw” camera capture, but not regular camera capture?? The non-raw use case seems to be the one that would have more impact to regular folks.

Why? Is jxl inferior to HEIC?


DNG spec added JPEG-XL as their modern codec. Both lossy and lossless modes are significantly better than the other 3 allowed codecs (JPEG, lossless JPEG, and zip.)


ProRAW files are large, so there's more potential to save space, making ProRAW a more attractive feature to use for a wider audience.


The azure post is very hand wavy, and it looks like azure isn’t even supporting redis 7, let alone redis minor version after the license change.


Nvidia margin is like 70%. Using google TPU is certainly going to erase some of that.


They sell cards and they are selling out


OLED uses PWM to modulate brightness, which makes some people uncomfortable due to eye sensitivity.

All phone OLED exhibits this, though iphone is one of the more egregious ones.


> OLED uses PWM to modulate brightness, which makes some people uncomfortable due to eye sensitivity.

I saw a couple mentions of this today that I’d never heard of before. Do you know if there have been any studies (preferably double-blind) into this?


https://www.digikey.com/en/articles/characterizing-and-minim...

FWIW I don't think I have any sort of special sensitivity, I just don't like it and it annoys me whenever I notice it

If I was not using my phone in the dark at low brightness as much I would probably be fine with OLED...

Also maybe they made it better since first OLED iphones, but they never say anything about PWM in press releases and it is kind of expensive to just buy it to try and throw out if it still sucks.


Don’t they also use PWM to dim the LED backlight on LCD displays?


It doesn't go to full black and maybe other reasons it is less noticeable. You can compare with a slo mo camera


They often do, but the iPhone SE has DC dimming.


It’s amazing how this is now the news, not when it successfully lands!


"This was the booster's 23rd launch." that's the thing I'll remember from the article


Think about who stands to lose the most if Tesla and spacex dominate (answer: old money)

Think about who controls the media (answer: old money and friends of old money)

It is very easy to see why they want everyone to think spacex and Tesla are collapsing


"Old money" is one way to put it. It seems to be dominated by pension funds and people's savings. Please don't put your savings into Vanguard's famous index fund — Vanguard currently has 7.47% of the shares and you don't want to ruin that by forcing Vanguard to increase its stake to 7.48%.


Intel is removing SMT from their next gen mobile processor.

My guess is this will help them improve ST perf. We will see how well it works, and if amd will follow


I like your idea. But on the other hand, training an AGI, and then having a layer on top “aligning” the AGI sounds super dystopian and good plot for a movie.


We create superintelligence, but just feed it a steady dose of soma.


the aligning means it should do what the board of directors wants, not what's good for society.


Poisoning Socrates was done because it was "good for society". I'm frankly even more suspicious of "good for society" than the average untrustworthy board of directors.


seriously? you're more worried about what your elected officials might legislate than what a board of directors whose job is to make profits go brrr at all costs, including poisoning the environment, exploiting people and avoiding taxes?


The vast majority of businesses do none of those things.


and the vast majority of elected officials didn't kill Socrates.


Didn't vast majority of elected officials vote for war in Iraq, Vietnam and Afghanistan?

Vast majority of elected officials are crooks that take millions from foreign interest groups (e.g AIPAC) and from corporations - and make laws in their favour.


weren't the us invited to defend the democratic government of Vietnam? weren't the taleban hiding al quaeda who attacked the US? didn't Saddam Hussein use chemical weapons against his own people? are you comparing all these people with Socrates?


Did the people want to participate in Vietnam? Get drafted so that they can die thousand of miles away from home?

> didn't Saddam Hussein use chemical weapons against his own people?

You can't argue that when US is providing weapons to Israel which are directly used to massacre thousands of innocents. That was just an excuse to the public

> are you comparing all these people with Socrates?

No, my point is that the government does not act in the interest of people or in the interest of upholding human rights.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: