I tend to have one hand holding a pen on a drawing tablet. I could customise any wm to be controlled with just the left side of the keyboard obviously but I fear I would have arthritis from doing that.
I'm half joking, I did use i3 for a few years, and have tried many others (bspwm comes to mind). But currently it makes no sense to use keyboard centric wms of any kind.
Static types do provide some guarantees as they rule out an entire class of runtime errors. In case of XMonad, since Haskell's type system is more expressive, the class of runtime errors ruled out at compile-time is broader.
Exactly. Locally hosted must be maintained as a viable option by volunteers, or the audio llm equivalent of YouTube circa 2006 will gradually become YouTube circa 2024…
I’ve had great luck so far with GPT-SoVITS. With a custom trained Japanese model and clean reference audio the quality is outstanding. It is quite finicky to set up and use though.
Yes, it can be done. I'm running a 24-channel DDR5 dual-EPYC rig and get good speed on large MoE models. I only use the GPU for context processing.
They're actually a best-case for CPU inference vs dense models. I usually run deepseek 2.5 quanted to q8, but if this model works well I'll probably switch to it once support hits llama.cpp.
I use 24 sticks of ddr5-4800, which gets me up to 9t/s on deepseek 2.5 at q8. 48 threads was optimal in llama.cpp. I would like to move to epyc 9005 chips and ddr5-6000, but it is cost prohibitive with CPUs still over $10k each on eBay.
How many cores do your CPUs have? Are you using the 64 core EPYC 9334 mentioned in the linked page? Do that many cores provide a speedup versus having fewer cores?
I run it at home at q8 on my dual Epyc server. I find it to be quite good, especially when you host it locally and are able to tweak all the settings to get the kind of results you need for a particular task.
It helps to be able to run the model locally, and currently this is slow or expensive. The challenges of running a local model beyond say 32B are real.
I would be fine though with like 10 times the wait time. But I guess consumer hardware need some serius 'ram pipeline' upgrade for big models to be run at crawl speeds.
Unrelated, but GPU coil whine can give unintentional ambience to LLM inference.
In some llama.cpp versions on my home inference rig it would manifest as a sort of squelchy sound that would match the generation of characters on the screen, reminiscent of the effect often used during dialog in 8-bit era video games.
I've actually noticed something similar on my GPU. Not sure if it's the same thing but whenever I'm playing Minecraft it makes a weird sound I don't really know how to describe, but as soon as I navigate away the sound goes away (some performance mods probably halt it's execution/rendering when not in focus).
I'm very curious about what exactly makes the sound and how it works. Glad to know it isn't only me because for some time I was afraid my GPU was defective :^)
A lot of the time it can happen if you're rendering a ridiculous number of frames. I used to get it in game menus where the FPS would spike into the hundreds. Other than that, just general high load will do it.
The noise comes from inductors in the GPU core power supply. Under the right load conditions, the coil in the inductor begins to resonate. The magnetic fields change so rapidly and contain so much energy that they physically push the coil until it resonates at some small fraction of the switching frequency. It's a pretty neat, if extraordinarily annoying phenomenon
On the ODDTAXI front, I can recommend the currently running "Roots of Odd Taxi (RoOT)" series. Its a nice side-story that adds a lot of texture without making the original worse. Also, the "ODDTAXI in the Woods" movie version definitely added a lot and tied things up in a way that the series didn't.
I see this a lot and I think it hurts more than it helps. People read this as, “if I want to be rich, I need to take out debt.” And they almost always take on debt for the wrong reasons.
Agreed and you can use debt very safely if your net position is in credit. For one example I'm always amazed at how many people don't take advantage of the interest free period of credit cards. As long as you have enough savings put aside to cover the CC balance in full each month you're significantly better off doing all your spending on a credit card instead of a debit card.
See youtube channel 'CalebHammer' [0] (he does financial audits for those that are in financial trouble) of mistakes the regular people make. It can be quite painful to watch.
Not the original poster, but debt can allow you to shift transactions to periods that are most advantageous to you.
Here's an example. Let's say that you as a high wealth individual have some stock. The stock has a value of $10M but you can only realize that value through the sale of the stock.
If you sell the stock right now you have to sell it for the price the market will buy it at and you have to pay taxes on the profit, either income taxes if you've not had the stock for long or capital gains taxes if you've held it for the requisite period.
It is in your interest to optimize your sale so that you pay the least amount in taxes and get the best price per share. You'd love to be able to hold your stock until you can do that, but you need money now. In comes debt.
Someone will probably happily issue you some debt that you can use today as money. You can collateralize that debt with your $10M in paper value and get a nice interest rate.
So you take out $1M in debt and enjoy life and at the end you have to pay back, to keep the math easy, $1.1M. This debt cost you $100k but if by taking on that debt you can sell when the stock price is higher or convert income tax (37%) into capital gains (20%) then the $100k could easily buy you much more than $100k.
In our example if the stock price were the same but all you did was hold the asset long enough to convert it from short term to long term then instead of paying $10M * 37% = $3.7M in taxes, you'd pay $10M * 20% = $2M in taxes. That's a savings of $1.7M on your tax bill.
This is how people with assets can use debt as a tool.
Here's an example that could be achievable without needing to be a super high wealth individual, but does require being able to pay a few thousand dollars up front with little notice.
Let's say you get hit with a $3,500 medical bill. The hospital says they're willing to reduce it by 20% ($700) if you pay up front so now your bill is $2,800.
Now, let's say you rarely use credit cards and a major bank will give you $750 cash as a bonus if you spend $4,000 in 3 months. With the medical bill and regular spending you can hit that without making any "extra" purchases.
You could sign up for that card, immediately pay off the $2,800 to avoid paying any interest on the card and once you get the cashback bonus it's really like paying $2,050 instead of $3,500. Now you can take that $1,500 you saved, invest it at 5% for 15 years and with compounding interest you get back +$1,500 profit (minus taxes) which essentially means your medical bill was $500.
Of course this requires luck and timing around being able to do that with the card but even if you didn't have the card bonus you can get a guaranteed 20% return in 1 year by paying it off. The alternative is paying the full amount in smaller payments. Technically a lot of hospitals don't charge interest and give you reasonable plans to pay it off but most other places will charge you interest.
The most important things financially are cash flow and coffer size. Being able to take on debt at advantageous times provides both of these things because it allows you to shift cash flow temporally and increase the money you have on hand at will. A rich person can translate portions of their future earnings into large amounts of capital on command, and this can come in the form of future anticipated earnings too (e.g., future anticipated rents or sales) while still being able to live on a day-to-day basis. Being able to control your current and future finances can also provide tax benefits if structured correctly.
Poor people can't do that - they need all of their cash now just to live, all the time.
I would phrase it more as a powerful tool if you are financially literate and have a predictable income (especially if it's predictable with confidence to a lender), something which is generally more true of high-income people. Debt (when appropriately priced) allows you access things that you would otherwise need to wait to afford, allowing saving money vs. renting said thing, or the time-value to you of the length of that wait (whether it's through directly financially benefitting from that thing, or from simply whatever utility you are getting from that thing, or both, like buying a more expensive car which saves you money on fuel and maintenance as well as just being nicer to drive). It's dangerous when your income is not predictable (because it means that debt is more expensive for you as well as more personal risk), or if you are forced into debt for necessities that are beyond your means, or if you are financially illiterate, all of which can mean you take on debt beyond your means, which quickly becomes exploitative.
(That latter part can happen even with very high incomes. It's not unheard of for e.g. professional sports players or celebrity actors making millions to take on way too much debt and ruin themselves, especially because their high income can disappear quickly, e.g. due to an injury)
reply