I.e. not a net-productive member of society? Fun fact, machines are taking everything over, so you and any "healthy children" may be in that same camp very soon. IMO, anyone capable of living happily while being outcompeted by machines is well-adapted for the future.
I'm not; average Down's Syndrome folks seem to be.
If this is the true cost of AI then the future might be dedicated extension cards for computers that hardcode entire models + weights.
Downside: you need to buy a new one for each model.
Upside: insanely fast inference and zero subscription cost, only one time purchase cost.
Once a certain open source model gets good enough this might become viable.
Right now the landscape is still shifting too fast.
State of the art models might remain on subscription, expensive and might be used by large companies only.
State of the art companies might also create their own hardware with hard-baked weights on chip that they don't release to the public, as it might just make more financial sense long term once they "stabilize" on a certain model.
I would shell out cash right now for something like Opus on silicon, like what Taalas [0] has built for Llama 3.1.
Having lightning-speed, local inference of a super high-quality model would be incredible. If you haven't played with it, check out Taalas's demo [1].
Honestly, though - I have my doubts. Recurring revenue is just too nice to pass up; I'm sure AI companies wouldn't want me buying a dedicated Opus card and not giving them money for several years until there's something worth upgrading to.
Recurring revenue does you no good if it is in fact a recurring loss because your subscription customers use up more than you're charging them.
Of course expecting the metaphorical Harvard Business School analysts to realize that is asking a lot. Subscriptions are Good and Goodness is Subscriptions, and like any other mass of people following trends the preconditions on when subscriptions are good for a business tend to get lost in the frenzy.
If local AI can make financial sense, then cloud AI will make even more financial sense - an AI card can serve a number of users simultaneously, can be utilized 24x7 instead of however many hours per week you use it, and has other improved efficiencies at scale. Cloud offerings with privacy and security controls will be available for those who want it, just like non-AI cloud offerings with security/privacy options are available today.
This seems rather optimistic. Tons of subscriptions people pay for would be cheaper/better locally, but they want turnkey and to set it then forget it.
The name of the game with businesses right now is also subscriptions. Hell look at Microsoft. The incentives are not there to let you pay a one time cost for some hardware.
Any kind really. If Apple can lock down the CPU of an iPhone, then I'm sure it is possible to lock down an LLM chip. The business model may then be that you can buy certain "agent apps" and run them on your LLM card. But I have to stop here because I don't want to give anyone any ideas though I'm sure they are "creative" enough.
IP-protected models manifested directly in silicon.
Everything we’re using now is the equivalent of building a GPU on an FPGA: the hardware is general purpose at one abstraction level, and that comes with inefficiency at the next layer up. Collapse the levels, gain efficiency at the cost of generality.
The whole premise of what's being described here is to bake the weights into the silicon. That isn't what I'd describe as vendor lock-in, any more than I'd describe a CPU that can only execute ARM instructions as vendor locked.
To answer my own question, I bet they could figure out a way to still bill you per-token, if they wanted to.
Portability between x86 and ARM is not a form of vendor lock?
And of course they could bill per-token, same way cable PPV worked (the bits were already in your house). But the cost structure of weights in silicon means that competitors would be encouraged to compete on this per-token cost, as their marginal cost would be zero.
I don’t see that being a durable business model, but I guess the counter argument is it’s also similar to game consoles, where initial hardware is subsidized and the business model assumes ongoing payment for bits.
Some recent studies have shown that a properly implemented LVT avoids harming most homeowners, in fact you may come out ahead if other taxes are eliminated. (LVT alone is adequate to fund government spending and entitlements.) The homeowners who will typically feel a pinch are those who have inherited very large estates which don’t generate income. They may need to sell or develop part of their estate.
Land speculators, however, will be in serious trouble.
The funnier part is that people are being let it without the gov crosschecking their identity with the government they are from and just being like "yeah you look ok, come in".
It's part of the scam, they actually want the AfD to later have that power so that they can say "Hey, look at what these fascists are doing, vote us back with urgency to prevent more fascism".
Win-win for the CDU/CSU and the AfD, the CDU gains power and has a boogeyman to use to scare voters into voting for them.
You destroy the life of the family and greatly make the lives of healthy children harder.
Why would you sacrifice your healthy children for one who has no real future?
Complete inversion of common sense.
reply