Inference is generally done on CPUs, but there's many situations where it can't be done on CPUs efficiently. LLMs like GPT-3/GPT-4 would have too high latency with CPUs to be used in somewhat real-time like with ChatGPT.
LLMs use high-end GPUs like the A100 and H100, as well as high-end dedicated AI accelerators like the TPU for their inference. Weaker GPUs like the T4, while faster than CPUs, don't have sufficient memory capacity for the huge sets of parameters and weights, which leads to storage bottlenecks.
Definitely impressive to see these models running on CPUs though.
I've been playing around with 4-bit LLaMa-13b on GPU, but I'm curious to see how my 5800X3D performs. Will see if I can get it running later tonight.
Pretty interesting timelines.
Intel @ Morgan Stanley Technology, Media and Telecom conference
ZINSNER: We’ll have a falloff in market share in the [2023] first quarter. We are expecting that to stabilize through the year – I would not call that victory. I would call that ‘we’re slowing down the share loss,’”
AMD Q422 ER
SU: If you think about when we went from Rome to Milan, it was basically similar platforms. So I would say that that ramp was a bit faster.
SU: So as we think about the Zen 4 ramp and the crossover to our Zen 3 ramp, it should be toward the end of the year, sort of in the fourth quarter
The stabilization Intel hopes to see here is really just a brief respite as AMD transitions to 4th gen EPYC.
Genoa ramp will be a bit slower than Milan due to the platform transition. No problem, SPR ramp doesn't seem much faster than ICL which explains why they only expect stabilization over actually retaking share.
Like Sapphire Rapids, the next-generation Emerald Rapids will be made on Intel 7.
Emerald Rapids will be more of a bridge to the difference-making chips released in 2024, but it will not stop the market-share loss the company is taking from AMD.
Like the article says, Emerald Rapids won't stop the share loss. Intel 7 ramp is too painful. Zen 4 will hit its stride in Q4 and take the baton from Zen 3.
With Intel still on Intel 7 for much of 2024, the knife will be pushed deeper and Intel will have another steep market share falloff.
Bergamo and Siena should be ramping strongly going into 2024.
Intel hopes that Intel 3-based Sierra Forest and Granite Rapids will ramp soon enough in 2024 to make a difference. Zen 5 is probably late 2024.
I really, really don't think Intel 3 can ramp soon enough in 2024. Fourth gen EPYC will be cutting deep by then. Resistance from Intel might be visible in Q4, but until then, there will be another year and a half of losses from Intel. Can they regain customer trust that quickly?
Also has zero support should you get a lemon. Just look at the discord and subreddit of the countless people stuck with bricks. Who wants to gamble 1k on a shiny paperweight. These major outlets really need to stop pushing aya, gpd and oxp
I wonder what happened to Alienware's handheld.
still nothing about bergamo?
That'll be later in the year, same with Siena.
Dead Island had some fun to it but i found the game gave me a headache playing it. Not sure if the FOV was too narrow but it was almost motion sickness.
3rd person mode could have helped you out, but uhh...
I had no crashes and that's on a 7900 XTX (pretty rough drivers right now). I was taken back by how smooth it ran and how amazing it looked; honestly felt like a real step into where graphics SHOULD be for games now.
RE Engine loves AMD GPUs.
I guess fruits from Capcom's partnership with AMD.
I think either this year or next year is supposed to be peak sales based on previous gens.
Was there a sequential decline last year?
Yes
Vushivushi
u/Vushivushi · 11yKarma
Cake day
Trophy Case (5)
Ten-Year Club
Place '22
