Cloud computing is operated by an anti-competitive oligopoly, says Osuri

Akash acts as an open and transparent marketplace for computing power, Osuri says

article-image

Alan Poulson Photography/Shutterstock modified by Blockworks

share

The cloud.

It’s a fabric that connects people in ways that were impossible just a few years ago — and we all pay for it.

“All of us pay a ‘cloud tax,’” Greg Osuri says. “We just don’t realize it.” According to Osuri, 50% of online subscription fees, for example, end up in the pockets of cloud providers.

On the 0xResearch podcast (Spotify/Apple), the founder and CEO of Overclock Labs and core contributor to Akash says that the cloud “keeps a modern society together.”

Cloud technology brings incredible value by enabling “amazing services for us and storing our data” but users have little to no control over this “invisible layer” of society, he says.

Osuri explains that this lack of individual control results in “uncontrollable costs, selective innovation, sometimes extremely anti-competitive practices and essentially, an oligopoly” that persists behind the scenes.

“That’s the current state of the cloud — an extremely important layer that is extremely opaque.”

A computing power marketplace

The goal of Akash, a decentralized computing network built on Cosmos, is to “reverse that opacity,” Osuri says. It seeks to create an “open, transparent, permissionless layer [so] that all of us have a degree of ownership and a degree of sovereignty.”

Akash acts as a marketplace that matches users with providers who might otherwise be sitting on idle computing power. Osuri explains that, at its core, it is a “super cloud,” that aggregates computing resources across a range of public and private providers and offers “a federated access point.”

Users get access to providers by leasing services in an “open setting,” he says, typically using a reverse auction mechanism. “You specify your needs and you specify what you’re willing to pay and providers bid on it.”

One key advantage of Akash, Osuri points out, is that “you have a degree of concentration of computational power where [it] has been traditionally hyper-fragmented.”

As of now, Akash is experiencing “near 100% utilization for high density GPUs,” Osuri says, “and about 50% utilization cumulative for all resources, all types of GPUs, including the low end GPUs.” 

That’s quite a bit higher utilization than pretty much anything else out there in crypto, Osuri says. “Traditionally, crypto has been good at oversupply and less demand. Here, we have the opposite problem: high demand and less supply, or supply that’s not yet on the market.”

Most demand for computing power right now is for high-end H100 chips and “data center grade homogenous hardware,” Osuri says — equipment that powers AI apps like ChatGPT. 

“Every time you hit a prompt in ChatGPT, the time it takes to come back, it requires one H100 per concurrent user for that time,” Osuri explains. “Now, do the math. 100 million users. All of them at the same time.”

“That’s impossible,” he says. “They have to prioritize the H100 time based on how many concurrent users they want to support and that dictates how fast the application works.”

“More users, less chips means slower. More chips, less users means faster.”

Mixing things up

Osuri mentions one team that is working with a broader mix of chipsets for “heterogeneous” computing power. “You can train on a 4090 and H100 at the same time, leveraging the compute power from each of those chips,” he says.

“There are lots of teams working on it,” he says, adding that at some point in time in the near future, idle home gaming PCs and consoles might even be able to provide computing power to the marketplace.

As of now, Osuri says that most demand for the Akash service comes from machine learning developers looking for on-demand A100, H100 or A6000 chipsets. 

“There is no place right now on the cloud where you can get on-demand access to 100’s,” he says. “Amazon, Google, Microsoft do not have A100s or H100s.”

Read more: Don’t give your life to Big Tech for free

Osuri reiterates that the Akash marketplace operates as a free market, with low demand resources costing around 80% less than they would via traditional services like AWS. On the flip side, high demand services like H100s are more expensive than what one would normally expect to pay.

“We don’t have any control over price,” he says. “It is a free market that sets the price.” 

Osuri explains that Overclock Labs might provide guidance regarding pricing, “but we don’t dictate what the price should be. And we never will. And that’s critical for the protocol to function.”

“We need to learn how to deploy these models on a decentralized network versus a centralized network,” he says. “It’s always been centralized because that was the only option.”

“For the first time, we actually have a viable decentralized option.”


Don’t miss the next big story – join our free daily newsletter.

Tags

Upcoming Events

Hilton Metropole | 225 Edgware Rd, London

Mon - Wed, March 18 - 20, 2024

Crypto’s premier institutional conference returns to London in March 2024. The DAS: London Experience: Attend expert-led panel discussions and fireside chats Hear the latest developments regarding the crypto and digital asset regulatory environment directly from policymakers and experts.

Salt Lake City, UT

WED - FRI, OCTOBER 9 - 11, 2024

Pack your bags, anon — we’re heading west! Join us in the beautiful Salt Lake City for the third installment of Permissionless. Come for the alpha, stay for the fresh air. Permissionless III promises unforgettable panels, killer networking opportunities, and mountains […]

recent research

Research report - cover graphics (1).jpg

Research

In this report, we dive into crypto private market data to gather insights on where the future of the industry is headed. Despite a notable downturn in private raises, capital continues to infuse promising projects that aim to transform payments, banking, consumer experiences, community, and more, with 2023 being the fourth-largest year for crypto venture capital.

article-image

BUZZ holds shares of Coinbase, Robinhood and MicroStrategy

article-image

Opinion: Even though I didn’t pay for my “Diamond Hands” burger with BTC, don’t let that fool you into thinking that crypto’s development is futile

article-image

The results mark “a major positive inflection point,” one analyst says, as the exchange carries net income momentum into a crypto rally

article-image

While the slate of 10 US spot bitcoin funds have tallied $4.6 billion of net inflows thus far, half of the field is lagging the leaders

article-image

Trading volumes totalled $154 billion in Q4, including $125 billion in institutional volume

article-image

DeFi on Bitcoin is all the rage right now and Stacks is positioned to benefit