Bitget App
Trade smarter
Buy cryptoMarketsTradeFuturesEarnSquareMore
Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Bitget-RWA2025/10/23 16:33
By:Bitget-RWA

As the demand for AI infrastructure skyrockets, organizations are under increasing pressure to maximize the inference output from their available GPUs. For those with specialized knowledge in certain methods, this environment presents an excellent opportunity to secure investment.

This is one of the main reasons behind the emergence of Tensormesh, which has just come out of stealth mode after raising $4.5 million in seed capital. The round was headed by Laude Ventures, with additional backing from angel investor and database innovator Michael Franklin.

Tensormesh intends to use these funds to develop a commercial offering based on the open-source LMCache tool, which was created and is maintained by co-founder Yihua Cheng. When implemented effectively, LMCache can cut inference expenses by up to a factor of ten—a capability that has made it popular in open-source projects and attracted collaborations with major players like Google and Nvidia. Now, Tensormesh aims to transform its academic achievements into a sustainable business.

At the core of this technology is the key-value cache (KV cache), a memory architecture that streamlines the processing of complex inputs by summarizing them into key values. In most conventional systems, the KV cache is discarded after each query, but Tensormesh CEO Juchen Jiang believes this practice leads to significant inefficiency.

“It’s comparable to a brilliant analyst who reviews all the information but forgets everything after answering each question,” explains Tensormesh co-founder Junchen Jiang.

Rather than deleting the cache, Tensormesh’s approach preserves it, making it available for reuse when the model encounters a similar task in a future query. Since GPU memory is a limited resource, this often involves distributing data across multiple storage solutions, but the payoff is a substantial boost in inference capacity without increasing server demands.

This improvement is especially impactful for chat-based applications, where models must repeatedly access an expanding conversation history. Agentic systems face a similar challenge, as their logs of actions and objectives continually grow.

While, in principle, AI firms could implement these changes themselves, the technical hurdles make it a formidable undertaking. Given the Tensormesh team’s expertise and the complexity involved, the company is confident there will be strong interest in a ready-made solution.

“Storing the KV cache in secondary storage and reusing it efficiently without degrading system performance is a tough technical challenge,” Jiang notes. “We’ve observed teams hiring dozens of engineers and spending several months to build such a system. Alternatively, they can leverage our product and achieve the same results much more efficiently.”

0

Disclaimer: The content of this article solely reflects the author's opinion and does not represent the platform in any capacity. This article is not intended to serve as a reference for making investment decisions.

PoolX: Earn new token airdrops
Lock your assets and earn 10%+ APR
Lock now!

You may also like

Ethereum News Update: Amundi’s Integrated Approach Connects Blockchain with Conventional Financial Regulations

- Amundi, Europe's largest asset manager, launched its first Ethereum-based tokenized money-market fund, enabling 24/7 settlements and transparent record-keeping via blockchain. - The hybrid model, developed with CACEIS, combines traditional fund operations with blockchain-based ownership, preserving regulatory compliance while expanding investor access. - Ethereum's dominance in stablecoin and RWA transfers ($105.94B in 30 days) underscores its role in accelerating tokenization, with Amundi positioning it

Bitget-RWA2025/11/28 17:06
Ethereum News Update: Amundi’s Integrated Approach Connects Blockchain with Conventional Financial Regulations

XRP News Today: XRP ETFs Drive Price Increases, While Solana ETFs Ease Selling Pressure

- XRP ETFs raised $587M in inflows since late November, outpacing Solana's $568M as investors favor altcoins with regulatory clarity and utility. - Bitwise XRP ETF's $107M debut and zero-fee strategy drove momentum, while Solana ETFs faced $156M weekly outflows due to network reliability concerns. - XRP's inflows acted as a "battering ram" pushing prices above $2.27, contrasting Solana's ETFs which merely dampened sell pressure without reversing its decline. - Analysts predict XRP could reach $3 by Decembe

Bitget-RWA2025/11/28 17:06
XRP News Today: XRP ETFs Drive Price Increases, While Solana ETFs Ease Selling Pressure

The Federal Reserve's Change in Policy and Its Impact on Alternative Cryptocurrencies Such as Solana

- Fed's 2025 policy shifts, including rate cuts and stablecoin regulations, are reshaping altcoin markets by altering liquidity and risk appetite. - Solana's Alpenglow upgrade (150ms finality, 1M TPS) addresses scalability issues, aligning with Fed's AI-driven infrastructure focus despite network reliability concerns. - Institutional inflows into Solana ETFs ($100M AUM) contrast with retail caution (78% HODLers in red), highlighting divergent risk perceptions amid 30% price corrections. - Divergent ETF flo

Bitget-RWA2025/11/28 17:06
The Federal Reserve's Change in Policy and Its Impact on Alternative Cryptocurrencies Such as Solana

Avail's Intent-Driven Nexus Addresses the Issue of Fragmented Liquidity Across Chains

- Avail launches Nexus Mainnet, a cross-chain solution unifying liquidity across Ethereum , Solana , and EVM networks. - The intent-solver model enables seamless asset transfers without technical complexities, streamlining user experiences. - Developers gain modular tools for multichain integration, reducing costs as cross-chain liquidity demand grows. - Nexus abstracts execution layers, offering unified balances and execution while addressing fragmentation challenges. - With $50B+ in cross-chain activity

Bitget-RWA2025/11/28 16:46
Avail's Intent-Driven Nexus Addresses the Issue of Fragmented Liquidity Across Chains