Composable infrastructure agency Liqid has created a cheap and scalable answer for organizations seeking to deploy high-performance inference capabilities of their knowledge facilities.
Unveiled at Dell Applied sciences World 2024, the UltraStack 30 crams a whopping thirty Nvidia L40S GPUs right into a single Dell PowerEdge R760 server.
Liqid beforehand launched a technical whitepaper for its UltraStack server at Nvidia GTC 2024 and at the moment it had solely managed to jam as much as 20 Nvidia L40S right into a PowerEdge server, in order that’s fairly a leap in a brief period of time.
AMD and Intel assist coming
Nvidia L40S GPUs have fewer cores and are usually much less highly effective than Nvidia’s H100 and A100 accelerators, in addition to the newer Blackwell GB200 and B200 programs. Nevertheless, they’re well-suited for quite a lot of high-performance duties, together with AI, knowledge analytics, and 3D rendering. This makes them a flexible selection for contemporary knowledge facilities {and professional} workloads, and they’re cheaper too. L40S usually price $7,000 to $8,000, in comparison with H100s which may go for $25,000 to $30,000.
The UltraStack 30 provides enhanced enterprise-level GPU infrastructure capabilities and builds on earlier options, with enhancements in operations per second and complete price of possession in comparison with comparable GPU density options. It additionally boasts an vitality environment friendly design able to delivering high-performance whereas decreasing energy consumption and operational prices.
That is simply the beginning, and the corporate has massive plans for the UltraStack 30. Sumit Puri, Liqid co-founder and chief technique officer, famous, “As we transfer ahead, we acknowledge that optimum reminiscence bandwidth will probably be essential for maximizing efficiency. This is the reason composableCXL (Compute Categorical Hyperlink) is on the horizon at Liqid, promising to additional improve our capabilities in delivering high-performance, low-latency options.”
Blocks & Recordsdata provides, “Our understanding is that Liqid can assist GPUs and different accelerators from suppliers corresponding to AMD and Intel. Additionally it is conscious of the potential for advertising and marketing its SmartStack and UltraStack applied sciences to MSPs that want to provide GPUs for lease.”
