News/Computing
Amazon is Ramping Up Infrastructure Spend to Meet Surging AI Demand
Amazon is doubling down on its AI infrastructure investments as demand soars, signaling the company's ambition to become a dominant player in the rapidly growing AI market. Scaling up AI capacity: AWS CEO Andy Jassy emphasizes the need for more AI infrastructure to meet the surging demand for AI services: Despite already making significant investments in AI, Jassy admits that AWS needs even more capacity to keep up with the current demand. The CEO's remarks underscore the immense potential and growth trajectory of AWS' AI business, which he believes will become a substantial revenue driver for the company. AWS' AI...
read Aug 2, 2024Not All Semiconductor Firms Are Benefitting from the AI Boom
The boom in artificial intelligence (AI) is not benefiting all semiconductor firms equally, as recent earnings reports highlight the complexities and dominance of certain companies in the chip supply chain. Winners in the AI boom: Companies like Nvidia and AMD are reaping the rewards of tech giants' increased spending on computing resources for training large language models (LLMs) and developing generative AI applications: Nvidia's graphics processing units (GPUs) are widely used for training LLMs, leading to a significant boost in the company's revenue. AMD's new MI300X AI chip is gaining traction, with the company expecting data center GPU revenue to...
read Aug 1, 2024GenAI Strains Data Centers, Highlights Urgent Need for Modernization
The rapid rise of generative AI is straining data centers and driving urgent modernization efforts, while budgets remain tight. As CIOs rush to bring genAI capabilities online, they face the daunting challenge of providing the immense power, cooling, and processing required to support these demanding workloads. The staggering energy demands of genAI: The scale of resources needed to support genAI is hard to comprehend, with ChatGPT alone estimated to consume enough daily energy to power 33,000 US homes. Data centers accounted for 4% of US energy consumption in 2022, and this figure is projected to reach 6% by 2026, according...
read Aug 1, 2024TikTok Spending $20M Monthly on Microsoft Cloud AI
TikTok emerges as a major customer of Microsoft's AI cloud services, with potential implications for the AI industry and Microsoft's financials. TikTok's reliance on Microsoft's AI: As of March, TikTok was paying Microsoft nearly $20 million per month to access OpenAI's models, making it one of the largest customers of Microsoft's AI cloud computing services. TikTok's payments to Microsoft accounted for almost a quarter of the revenue generated by Microsoft's increasingly profitable cloud division. Microsoft's cloud AI business was on track to earn $1 billion in annual revenue, highlighting the growing importance of AI services in the company's portfolio. ByteDance's...
read Jul 31, 2024Here are the Features Acer Just Integrated into its New AI Computers
Acer introduces a range of AI-powered features in its laptops to enhance user experience and productivity. These features leverage AI technologies to improve everyday computing tasks, video conferencing, and personalization. Smarter digital assistance with Copilot: Acer AI-powered laptops come with Microsoft Copilot, a part of the latest Microsoft Windows operating system, which offers advanced digital assistance: Copilot can answer queries, draft emails and messages, and even create images from simple text prompts. It also integrates with other apps, including Microsoft's Edge Browser to summarize entire web pages, boosting productivity. Enhanced video conferencing with Acer PurifiedView and PurifiedVoice: Acer's AI-powered features...
read Jul 31, 2024Samsung Q2 Profit Soars on Rising AI Chip Demand
Samsung's Q2 earnings surpass expectations, driven by strong AI memory chip demand and smartphone sales, signaling the company's resilience amidst industry challenges. Robust financial performance: Samsung Electronics reported impressive second-quarter results, exceeding analysts' estimates for both revenue and operating profit: Revenue reached 74.07 trillion Korean won (approximately $53.45 billion), surpassing the average estimate of 73.74 trillion Korean won. Operating profit soared to 10.44 trillion Korean won, significantly higher than the average estimate of 9.53 trillion Korean won, representing a staggering 1,458.2% increase from the previous year. Strong demand for AI memory chips: Samsung attributed its strong performance to robust demand...
read Jul 28, 2024AMD’s Ryzen AI Chips Impress, Intensifying Laptop AI Arms Race
Key Takeaways: AMD's new Ryzen AI 300 series processors, seen first in the Asus Zenbook S 16 laptop, deliver impressive performance across productivity tasks, graphics benchmarks, and advanced AI workloads, positioning AMD as a strong contender in the AI laptop market. A Closer Look at the AMD Ryzen AI 300 Series: The new chips feature several architectural upgrades aimed at AI performance: The 4nm process node allows higher transistor density for speed and efficiency improvements The "Zen 5" CPU cores provide a 16% boost in instructions per cycle and up to 12 high-performance cores The RDNA 3.5 integrated GPU delivers...
read Jul 26, 2024IBM Says Quantum Computing May Solve AI’s Energy and Cost Crisis
The exponential growth in AI training costs is raising sustainability and equity concerns, but quantum computing may offer a solution. The AI training cost problem: The rapid increase in AI usage is driving up energy consumption and costs, which could surpass the US GDP by 2030 and limit AI's potential if left unchecked. ChatGPT queries consume at least 10 times more energy than Google searches, contributing to the unsustainable growth in AI's energy footprint. By 2030, the cost to train a single AI model once could exceed worldwide IT spending, creating a hard ceiling for the technology's development and accessibility....
read Jul 25, 2024Elon Musk’s xAI Claims “Memphis Supercluster,” Will Be World’s Most Powerful AI by 2024
Elon Musk announces launch of xAI's "Memphis Supercluster," claiming it will be the world's most powerful AI training system by the end of 2024, but questions remain about the facility's power consumption and local impact. Ambitious claims and technical details: Musk took to X (formerly Twitter) to share that xAI, in collaboration with X and Nvidia, has begun training on a massive supercomputer cluster in Memphis, Tennessee, with the goal of developing the world's most powerful AI by every metric by December 2024: The "Memphis Supercluster" features 100,000 liquid-cooled Nvidia H100 GPUs on a single RDMA fabric, which Musk claims...
read Jul 24, 2024Lambda Launches On-Demand H100 GPU Clusters, Democratizing AI Training Access
Key details: Lambda, a GPU cloud company, is launching 1-Click Clusters that provide on-demand access to Nvidia's powerful H100 GPUs and Quantum 2 InfiniBand clusters: The service targets companies that need to train AI models for shorter periods and cannot afford long-term GPU contracts. Customers can reserve 2 to 64 nodes on the Lambda cluster for a minimum of two weeks, with pricing depending on the number of nodes and time period required. Lambda's offering focuses on AI model training, unlike cloud providers like AWS and Azure that primarily support AI inference. Addressing a market need: The new service aims...
read Jul 24, 2024Quantum Transistors Secures $19M to Make Quantum Computing Accessible and Scalable
Quantum Transistors, a Tel Aviv-based developer of advanced quantum processors, has secured a substantial $19 million investment from the European Innovation Council (EIC) to further its mission of making quantum computing more accessible and scalable. Landmark investment validates Quantum Transistors' vision: The EIC's investment, comprising a $2.7 million grant and a future equity investment of $16.3 million, is a strong endorsement of Quantum Transistors' innovative approach to quantum computing: Quantum Transistors aims to leverage the trillions invested in the semiconductor industry to build a scalable quantum technology, making it more accessible to everyone. CEO Shmuel Bachinsky likened the company's goal...
read Jul 22, 2024DOE Launches $12B AI Initiative for Science, Energy, and Security Breakthroughs
The Department of Energy (DOE) has unveiled a $12 billion, five-year road map to develop integrated scientific AI systems, aiming to advance scientific discovery, energy solutions, and national security applications. Key focus areas of the FASST initiative: The Frontiers in Artificial Intelligence for Science, Security and Technology (FASST) project will establish a network of AI research clusters utilizing DOE's computing infrastructure, focusing on four main pillars: Data: Developing methods, platform protocols, and tools for efficient and safe aggregation and distribution of AI training datasets. Computing Infrastructure and Platforms: Developing and deploying next-generation AI computing platforms and infrastructure such as testbeds...
read Jul 22, 2024xAI Powers Up Massive Memphis Supercomputer, Sparking Local Excitement and Environmental Concerns
Elon Musk's xAI startup has powered up a massive supercomputing facility in Memphis, Tennessee to train its next AI model, Grok, with over 100,000 Nvidia H100 GPUs, sparking both excitement and concerns among locals. Key details about xAI's Memphis supercomputing cluster: The facility, dubbed the "Gigafactory of Compute," is now operational and began training models at 4:20am local time on Monday morning, according to Musk. It leverages 100,000 liquid-cooled Nvidia H100 GPUs on a single RDMA fabric, which Musk touts as "the most powerful AI training cluster in the world." The H100 GPUs are designed specifically for training large AI...
read Jul 21, 2024Qualcomm Hopes to Boost AI App Development By Making Its Models Available to Developers
Qualcomm makes its AI models available to app developers, empowering them to create AI-enabled applications that harness the capabilities of the company's powerful Hexagon neural processing unit (NPU) in its Snapdragon X Elite platforms. Simplifying AI development for Snapdragon X Elite: Qualcomm has made its trained AI models, optimized for the 45 TOPS Hexagon NPU, accessible to registered software developers through its AI Hub: The AI Hub offers a variety of models for tasks such as image classification, object detection, semantic segmentation, and generative AI, which can be easily deployed in applications like vision, audio, and speech. Developers can filter...
read Jul 18, 2024Bitcoin Miners Pivot to AI: The New Frontier in West Texas
The race to power AI is accelerating, with bitcoin miners in West Texas shifting their focus to meet the growing demand for artificial intelligence infrastructure: Lancium and Crusoe Energy Systems announced a multibillion-dollar deal to build a 200-megawatt data center near Abilene, Texas, designed to cater to the unique needs of AI companies, with plans to expand to 1.2 gigawatts. At full capacity, this will be one of the largest AI data center campuses in the world, underscoring the rapid evolution of data centers to support modern AI workloads. Bitcoin miners embrace AI: Following the recent bitcoin halving, which has...
read Jul 18, 2024NTT Data Unveils Edge AI Platform to Accelerate Real-Time Decision-Making Across Industries
NTT Data, the IT infrastructure and services subsidiary of Japan's NTT, has unveiled its new Edge AI platform to accelerate AI processing at the edge, enabling real-time decision-making and enhanced operational efficiencies across industries. Key features and benefits of NTT Data's Edge AI platform: The fully managed solution processes data where it is generated, unifying diverse IoT devices, systems, and data into a single data plane: It addresses the challenge of processing massive data sets on compact computing platforms by using smaller, more efficient machine learning models to deliver real-time AI insights. The platform includes all the necessary systems, tools,...
read Jul 17, 2024HP Unveils AI Computers, Intensifying Tech Hardware Battle
HP's new AI-powered computers are set to intensify competition in the tech hardware market as companies race to integrate artificial intelligence capabilities into their products. Key details of HP's AI computer launch: HP has announced plans to release "the world's highest performance AI PC," positioning itself at the forefront of the AI hardware battle: The new computers feature an advanced chip capable of running AI commands without an internet connection, aimed at enhancing productivity in the workplace. Notable features include a camera that tracks the user's face during meetings, an on-device AI "companion," and the ability to build a searchable...
read Jul 16, 2024Microsoft CTO: AI Progress to Continue Despite Skepticism, Powered by Scaling Laws
Microsoft CTO Kevin Scott believes AI progress will continue despite skepticism, arguing that large language model (LLM) "scaling laws" will drive breakthroughs as models get larger and have access to more computing power. Scaling laws and AI progress: Scott maintains that scaling up model size and training data can lead to significant AI improvements, countering critics who argue that progress has plateaued around GPT-4 class models: He acknowledges the challenge of infrequent data points in the field, as new models often take years to develop, but expresses confidence that future iterations will show improvements, particularly in areas where current models...
read Jul 15, 2024AMD Reveals New AI Chips With 35x CPU Performance
AMD unveils next-generation AI PC architecture with powerful new NPUs and Zen 5 CPUs, aiming to lead the AI computing era. Key details of AMD's AI PC architecture: AMD executives revealed the company's latest AI PC architecture, which includes a new neural processing unit (NPU) in the AMD Ryzen AI chips, offering significant performance improvements over CPUs and integrated GPUs: The NPUs in AMD's Ryzen AI processors can operate on AI models at 35 times the performance per watt of a standard CPU and achieve eight times the performance of an integrated GPU. The third generation of AMD Ryzen AI...
read Jul 15, 2024HP’s AI-Powered Computers Raise the Bar for PC Performance
AMD and HP team up on powerful new OmniBook Ultra laptop: AMD has partnered with HP to develop a custom Ryzen AI 300-series processor with a boosted Neural Processing Unit (NPU) for HP's latest flagship laptop, the OmniBook Ultra: The custom AMD chip is rated for 55 trillion operations per second (TOPS) of AI performance, a significant increase over AMD's recently announced 50 TOPS Ryzen AI 300-series processors. This makes the OmniBook Ultra the "world's fastest AI PC" for now, with HP claiming a 44% AI performance advantage over Apple's M4 chip and 3x faster response times in AI chatbots....
read Jul 12, 2024Windows 12 Rumors: AI Boost, Modular Core, and Floating UI Spark Intrigue
Microsoft's next major Windows release, colloquially referred to as Windows 12, is generating buzz despite not being officially announced yet. More AI-powered features and modular system design are just a couple of the leaks and rumors swirling around the anticipated operating system. Release timeline remains uncertain: While Microsoft has not definitively confirmed Windows 12 development, clues suggest it could arrive sometime in 2025: Microsoft recently moved to an annual feature update cadence for Windows, with the next logical release window for a major version being around September or October 2025. This timeline would coincide with the end of support for...
read Jul 12, 2024Qualcomm Exec: On-Device AI Will Revolutionize PCs And Enhance Privacy
The Qualcomm executive Nitin Kumar outlined the company's vision for AI-powered PCs at VentureBeat's Transform 2024 conference, highlighting Snapdragon processors' capabilities and the potential for on-device AI to drive innovation and reshape personal computing. Qualcomm's edge in AI PCs: Kumar emphasized Snapdragon processors' ability to deliver robust performance without compromising battery life, thanks to their integrated high-performing NPU and tight integration with Windows and Microsoft's ecosystem. Qualcomm's latest Snapdragon X series processors feature a 45 TOPS NPU, enabling local execution of complex AI models like Meta's 7 billion parameter Llama model without relying on the cloud. The company's AI Hub...
read Jul 12, 2024Japan is Building a $1B AI Supercomputer with NVIDIA
The Japan National Institute of Advanced Industrial Science and Technology (AIST) is significantly enhancing its AI research capabilities with the development of the AI Bridging Cloud Infrastructure 3.0 supercomputer (ABCI 3.0), powered by NVIDIA H200 GPUs and Quantum-2 InfiniBand networking. Advancing Japan's AI sovereignty and competitiveness: AIST, one of Japan's largest public research organizations, is upgrading to ABCI 3.0 to bolster the country's AI research and development capabilities: The initiative is part of a $1 billion investment by Japan's Ministry of Economy, Trade and Industry (METI) to strengthen computing resources and support cloud AI computing. ABCI 3.0 aims to enhance...
read Jul 11, 2024Super Micro Poised for Upside, Wells Fargo Says
Super Micro Computer poised for upside preannouncement, according to Wells Fargo: Super Micro, a server company and AI play, could issue a positive announcement ahead of its early August earnings for its fiscal fourth quarter, potentially offsetting its third-quarter revenue miss. Wells Fargo analysts, led by Aaron Rakers, note that Super Micro has historically either preannounced or published its earnings release date around 19 days after the close of its quarterly results. Improved investor sentiment and the stock's valuation boost optimism for a possible upside preannouncement late next week. Super Micro's shares have more than tripled this year, climbing 215%,...
read