News/Computing
How Andreessen Horowitz is enabling startups to cheaply access computing power
The GPU Crunch and Its Impact on Startups: The rapid growth of AI has led to a shortage of GPUs, creating challenges for startups competing against larger, better-funded companies for access to these critical resources. The competition for GPU access has favored large incumbents who can afford to outbid startups and commit to long-term contracts. Startups faced the risk of being stuck with expensive, long-term GPU commitments that might not align with their actual needs or budgets. The market rate for short-term GPU capacity increased by 3-4x from late 2020 to mid-2023, making it difficult for startups to access the...
read Oct 22, 2024Why the next battleground in tech will be operationalizing AI at the edge
The AI edge computing revolution: As organizations increasingly embrace AI and machine learning, the focus is shifting toward operationalizing AI at the edge and far edge, presenting both challenges and opportunities for technology leaders. The rapid growth in AI workloads is putting immense pressure on data centers, driving the need for more powerful and efficient infrastructure solutions. Edge computing is emerging as a key trend across industries, with predictions suggesting that by 2025, 75% of enterprise-generated data will be created and processed outside traditional data centers or the cloud. The push towards edge AI is driven by the need for...
read Oct 20, 2024Engineers claim new algorithm reduces AI power consumption by 95%
Breakthrough in AI energy efficiency: Engineers at BitEnergy AI have developed a new algorithm that could potentially reduce AI power consumption by up to 95%, marking a significant advancement in artificial intelligence processing technology. The new method, called Linear-Complexity Multiplication (L-Mul), replaces complex floating-point multiplication (FPM) with simpler integer addition while maintaining high accuracy and precision. This development addresses the growing concern of AI's increasing energy demands, which have become a primary constraint on AI advancement. Technical details and implications: The L-Mul algorithm represents a fundamental shift in how AI computations are performed, with far-reaching consequences for the industry and...
read Oct 17, 2024Why CIOs must start paying more attention to edge computing
The convergence of AI and edge computing: Enterprise AI is poised to drive the development of autonomous systems, with edge computing playing a crucial role in enabling faster decision-making and reduced data transfer costs. Analysts predict that 75% of CIOs will increase their AI budgets this year, reflecting the growing importance of AI in enterprise strategies. Edge computing, which processes data closer to its source, is expected to become more widespread by 2025 as AI and Internet of Things (IoT) technologies continue to expand. CIOs are planning to implement AI on the edge by 2025 to enhance operational intelligence and...
read Oct 16, 2024Magic Leap founder raises $20M for new AI startup SynthBee
AI startup SynthBee secures significant seed funding: Rony Abovitz, a seasoned tech entrepreneur, has launched a new AI company called SynthBee, which has successfully raised $20 million in seed funding. SynthBee, based in Fort Lauderdale, has secured the investment led by Crosspoint Capital Partners to support its growth and development of a proprietary computing intelligence platform. The startup aims to focus on enterprise productivity, emphasizing security, transparency, and scalability while preserving intellectual property and know-how. Founder's track record: Rony Abovitz brings a wealth of experience and success to his new venture, having previously founded and led innovative technology companies. Abovitz...
read Oct 15, 2024Quantum software startup Zapata shuts down after funding struggles
Quantum software pioneer shuts down: Zapata AI, a leading startup in the quantum software market, ceased operations on October 9, 2024, following an unexpected financial setback. The catalyst for closure: An accelerated payment demand from Sandia Investment Management LP triggered the company's sudden shutdown. Zapata AI owed approximately $2.5 million to Sandia Investment Management LP. The original payment due date was set for March 28, 2026. Sandia accelerated the payment deadline to October 8, 2024, leaving Zapata AI unable to meet the financial obligation. Immediate consequences: The abrupt closure resulted in widespread job losses and the termination of ongoing projects....
read Oct 14, 2024Flex unveils new liquid-cooled data center solutions at OCP
AI data center evolution: Flex, a major player in the IT solutions industry, is expanding its role in the AI data center market with innovative power, cooling, and infrastructure solutions designed to meet the demands of cutting-edge AI servers. Flex has positioned itself as a full-stack provider of power, cooling, and IT infrastructure for AI-driven data centers, addressing the unique challenges posed by the increasing computational requirements of artificial intelligence. The company is launching liquid cooling-ready servers featuring direct-to-chip cooling technology, housed in racks that comply with Open Compute Project (OCP) specifications. Company background: Flex, formerly known as Flextronics, has...
read Oct 13, 2024New breakthrough enables LLMs to run efficiently on low-resource edge devices
Advancing edge AI with TPI-LLM: Researchers have developed a new system called TPI-LLM that enables large language models (LLMs) to run efficiently on low-resource edge devices, addressing privacy concerns and resource limitations. The shift towards edge computing for LLM inference is driven by growing privacy concerns surrounding user interaction data. Edge devices typically face constraints in computing power, memory, and bandwidth, necessitating collaboration across multiple devices to run and accelerate LLM inference. Existing solutions like pipeline parallelism and tensor parallelism have limitations in single-user scenarios and communication efficiency, respectively. Key innovations of TPI-LLM: The system introduces novel approaches to overcome...
read Oct 10, 2024Yale paper explores how quantum machine learning can enable drug discovery
Quantum computing and drug discovery: A promising partnership: Researchers from NVIDIA, Moderna, and Yale have published a review paper exploring how quantum machine learning (QML) could revolutionize drug discovery processes, potentially leading to more efficient pharmaceutical development. The study investigates the potential of future quantum neural networks to enhance existing AI techniques in drug discovery, offering researchers improved methods for predicting molecular properties. This research highlights the growing intersection of quantum computing, artificial intelligence, and pharmaceutical development, suggesting a future where these technologies work in tandem to accelerate medical breakthroughs. GPU-accelerated simulations: The key to quantum research: The paper emphasizes...
read Oct 10, 2024Intel’s new ‘Arrow Lake’ CPUs boost desktop efficiency
Intel's Arrow Lake CPUs: A new era of desktop computing: Intel's latest desktop CPU lineup, the Core Ultra 200S series (codenamed "Arrow Lake"), is set to launch on October 24, marking a significant step forward in energy efficiency and AI capabilities for consumer processors. Key architectural advancements: The new CPUs utilize Intel's "Lion Cove" Performance cores and "Skymont" Efficient cores, offering a range of 6-8 P-cores and 8-16 E-cores depending on the model. Arrow Lake features deeper cache compared to its predecessors, with 4MB L2 for E-core clusters, 3MB L2 for P-cores, and up to 36MB L3 cache. The series...
read Oct 10, 2024AMD launches Ryzen AI Pro 300 processors for enterprise Copilot+ PCs
AMD's Strategic Move in Enterprise AI Computing: AMD has unveiled its new Ryzen AI Pro 300 series processors, marking a significant advancement in bringing AI-powered computing capabilities to enterprise users. Key Features and Specifications: The lineup includes three chips designed for Copilot+ PCs: AMD Ryzen AI 9 HX Pro 375, AMD Ryzen AI 9 HX Pro 370, and AMD Ryzen AI 7 Pro 360. These processors represent a substantial upgrade from the previous AMD Ryzen Pro 8040 series. The most powerful chip in the series, the Ryzen AI 9 HX Pro 375, boasts an NPU (Neural Processing Unit) capable of...
read Oct 9, 2024AI PC sales lag as global market slumps in Q3
AI PCs fail to boost market in Q3: Despite industry hype, the introduction of AI-powered personal computers did not prevent a decline in overall PC shipments during the third quarter of 2024. IDC reports a 2.4% year-over-year decrease in PC shipments, with only 68.8 million units shipped between July and September. Gartner estimates a similar decline of 1.3% year-over-year for the same period. The lackluster performance comes as a surprise to analysts who had anticipated a market rebound following the post-pandemic slump. Challenges for AI PC adoption: The slow start for AI PCs highlights the difficulties in convincing consumers and...
read Oct 9, 2024Why generative AI may not actually cause a compute crunch
The AI computing power landscape: Debunking scarcity concerns: Despite widespread worries about generative AI (genAI) causing a shortage of computing power, a detailed analysis suggests that the long-standing regime of affordable and widely available computing resources is likely to persist. Even under aggressive assumptions, genAI workloads are projected to account for only about 34% of global data centre-based AI computing supply by 2028. This forecast challenges the notion of an impending scarcity crisis in AI computing resources. Breaking down genAI computational demands: GenAI computational requirements into three distinct areas, each with varying resource intensities and usage patterns. Model Training: This...
read Oct 8, 2024What happens when you combine quantum computing with AI
Quantum computing and AI: A revolutionary convergence: The fusion of quantum computing and artificial intelligence (AI) is poised to transform the technological landscape, promising unprecedented advancements in computational power and problem-solving capabilities. The unique attributes of quantum computing, such as parallel computations and handling vast complexities, are set to propel AI into new realms of possibility. This convergence has the potential to revolutionize industries, enhance scientific discovery, and address global challenges with unparalleled precision and speed. Quantum-enhanced AI: Expanding the palette of possibilities: The integration of quantum computing with AI is analogous to expanding an artist's palette, offering a richer...
read Oct 8, 2024Why clean energy and AI need each other
The AI-Clean Energy Nexus: A Crucial Intersection for Global Leadership: The rapid growth of artificial intelligence (AI) is creating unprecedented demand for concentrated and consistent power, presenting both challenges and opportunities for the clean energy sector and global economic leadership. The Power Demands of AI: A Game-Changing Shift: The energy requirements of AI data centers are reshaping the landscape of electricity consumption, with significant implications for grid infrastructure and power generation. AI data centers could add the equivalent of three New York Cities' worth of load to the US power grid by 2026, potentially doubling their share of national electricity...
read Oct 8, 2024Foxconn to build Taiwan’s fastest AI supercomputer with Nvidia
Foxconn and Nvidia collaborate on Taiwan's fastest AI supercomputer: Foxconn, in partnership with Nvidia, is set to construct Taiwan's most powerful supercomputer using Nvidia's cutting-edge Blackwell GPU architecture. Project specifications and performance: The supercomputer, named Hon Hai Kaohsiung Super Computing Center, was announced at Hon Hai Tech Day. It will feature the GB200 NVL72 platform, comprising 64 racks and 4,608 Tensor Core GPUs. The system is expected to deliver over 90 exaflops of AI performance, making it the fastest in Taiwan. Construction has begun in Kaohsiung, Taiwan, with the first phase expected to be operational by mid-2025 and full deployment...
read Oct 8, 2024Q-CTRL secures $59M to advance quantum computing software
Quantum computing breakthrough: Australian quantum computing infrastructure software company Q-CTRL has raised $59 million in a Series B-2 funding round, bringing its total Series B funding to $113 million and overall funding to $133 million. Funding details and investor landscape: The latest round was led by global late-stage venture firm GP Bullhound, signaling strong confidence in Q-CTRL's potential to shape the quantum industry. New investors include Alpha Edison, Lockheed Martin Ventures, NTT Finance, Salus Group, and TISI, joining existing backers such as Alumni Ventures, DCVC, and Salesforce Ventures. The investment round saw a significant increase in Q-CTRL's valuation, reflecting the...
read Oct 3, 2024Microsoft unveils AI-powered Recall feature in major Windows 11 update
Windows 11 AI revolution: Microsoft unveils new features: Microsoft is set to introduce a suite of AI-powered features to Windows 11 and Copilot+ PCs, aiming to enhance user experience and productivity through advanced technology integration. Key AI enhancements: Recall: A new feature that captures and indexes screenshots of user activity, making them searchable for easy content retrieval. This opt-in function requires Windows Hello authentication for privacy. "Click to do": An intelligent suggestion system that recommends ways to complete tasks using various applications and system features. Super resolution in Photos: An AI-driven tool designed to enhance the quality of low-resolution and...
read Oct 2, 2024Equinix secures $15B for AI-driven data center expansion
Major data center expansion to meet AI demand: Equinix, a leading digital infrastructure company, has announced a massive $15 billion investment to expand its xScale data centers, primarily in the United States, to address the growing demand for artificial intelligence (AI) and cloud computing services. Key details of the investment: Equinix has signed a joint venture agreement with GIC and the Canada Pension Plan Investment Board (CPP Investments) to raise over $15 billion in capital. The investment will nearly triple the existing $8 billion commitment to the Equinix xScale program. The focus is on building new state-of-the-art xScale facilities on...
read Oct 1, 2024AMD unveils energy-efficient Epyc chips for high-performance devices
AMD's New Frontier in Embedded Computing: AMD has launched its Epyc Embedded 8004 Series processors, marking a significant advancement in high-performance, low-power computing for the embedded market. The new processors are designed for compute-intensive embedded systems, offering exceptional performance for demanding workloads while maximizing power efficiency. These processors are particularly suited for networking systems, routers, security appliances, enterprise and cloud storage, and industrial edge applications. The Epyc Embedded 8004 Series is the first in AMD's embedded portfolio to integrate "Zen 4c" cores, setting a new standard for platform efficiency and innovation. Performance and Efficiency Gains: The AMD Epyc Embedded 8004...
read Oct 1, 2024Google AI will summarize and translate right on your Chromebook now
AI-powered enhancements for Chromebooks: Google is rolling out a suite of new artificial intelligence features for Chromebook devices, aiming to enhance productivity and user experience across its laptop ecosystem. Chromebook Plus devices will receive exclusive AI capabilities, including "Help Me Read" for text summarization, live translation for voice and video calls, an AI-enhanced recorder app, and video call improvements for audio and video quality. All Chromebooks will benefit from new features like Recap for session continuity, Focus mode with Google Tasks integration, improved Drive integration, and a Gemini AI assistant on the home screen. These AI enhancements are designed to...
read Oct 1, 2024Dell’s XPS 13 laptop has on-device AI to enable advanced features without wifi
Introducing the Dell XPS 13 9345: Dell's latest addition to its premium XPS lineup, the XPS 13 9345, marks a significant leap in laptop technology by incorporating advanced AI capabilities and powerful performance in a sleek, portable design. Copilot+ integration revolutionizes user experience: The Dell XPS 13 9345 is the first XPS laptop to feature Copilot+, a suite of AI-powered features that run locally on the device, enhancing functionality and user interaction. The classic Paint application receives a major upgrade with Cocreator, allowing users to generate AI-created art based on doodles or text descriptions. Advanced Windows Studio Effects, such as...
read Oct 1, 2024Microsoft is infusing Windows search with AI for its next upgrade
AI-powered search revolutionizes Windows user experience: Microsoft is set to introduce significant improvements to Windows search functionality on its new Copilot Plus PCs, leveraging AI models to enhance user interaction with various types of content. Key features and improvements: The new search capabilities will allow users to find images using natural language descriptions, even if the search terms don't match file names or metadata. Windows will better understand user intent, making it easier to locate documents, images, files, and emails without the need to remember specific file names or locations. The improved search will be available in File Explorer, the...
read Sep 29, 2024Inside OpenAI’s ambitious plans to make AI flow like electricity
OpenAI's ambitious global AI infrastructure plan: Sam Altman, OpenAI's CEO, has been pitching a multitrillion-dollar initiative to create a vast network of computer chip factories and data centers worldwide, aiming to provide the computing power needed for next-generation AI development. The plan involves collaboration with investors from the United Arab Emirates, Asian chip manufacturers, and government officials from various countries, including the United States, Europe, and Canada. OpenAI's vision is to establish a global reservoir of computing power dedicated to advancing AI technology, potentially rivaling the transformative impact of the Industrial Revolution. The scale of the proposed investment, estimated to...
read