Can AI make the PC cool again?

By Karen Weise and Brian X Chen

The race to put artificial intelligence everywhere is taking a detour through the good old laptop computer. Microsoft on Monday introduced a new kind of computer designed for artificial intelligence. The machines, Microsoft says, will run AI systems on chips and other gear inside the computers so they are faster, more personal and more private.

The new computers, called Copilot+ PC, will allow people to use AI to make it easier to find documents and files they have worked on, emails they have read or websites they have browsed. Their AI systems will also automate tasks such as photo editing and language translation.

The new design will be included in Microsoft’s Surface laptops and high-end products that run on the Windows operating system offered by Acer, Asus, Dell, HP, Lenovo and Samsung, some of the largest PC makers in the world.

The AI PC, industry analysts believe, could reverse a longtime decline in the importance of the personal computer. For the past two decades, the demand for the fastest laptops has diminished because so much software was moved into cloud computing centers. A strong internet connection and web browser was all most people needed.

But AI stretches that long-distance relationship to its limits. ChatGPT and other generative AI tools are run in data centers stuffed with expensive and sophisticated chips that can process the largest, most advanced systems. Even the most cutting-edge chatbots take time to receive a query, process it and send back a response. It is also extremely expensive to manage.

Microsoft wants to run AI systems directly on a personal computer to eliminate that lag time and cut the price. Microsoft has been shrinking the size of AI systems, called models, to make them easier to run outside of data centers.

Analysts expect Apple to follow suit next month at its conference for software developers, where the company will announce an overhaul for Siri, its virtual assistant, and an overall strategy for integrating more AI capabilities into its laptops and iPhones.

Whether the AI PC takes off depends on the companies’ ability to create compelling reasons for buyers to upgrade. The initial sales of these new computers, which cost more than $1,000, will be small, said Linn Huang, an analyst at IDC, which closely tracks the market. But by the end of the decade — assuming AI tools turn out to be useful — they will be “ubiquitous,” he predicted. “Everything will be an AI PC.” The computer industry is looking for a jolt. Consumers have been upgrading their own computers less frequently, as the music and photos they once stored on their machines now often live online, on Spotify, Netflix or iCloud. Computer purchases by companies, schools and other institutions have finally stabilized after booming — and then crashing — during the pandemic.

Some high-end smartphones have been integrating AI chips, but the sales have fallen short because the features “are still not sophisticated enough to catalyze a faster upgrade cycle,” Mehdi Hosseini, an analyst at Susquehanna International Group, wrote in a research note. It will be at least another year, he said, before enough meaningful breakthroughs will lead consumers to take note.

At the event, Microsoft showed new laptops with what it likened to having a photographic memory. Users can ask Copilot, Microsoft’s chatbot, to use a feature called Recall to look up a file by typing a question using natural language, such as, “Can you find me a video call I had with Joe recently where he was holding an ‘I Love New York’ coffee mug?” The computer will then immediately be able to retrieve the file containing those details because the AI systems are constantly scanning what the user does on the laptop.

Chipmakers have also made advances, like adjusting a laptop’s battery life to allow for the enormous number of calculations that AI demands. The new computers have dedicated chips built by Qualcomm, the largest chip provider for smartphones.

Though the type of chip inside the new AI computers, known as a neural processing unit, specializes in handling complex AI tasks, such as generating images and summarizing documents, the benefits may still be unnoticeable to consumers, said Subbarao Kambhampati, a professor and researcher of artificial intelligence at Arizona State University.

Most of the data processing for AI still has to be done on a company’s servers instead of directly on the devices, so it’s still important that people have a fast internet connection, he added.

But the neural processing chips also speed up other tasks, such as video editing or the ability to use a virtual background inside a video call, said Brad Linder, editor of Liliputing, a blog that has covered computers for nearly two decades. So, even if people don’t buy into the hype surrounding artificial intelligence, they may end up getting an AI computer for other reasons. — The New York Times