Category: Technology

Microsoft has a lot of news at this year’s Build conference around its AI “copilots” for Windows 11 and other products, but it wants third-party developers in on the action too. The company announced that it has expanded its AI plugin ecosystem and provided a framework for building AI apps and copilots. At the same time, it’s adopting the same open plugin standard that OpenAI uses for ChatGPT to ensure it’ll work alongside its Windows 11, 365 and other copilots. 

Microsoft introduced the idea of copilots nearly two years ago. Those are applications that use AI and LLMs (large language models) to help users with complex cognitive tasks like writing sales pitches, generating images and more. For example, ChatGPT on Bing is actually a copilot, and Microsoft has also launched copilots for Microsoft 365 and Microsoft Security, among others. 

Now, it’s adding features that let developers build their own using new “plugins” that allow copilots to interact with other software and services. “You may look at Bing Chat and think this is some super magical complicated thing, but Microsoft is giving developers everything they need to get started to go build a copilot of their own,” said Microsoft CTO Kevin Scott. “I think over the coming years, this will become an expectation for how all software works.”

In addition, Microsoft said it’s adopting the same open plugin standard used by Open AI so that all of Microsoft’s copilots can potentially work with ChatGPT. “That means developers can now use one platform to build plugins that work across both business and consumer surfaces, including ChatGPT, Bing, Dynamics 365 Copilot, Microsoft 365 Copilot and Windows Copilot,” it wrote. 

As part of that platform, Bing is adding plugin support for third-party companies including Instacart, Kayak, Klarna, Redfin and Zillow. That’s on top of those previously announced by Open AI including OpenTable and Wolfram. Developers can also extend Microsoft 365 Copilot using ChatGPT and Bing plugins, as well as Teams message extensions and Power Platform connectors. Developers will also be able to build their own plugins with the Microsoft Teams Toolkit for Visual Studio Code and Visual Studio. 

Finally, Microsoft announced that Azure AI Content Safety is now in preview. It’s designed to ensure copilots avoid creating outputs that are “biased, sexist, racist, hateful, violent” or encourage self-harm, said Microsoft product manager Sarah Bird. The models detect inappropriate content across images and text, then flag them and assign severity scores so that human moderators can see anything that requires urgent action. “It’s part of the safety system that’s powering the new Bing… [and] we’re now launching it as a product that third-party customers can use,” said Bird. 

This article originally appeared on Engadget at https://www.engadget.com/microsoft-is-helping-developers-build-their-own-chatgpt-compatible-ai-copilots-150029815.html?src=rss 

Unlike Meta, Microsoft doesn’t need to change its name to prove it’s committed to an entirely new tech platform: It’s doing so through action. After debuting its AI-infused Bing search engine earlier this year, the company unveiled the Microsoft 365 Copilot for Office apps. And even before those consumer reveals, Microsoft delivered an AI tool for developers in 2021 with GitHub Copilot. Today at its Build developer conference, Microsoft is making the inevitable next step: It’s making AI an integral part of Windows 11.

The new Windows Copilot tool lives in the Windows sidebar and, just like Bing’s AI chat, you can use it as a super-powered search engine by typing in general questions. But true to its name, it’s also deeply integrated with Windows. You can ask it to accomplish tasks within the OS — like turning on the night light mode, or changing your desktop background — without fishing around for specific settings. Windows Copilot can also function as a genuine virtual assistant by summarizing documents, or launching a photo app to accomplish a few edits before sending it off to a group of your coworkers. Cortana would never.

Microsoft CVP Panos Panay introducing the Surface Studio.

“I think about Windows and the role of AI as such an opportunity,” said Panos Panay, Microsoft Executive Vice President and Chief Product Officer, in an interview with Engadget ahead of Tuesday’s launch. “We have hundreds of millions of people [using Windows], bringing the power of AI to Windows 11 gives you the opportunity to not only get more creative and get more productive, but ultimately just let every Windows user become a power user.”

Windows Copilot, which will be available to preview in June, also has the potential to reach far more users than the revamped Bing. The company’s search engine clearly received plenty of buzz thanks to AI — Microsoft said it hit 100 million daily active users a month after the AI chat feature launched — but according to StatCounter, Bing has also lost market share over the past few months. It hit 7.2 percent in April, down from a recent high of 9.92 percent last October.

That’s not entirely surprising, though. Microsoft’s battle against Google has always seemed like a hopeless endeavor. The company launched its first attempt, MSN Search, in 1998 soon after Google arrived, and amid Yahoo’s dominance as the go-to web portal. MSN Search turned into Live Search, which ultimately evolved into Bing in 2009.

Microsoft has always been a company that’s dabbled in search, but it’s not a search company. But Windows is another matter entirely. It’s a product with a devoted user base, many of whom have decades of experience with the OS. According to Microsoft, there are over 1.4 billion monthly active devices running Windows 10 or 11. (And of course, that doesn’t include the PCs running older Windows versions.) Microsoft previously tried to bring Bing’s AI capabilities into the Windows taskbar in February, but that ultimately just amounted to a shortcut that launched Bing’s AI chat in the Edge browser. Windows Copilot actually weaves AI into the core Windows 11 experience.

“There’s so much depth in this product from the ’90s on,” said Panay. “Our job is to responsibly, of course, push it forward to users that need both the past and need to get to the future […] We have so many kinds of users that use Windows in its simplest form, like browsing, Mail, and Office […] And then we’ve got the hardcore devs who get right down to the depth of the product. And I think both are so vital to the platform. But now I think every developer can move forward as an AI developer and every user can be a power user on Windows. I think it just makes Windows that much better.”

Windows Copilot is currently a text-only tool, but Panay envisions it evolving into something you can interact with on your own terms. It has the potential to be the powerful voice assistant that Cortana, the Siri competitor Microsoft pushed for years, never amounted to. (And to be fair, pretty much every virtual assistant ended up being a disappointment. Siri remains confounding and inaccurate, while Google’s Assistant is mainly useful for preemptively delivering information, rather than dealing with voice commands.)

The simple, text-based approach to AI also makes sense for Microsoft. For many users, Windows Copilot will be the first time they’ve interacted with any sort of generative AI product. Better to let general users warm up with a few text strings before overwhelming people with voice commands. And hopefully by the time Microsoft adds voice support, it’ll be closer to the Star Trek computer than the frustrating assistants of yore. (I’m dreaming of the day when I can shout at my computer to look up information as I’m writing feverishly on deadline, or ask it to transcribe and summarize a meeting.)

Windows Copilot, just like Bing Chat, will also support the same third-party plugins that OpenAI’s ChaptGPT uses. That means any developer will be able to easily connect their apps to AI, an essential move to make these products more useful. Every software platform needs a thriving third-party ecosystem to survive — just think of what iOS or Android would be like if you were stuck using only Apple or Google’s apps.

“AI is going to be the single largest driver of innovation for Windows in the years to come,” said Panay. “It’s going to change the way you work, change your interaction models to make it easier. It’s going to understand so much about what you need.”

Panay stressed that Microsoft is also focused on making your AI interactions secure and private. Windows Copilot could end up juggling some sensitive information if you start asking questions about specific health questions, for example. A potentially bigger concern is misinformation: Windows Copilot and Bing Chat can answer your questions confidently, but it may not always be accurate. And it’s a bigger problem than standard web searches since it’s unclear where AI chatbots are pulling information from.

“We have to approach AI with innovation but also optimism,” Panay said when I asked about how Microsoft is planning to deal with AI misinformation. “To your point, we have to prioritize both people’s safety and privacy. Also, at the end of the day, if you do it in a frame of humility, where we’re always learning, this is going to be vital to your point.”

It’s clear that Microsoft still has plenty to learn from Windows Copilot. The preview period, which kicks off next month, is a chance for the company to see how it’s used in the wild, and to make adjustments before it’s officially released. Panay says that the Bing team is already working to make sure its results come from grounded references, and that they’re also holding to Microsoft’s responsible AI standards.

Microsoft CVP Shilpa Ranganathan

According to Shilpa Ranganathan, a Microsoft Corporate Vice President leading the Windows team, the company has been talking a lot about how Copilot results are displayed, as well as communicating the uncertainty of some answers to customers. “We’re going to build it into the experience as a learning experience for us as well […] I don’t want to take a path that allows us to lose trust with customers,” she said. “We believe that’s most important. I’d rather say, hey, we’re not 100 percent sure. Help us make this better or if this didn’t help you, I would like feedback now so that we never show this to another customer again.”

Panay hopes to get to a point where “as a product maker, I have the confidence that what we’re handing to our customers is exactly what they need when we launch into the full availability [of Windows Copilot].” He added, “It’s about humility. If you give it time and the right innovation, then we can get to that point of creating the guardrails needed to keep it safe and remove the misinformation.”

Given the state of the web today, where less reputable websites employ a variety of SEO tricks to rank higher in search results, it’s unclear if we’ll ever be truly rid of AI misinformation. The next content war will be entirely focused on websites vying for placement within AI search results. The problem for users is that it’ll be harder to tell if bad information is coming from a seemingly reputable source, rather than an obviously scammy website filled with junk content.

Windows Copilot has the potential to fundamentally reshape the way we use Windows. But hopefully, it won’t erode user trust in the process.

This article originally appeared on Engadget at https://www.engadget.com/microsoft-windows-copilot-ai-panos-panay-interview-150044298.html?src=rss 

Samsung has unveiled a new display technology that could lead to new biometric and health-related capabilities in future phones and tablets. The tech giant has debuted what it calls the Sensor OLED Display that can read your fingerprints regardless of what part of the screen you touch at this year’s SID Display Week in LA. While most smartphones now have fingerprint readers on the screen, their sensors are attached under the panel as a separate module that only works within a small designated area. For Sensor OLED, Samsung said it embedded the fingerprint sensor into the panel itself. 

Since the display technology can read fingerprints anywhere on the screen, it can also be used to monitor your heart rate and blood pressure. The company said it can even return more accurate readings than available wearables can. To measure your blood pressure, you’d need to place two fingers on the screen. OLED light is apparently reflected differently depending on your blood vessels’ contraction and relaxation. After that information is returned to the panel, the sensor converts it into health metrics.

Samsung explained in its press release: “To accurately measure a person’s blood pressure, it is necessary to measure the blood pressure of both arms. The Sensor OLED display can simultaneously sense the fingers of both hands, providing more accurate health information than existing wearable devices.” The company has yet to announce if it’s planning to use this new technology on devices it’s releasing in the future, but the exhibit at SID Display already shows it being able to read blood pressure and heart rate. 

In addition to Sensor OLED, Samsung has also showcased the Rollable Flex screen that can expand more than five times in length when unrolled. Meanwhile, its Flex In & Out phone concept shows a Galaxy Fold-like device that you can vertically fold inward or outward. It eliminates the need for an external display, which could lead to thinner foldable phones. 

This article originally appeared on Engadget at https://www.engadget.com/samsungs-new-sensor-oled-display-can-read-fingerprints-anywhere-on-the-screen-121346659.html?src=rss 

Skullcandy is well known for offering decent, affordable audio gear and the brand’s latest earbuds are even less expensive than the $25 Dime from 2021. The Smokin’ Buds True Wireless Earbuds will set you back just $20.

The company is promising plenty of bells and whistles with these earbuds, such as “clear, full range sound backed by impressive bass depth.” In addition, Skullcandy says users can expect “expertly tuned” drivers.

There are EQ modes designed to help you get the most out of music, movies and podcasts. Each earbud has a microphone, so you can wear either one at a time. There are touch controls for volume, calls and EQ modes, and you’ll be able to activate a voice assistant by tapping either earbud.

Skullcandy says the Smokin’ Buds have a comfortable, noise-isolating fit thanks to an ergonomic, oval design. IPX4 sweat and water resistance should help make them durable. What’s more, Skullcandy claims you’ll get up to eight hours of use on a single charge and an extra 12 hours from the charging case. The brand also says a rapid charging feature can add two hours of playtime after just 10 minutes of charging. Bluetooth 5.2 support should help the earbuds to pair with devices swiftly too.

On top of all of that, Skullcandy says the Smokin’ Buds are “environmentally conscious.” They’re made with 50 percent certified recycled plastics, a consolidated part count and smaller, “more efficient” batteries, while the packaging is completely recyclable. “With 25 percent of earbud sales happening in the under $30 price range, we aimed to provide a better option that would mitigate the environmental impact of this popular, high-volume category,” Jason Luthman, Skullcandy’s director of global product management, said.

Given the price, it’s hard to imagine that the Smokin’ Buds will truly compete against the very best earbuds on the market in terms of audio quality. Still, they check a lot of the right boxes at this price range (don’t go expecting active noise cancellation for 20 bucks) and they could be a handy backup pair or a viable option for workouts instead of using fancier earbuds when you’re working up a sweat.

This article originally appeared on Engadget at https://www.engadget.com/skullcandys-latest-cheap-earbuds-cost-just-20-120031703.html?src=rss 

Guess Android tablets aren’t dead just yet. Following Google’s official launch of the Pixel Tablet last week, Amazon has unveiled a new Fire tablet called the Max 11. For just $230, the Fire Max 11 offers an 11-inch LCD screen, slim aluminum frame and smart home controls courtesy of Alexa. I was able to briefly check out a sample at a briefing last week and am impressed by how much Amazon is offering for the money.

This isn’t your average Fire tablet, by the way. While the company’s previous slates have found a niche as affordable, kid-friendly mobile entertainment devices, the Max 11 is all grown up. With slimmer bezels, a more-premium aluminum build and weighing just over a pound, it’s designed for those who also want to do some work and multi-tasking. To that end, the tablet uses an octa-core MediaTek processor that Amazon said is almost 50 percent faster than its “next fastest tablet.” 

There’s a fingerprint sensor embedded in the power button, making the Maxx 11 the company’s first tablet to offer this feature. The 11-inch screen, which Amazon says is its “biggest, most vibrant… tablet display,” has a 2,000 x 1,2000 resolution and is certified for low blue light. It also supports WiFi 6 and runs Fire OS 8, which offers some split-screen and picture-in-picture features to let you fire off emails while keeping an eye on your favorite YouTube livestream (like the Engadget Podcast, perhaps?). 

More importantly, though, the company also made a keyboard case and stylus for the Max 11 that you can get for an additional $100. If you don’t need the pen ($35), you can get just the case for $90. It attaches to the device magnetically and connects via pogo pins, too. I like that the cover comes with a kickstand, and in my brief experience it was sturdy enough to prop the tablet up and various angles. The keyboard is detachable so you can peel it off when you don’t want it in the way. Its keys were surprisingly springy and deep, with a well-spaced layout. Though I think the trackpad is a little small, I’m glad that Amazon at least included one instead of ditching it altogether. 

I also enjoyed casually scribbling my name and random greetings with the “Made For Amazon Stylus Pen,” which uses a replaceable AAA battery that the company said should last six months. Palm rejection on OneNote was effective during the briefing, and you can also write directly into search and message fields, and the Max 11 will convert your scrawl into text that you can submit. 

Of course, this is quite a different device from the Pixel Tablet, which comes with a speaker base that keeps it charged and turns into a smart display when attached. But lest you forget, Amazon already offers Show Mode on its tablets, which turns them into dashboards for your connected home, a la its Echo Shows. The same is true for the Max 11, and with the kickstand on the case, you can basically turn it into a smart display. Sure, it won’t always remain charged unless you plug it in, nor will it have a superior audio system when left standing. But you can sort of replicate the Pixel Tablet experience here for $150 less. Alexa can always be listening, too.

The Max 11 itself will last 14 hours on a charge, according to Amazon, and 64GB and 128GB models will be available. For those who are curious, the device will have 4GB of RAM and 8-megapixel front and rear cameras. And in case you’re clumsy or expect the kids in your life to fight over this tablet, it should be reassuring to know that Amazon claims the Max 11 is “three times as durable as the iPad 10.9′ (10th generation).”

Like the company’s other tablets, the Fire Max 11 supports comprehensive parental controls and multiple user profiles so you can share this with some peace of mind. For just $330, the Fire Max 11 offers plenty of features that make it seem like a solid value. It’s certainly cheaper (when you include the price of the keyboard case) than the Galaxy Tabs, Surfaces and iPads that have long dominated the tablet market. There are companies like Lenovo to look out for, of course, but given the strong foothold Amazon has had in the family-oriented slate space, the Max 11 appears poised to find its home in the backpacks of many school-going children soon. You can pre-order the Fire Max 11 starting at $230 today.

This article originally appeared on Engadget at https://www.engadget.com/amazons-latest-fire-tablet-is-a-230-android-powered-2-in-1-130022727.html?src=rss