Category: Technology

Currently, Unicode 15.1 supports just shy of 3,800 various emoji. But for everyone out there that for some reason thinks that’s not nearly enough, today at WWDC 2024, Apple announced the ability to use AI to generate unique emoji based on your prompts.

Called Genmoji, which looks to be an awful portmanteu of the words “generate” and “emoji,” these new creations are powered by Apple Intelligence, which is a new collection of AI features coming to the iPhone, iPad and Mac sometime later this year. Similar to creating images with services like Midjourney and Dall-E, users will be able to whip up custom emoji by inputting specific prompts. Once made, they can be shared with others as stickers, reactions in a Tapback or simply embedded in-line in messages. 

While the feature isn’t expected to be officially available until later this fall, there don’t seem to be any major limitations to what you can dream up. In a teaser at WWDC, Apple showed examples like a smiley face with cucumbers over its eyes and a T-rex riding a skateboard while wearing a tutu. That said knowing Apple, there is sure to be some restrictions for Genmoji made using more graphic prompts like guns or blood. 

Now on some level, it could be fun to razz your friends with Genmoji based on their latest mishap. But at the same time, part of the magic of emoji has always been being able to convey a message using the limited number of icons while still getting your point across. Also, it’s truly hard to imagine how much added value a bagel with lox Genmoji (see the lead picture above) provides compared to the classic image. But since AI is so hot right now, seeing Apple Intelligence get applied to emoji was probably an inevitability. 🤷‍♂️

This article originally appeared on Engadget at https://www.engadget.com/in-case-there-werent-enough-emoji-already-apples-genmoji-uses-ai-to-generate-even-more-200011608.html?src=rss 

As expected, Apple’s assistant is about to get much more helpful thanks to a load of new AI-powered capabilities. During WWDC, the company previewed a new version of Siri that can take actions on your behalf and understand a wide range of new queries.

The new version of Siri has a better understanding of the apps on your phone and will be able to take more than 100 actions based on your activity and device. For example, you could ask Siri to show you specific photos or memories in your Photos app or to find tracking details for an expected delivery from an email in the Mail app.

Siri will also be able to perform some tasks for you, like adding an address to a contact card, tweak a photo, or share a summary of your notes in an email. Third-party developers will also be able to take advantage of these new capabilities with a new “app intents framework” that will allow them to tap into Apple Intelligence and make certain actions compatible with Siri.

Apple said that Siri’s new AI powers could be a major time saver for otherwise tedious tasks. One example offered by the company was the need to fill in a driver’s license number in an online form. Instead of searching your photos yourself, you could ask Siri and it would be able to find the image of your license, grab the number and fill in the form. Siri can also answer questions based on details from your messages and emails, like remembering your dinner reservations or providing up-to-date flight tracking for a previously-shared reservation. 

Another major change is that Siri will no longer be only a voice-activated assistant. Apple is adding a “type to Siri” feature that makes it a bit closer to the experience of other generative AI chatbots. When you do chat with Siri, the experience should feel more natural as the assistant will be better able to respond to queries when the command isn’t spoken perfectly. Apple demoed how Siri could respond to a request about weather conditions even when the speaker stumbled over their words and misspoke. Additionally, the assistant can provide help and answer about iPhone capabilities, like “I need to scan a document.”

Siri will also be able to take advantage of chatGPT, thanks to Apple’s newly-announced OpenAI partnership. For some text-based queries, users can opt to get an answer from chatGPT from within the new type to Siri interface. 

Apple didn’t specify when all of the new Siri capabilities will launch, but said the new version of its assistant will be coming to iPhone, iPad and the Mac. The revamped Siri is part of Apple’s push into “personal intelligence,” which Tim Cook described as the “next big step” for the company.

Catch up here for all the news out of Apple’s WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/apples-new-ai-powered-siri-can-use-apps-for-you-184116016.html?src=rss 

As rumored, Apple confirmed at WWDC 2024 that it’s partering with OpenAI to bring ChatGPT to the iPhone and other devices. GPT-4o will power cloud-based Apple Intelligence queries in iOS 18, iPadOS 18 and macOS Sequoia.

Apple’s Craig Federighi said the new AI-powered Siri can (with your permission) tap into ChatGPT’s knowledge base “when it might be helpful.” Examples include asking for menu ideas for an elaborate meal with specific ingredients. You can also include photos with your questions, like asking for decorating advice based on a specific detail or color arrangement in the uploaded picture. In addition, you can ask Siri about documents, presentations and PDFs.

With its new Compose feature, ChatGPT will integrate with Apple’s system-wide writing tools. Apple included an example of creating a custom bedtime story that incorporates a child’s specific interests. Notably, Apple mentioned that you’ll want to “check important info for mistakes.”

Apple says you can access ChatGPT for free without creating an account, and the company says your requests and user info won’t be logged. If you already subscribe to ChatGPT (Plus, Teams or Enterprise), you can connect your account and access extra paid features via Apple Intelligence experiences. Apple emphasized that you’ll be in control of when it’s used, and you’ll be required to grant explicit permission for each cloud-based ChatGPT request.

ChatGPT integration will be available in iOS 18, iPadOS 18 and macOS Sequoia, but the OpenAI features won’t arrive until “later this year.” Apple said it will add support for other AI models in the future, which apparently confirms that it doesn’t have a long-term exclusivity deal with OpenAI.

Catch up here for all the news out of Apple’s WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/chatgpt-is-baked-into-apple-intelligence-185026662.html?src=rss 

Today’s keynote for Apple’s Worldwide Developers Conference teased a lot of what users can expect later this year when all of its major software updates roll out to the public in the fall. Big changes coming to iOS 18, macOS Sequoia and watchOS 11 include RCS support, a new Passwords app, a revamped Calculator app for iPhone and iPad and a bunch of artificial intelligence (AI) infusions across the board thanks to the new “Apple Intelligence” system. If you weren’t able to catch the news live, here’s a rundown of everything announced at WWDC 2024.

Apple Intelligence

Apple revealed its plans to incorporate AI into its operating systems at WWDC this year. Dubbed “Apple Intelligence,” this new generative AI system will appear in iOS and iPad 18 and macOS Sequoia in the form of (what Apple believes to be) practical tools that most people can use regularly. Those features include new writing tools that can help you rewrite, proofread and summarize things like emails and other messages, original emoji and image creation and more. Going hand-in-hand with original image generation is a new feature called Gemoji, which allows users to create their own unique emojis by typing in descriptions and requirements like “T-rex wearing a tutu on a surfboard.”

Siri is getting an AI infusion now that it will be powered in part by large language models. In addition to asking Siri to delete an email or edit a photo, users will also be able to ask the virtual assistant to summarize articles and webpages in Safari and even extract personal information from a picture of your ID so it can fill out an online form for you. The company emphasized the importance of “personal context” with Apple Intelligence, which will enable things like using natural language to search for photos that contain only you and a specific family member.

Apple highlighted how most Apple Intelligence actions will be done on-device to make the system as privacy-focused as possible. For queries that cannot be done locally, the work will be sent to Apple’s processing centers. The company also created Private Cloud Compute, a feature that’s supposed to utilize the cloud for more advanced AI processing while also making sure your data remains secure.

OpenAI’s ChatGPT is also integrated into Apple Intelligence, allowing users to give Apple permission to share their queries with ChatGPT in the moment. ChatGPT will also work with the AI writing tools coming to iOS and iPadOS 18 in a new Compose feature. ChatGPT integration with iOS 18, iPadOS 18 and macOS Sequoia will roll out later this year, and apparently Apple intends to add support for other AI models in the future — meaning its partnership with OpenAI isn’t a long-term exclusive.

iOS 18 and iPadOS 18

The next iPhone software update will roll out to users in the fall and, as expected, one of the biggest changes is support for Rich Communication Service, or RCS. The more-secure messaging protocol offers many improvements over SMS including end-to-end encryption, better media sharing and support for proper group chats. Apple previously stated it would adopt support for RCS in 2024 to comply with EU regulations, so it’s unsurprising to see it highlighted in iOS 18’s forthcoming features. Also new to Messages will be the ability to “tapback” reply using emojis and stickers, text formatting and effects and the ability to send messages via satellite.

iPhone users will have more control over their home screens in iOS 18 thanks to the fact that it will not be a locked grid system anymore. Users will be able to move app icons a more of a freestyle way, plus they’ll be able to change app icon colors as well using a tint color picker. In terms of design and layout, this is one of the biggest changes to come to the iPhone’s home screen in years and it gives iOS users similar features that Android users have had for a long time. In the same vein, Control Center will be updated in iOS 18 to include more customization options and will allow users to program quick controls form third-party apps in addition to the native options.

The Photos app is getting a big redesign in iOS 18, putting an emphasis on intelligently created groups of photos that revolve around memories, trips and other big events. The new design ditches the old tabbed layout and will usher in a one-page design when you can view all of your photos individually, or view them by Collections. Users will also be able to filter out things like screenshots and receipts that would show up in a chronological format, but would otherwise mess up the a tightly curated group of vacation photos.

A couple of new privacy features stand out in iOS 18, namely the ability to lock and hide apps. For the former, users can lock an app so sensitive information stays behind a Face-ID or Touch-ID wall, preventing even those who you casually hand your iPhone to from seeing that information. Hiding an app, on the other hand, does exactly what you think: hides a program in a special hidden folder that others won’t be able to see.

The Calculator app is getting a big overhaul in iOS 18, including improved unit conversions, a sidebar showing recent activity and integration with the Notes app. But what might be even more notable is the fact that the revamped Calculator app will not only be available on iPhones and Macs — it’s coming to iPads for the first time as part of the iPadOS 18 update. Embedded within the iPadOS Calculator app is a new feature called Math Notes, which lets users write out math equations with the Apple Pencil and the app will solve many of them instantly.

iPadOS 18 will also feature a new Tab Bar, which looks similar to the Dynamic Island on iPhones. This bar makes it easier to access essential controls even when you’re in apps, and depending on what you’re doing, it can show up at the top of the screen or as a sidebar of sorts on the left of the display. The Notes app is getting another new feature called Smart Script, which will make users’ handwriting more legible and less messy automatically.

macOS Sequoia

The next iteration of Apple’s computer software will be called macOS Sequoia. In addition to many of the AI features also coming to iOS and iPadOS 18 as part of Apple Intelligence, the next macOS update will include iPhone mirroring, which lets users see and control their iPhone screen on a Mac screen. They’ll be able to use their keyboard and trackpad to intact with the iPhone screen on their laptop, and they can even open iOS apps directly on their computers.

A new Passwords app builds upon the technology of iCloud keychain to save all of users’ passwords and login credentials across devices and platforms (it will be available on Windows in addition to iOS and iPadOS). Along with standard passwords, the new app can save passkeys, verification codes and more, and give users the ability to securely share passwords with others.

Other updates coming in macOS Sequoia include a snap window arrangement tool with accompanying keyboard and menu shortcuts, Presenter Preview, which lets you see what you’re about to share with call partners before they see it, and gaming upgrades like improved Windows porting capabilities using Gameporting Toolkit 2.

watchOS 11

The next software update for the Apple Watch includes two big changes: Training Load and a new Vitals app. Training Load in watchOS 11 essentially uses many of the health and fitness metrics collected during workout tracking to estimate your effort level each time. Each workout will receive a rating from one (easy) to ten (all out) that estimates how hard the user worked during that particular session.

The new Vitals app will show Apple Watch users how their vitals captured, including heart rate, compare to baseline measurements. This will hopefully allow users to better understand when something might be off and outside the normal suggested range.

The Activity app on iPhone is also getting an update to accompany watchOS 11, and will allow users to customize the data they see on the homepage so they can put the most important stats to them front and center. Cycle Tracking will also get an update to include more detailed pregnancy insights, including gestational age and information about the user’s health metrics that may related to pregnancy (like heart rate fluctuations). 

visionOS 2

Until now, Apple’s Vision Pro headset has only been available in the US. That’s changing soon as the company announced the device’s rollout in additional countries including Australia, Canada, China, France, Germany, Japan, Singapore and the UK. As far as the headset’s software, visionOS goes, Apple announced that visionOS 2 will add spatial photos, which adds depth to images in the Photos app, new UI gesture controls and improved Mac screen mirroring with support for higher resolutions and display sizes.

AirPods Pro audio updates

Apple briefly mentioned some software updates coming to AirPods Pro, including improved Voice Isolation, which should help the buds better pick up a user’s voice in noise environments. A new Siri Interaction is coming to AirPods Pro as well: a silent head-nod will allow users to answer an incoming call without saying a word out loud to Siri, and contrasty, a shake of the head will decline a call. These silent interactions will also be applicable to messages and notifications, in addition to calls.

Developing…

Catch up here for all the news out of Apple’s WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/wwdc-2024-everything-apple-announced-today-including-ios-18-ai-with-apple-intelligence-and-more-184422477.html?src=rss 

Apple’s macOS 15 update is called Sequoia. The 2024 Mac software, coming this fall, includes iPhone mirroring and notification, a new passwords app and Safari upgrades. The new software was announced at Apple’s WWDC 2024 keynote at Apple Park.

iPhone mirroring lets you use your Mac to view, control and interact with your phone. It lets you access iOS apps and receive notifications from your nearby handset. Your iPhone screen stays locked in Standby mode (one of iOS 17’s updates) while you work on your computer.

macOS Sequoia also adds a new Windows-like snap window arrangement tool. Drag an app near the screen’s edge, and macOS will automatically suggest where to tile it. You can quickly place them side by side or in corners. Sequoia will also include new keyboard and menu shortcuts to arrange tiles even faster.

Apple highlighted new video conferencing features in its WWDC keynote. Presenter Preview lets you see what you’re about to share with your call partner(s) before they see it, potentially saving folks some mistakes or embarrassment. Meanwhile, Background Replacement (as its name implies) lets you swap out your real background for built-in ones or your own photos, similar to features in many calling apps.

1Password’s developers are likely squirming today with the introduction of Apple’s new Passwords app. Building on iCloud Keychain and the passwords previously buried in Safari’s settings (and system settings on iPhone and iPad), the standalone app will include all your saved credentials, verification codes and security alerts. It syncs across devices and will also appear on iOS, iPadOS, visionOS and even Windows (via iCloud for Windows).

Safari also gets some upgrades. These include Highlights, which automatically detect relevant info from webpages, and Summaries, which provide AI-fueled recaps of web content in a redesigned Reader mode.

macOS Sequoia has some gaming advancements, including improved Windows porting capabilities in Gameporting Toolkit 2. Apple said it will also be easier to port Mac games to iPad and iPhone, potentially giving developers an extra financial incentive to make or port titles for the Apple ecosystem.

Catch up here for all the news out of Apple’s WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/macos-sequoia-will-let-you-see-your-iphone-mirrored-on-your-macs-screen-180215857.html?src=rss