What Is Live Text in iOS 15 and How to Use It on iPhone and iPad

Jun. 30, 2021



Many a time, we come across a situation where extracting text from an image becomes the need of the hour. Whether it’s a quick online search, sharing certain information, or digitizing things like phone numbers and emails, we have to rely onOCR appssuch asGoogle Lensto get the job done. While it’s okay to use a third-party OCR app to do the needful, it’s always better to have a native alternative. And exactly that’s what has made Live Text a fan favorite in iOS 15. Should you wish to go hands-on with this new feature, read on to learn what is Live Text and how to use it in iOS 15 on iPhone and iPad.

Here, we not only explain how the Live Text features works in iOS 15 but also teach you how to use the feature via multiple methods, including the camera app, Photos app, and more. So, let’s get down to it!

Live Text is a classic example of how smartly Apple takes inspiration from third-party offerings and comes up with something more efficient and deeply integrated into the Apple ecosystem. IfNight Mode on iPhone 11 seriesseemed fascinating despite coming late to the party,AirPodsdidn’t take much time to bring about a resolution in the true wireless earphones segment. The Cupertino giant’s repertoire of coming from behind and adding a more compelling alternative to an existing app or feature is well-known. And Live Text inherits all the characteristics that Apple is known for.

Google Lens has long been a top-notch app for recognizing objects, animals, extract text from an image, and more. However, it isn’t as integrated into the Android experience as Live Text is in iOS 15, iPadOS 15, and even macOS Monterey. TheLive Text feature works the same as Google Lensand makes extracting text from images (or almost anything around you) a pretty intuitive affair. Just point your camera at any object to extract a phone number, email address, directions in Apple Maps, and more.

You can use Live Text in the native Photos and Camera apps as well as inside other apps likeSafari,Messages,WhatsApp, and more. Plus, you can also bring it up fromSpotlightto quickly look for anything that catches your eyes. To be more precise, you can trigger Live Text from any text input field on your iPhone and iPad. Thus, it wouldn’t be wrong to say that Live Text in iOs 15 is one of the best OCR (Optical Character Recognition) powered features out there.

Unfortunately, not alliOS 15 compatible iPhonesand iPads support Live Text. So make sure you have a compatible iOS device to use this feature.

Here is the List of Live Text Compatible iPhone Models:

Here is the List of Live Text Supported iPad Models:

Currently, Live Text in iOS 15 recognizes seven languages, includingEnglish, French, Spanish, German, Portuguese, Italian, and Chinese. Apple is expected to add support for more languages in the coming months.

Live Text is neatly integrated into the stock camera app on iOS 15. So, whenever you come across something you want to look up, copy, share or translate, you can do so with utmost ease.

  1. Launch the Camera app on your device and point it at an object or text. After that,look for the “Live Text” iconand tap on it. Do note that the Live Text icon shows up in the bottom right corner when in portrait orientation and the bottom left in the landscape orientation.

  2. Now, Live Text will recognize the text in the image. You can thenselect the textthat you want and use one of the following options:

It’s worth pointing out that when you tap on a phone number, a new context menu will appear with multiple options likeFaceTime, send a message, add to contacts, and copy. Likewise, if you tap on an email address, you will get the option to email right away.

Live Text works in the Photos app just as seamlessly. So, if you ever come across any image (including screenshots) and wish to extract text from it, you can get it done with ease. Just follow the steps below:

  1. Open thePhotos appon your iPhone or iPad. Then, navigate to the image you want to extract text from.

  2. Now, tap the tinyLive Text icon(looks like a square viewfinder with three lines) at the bottom right corner of the screen. Live Text will instantly recognize all the available text in the image.

  3. Next, select the text you want tocopy, share, look up, or translate.

Live text is equally efficient in terms of extracting text from a handwritten note. If you wish to digitize your notes to keep them secure and accessible across devices, Live Text OCR can come in super handy.

Simply launch thecamera appon your iOS 15 device. Then, allow the viewfinder to appear around the handwritten note. After that, tap theLive Text buttonto convert the handwriting into text. After that, select the text and then do the needful.

Imagine you are in the midst of a conversation with your colleague or friend. Suddenly, you need to extract text from an image and share it. Wouldn’t you want to get everything done without having to leave the conversation thread? Yes, you would. That’s the flexibility iOS 15 offers by letting you invoke Live Text from inside a messaging app.

Open a messaging app like Apple Messages. Then, tap and hold the text input field. After that, tap the “Text from Camera” option. Now, use your iPhone/ iPad’s camera app to extract the text from an image and share it without ever leaving the messaging app. Pretty cool, isn’t it?

Spotlight has got many interesting hacks up its sleeve, including the ability to let you use Live Text in iOS 15. To use the feature, swipe down from the middle of the home screen to bring up Spotlight Search. After that, touch the text input field and select the “Text from Camera” option. Now, go ahead and do the needful as explained in the steps above.

Having a smart OCR tool accessible within a browser at all times means you can use it to recognize text and get started with the search without wasting any time. So, the next time you come across something that makes you curious, do not forget to bring up the Live Text OCR feature in Safari on iOS 15.

To use it, tap and hold the search bar textbox and then select the “Text from Camera” option. Now, follow the steps detailed above to extract text from an image or real-life object and get started with a quick search.

Interestingly, iOS 15 also lets you check the file size of the selected text before sharing. It could come in handy when you want the file size of the selected text to be minimal for smooth sharing.

  1. Now, choose the “ShowFile Size” option from the iOS 15 Share sheet. Voila! It will instantly show the file size of the selected text at the top of the screen.

Notably, you can also translate selected text offline. Save it for times when your iOS 15 device is not connected to the Internet, but you want Live Text to continue to work well, and without any hiccups. Bear in mind that offline translations may not be as accurate as online translations.

To get started, make sure you have enabledon-device translation. Also, ensure that you have downloaded the languages that you want to translate.

  1. Now, turn on the toggle next to the “On-Device Mode” option.

  2. Also, make sure to download the languages you want to translate. We have listed the supported languages at the start of this article. Next, tapDownloaded Languagesand download the preferred languages so that they are available offline.

  3. That’s it! From now onwards, you will be able to translate languages even when your iPhone or iPad is not connected to the Internet.

While Google Lens has been around for several years, Apple’s Live Text feature has just hit the ground. So, in terms of experience, Google’s offering takes the cake. Not only that, Google Lens also has an upper hand when it comes to universal compatibility.

But what tilts the tide in favor of Live Text is the unmatched system-wide integration into the Apple ecosystem. And that is likely to get even better with time. That leaves us to the final frontier: Efficiency. To ward off the temptation of a surefire conclusion, I would direct you toAkshay’s in-depth comparison between Apple Live Text and Google Lens.

Tips to Use Live Text on iPhone and iPad Like a Pro

Tips to Use Live Text on iPhone and iPad Like a Pro

That’s all about Live Text in iOS 15! Even though iOS 15 is still a work in progress, Live Text works quite reliably. And by the time Apple eventually rolls out the latest iteration of iOS this fall, it should become even better. Google Lens may have years of expertise under its belt, but Apple’s Live Text seems to have a clear edge in ease of use and intuitiveness – at least for now. By the way, what’s your take on Live Text in iOS 15? Share your thoughts on the coolest iOS 15 features, includingFocus mode,ability to drag and drop files across apps in iOS 15,FaceTime calls to Android,Apple Digital Legacy, and more.

An old school bibliophile who turned a tech nerd out of obsession. When he is not digging into hacks and tracking down stories that are breaking the internet, you may find him reciting poems.

Powered by Hugo