What’s on my screen? -Learn about the content of your mobile screen

Your Google Assistant can display information, apps and actions that are connected to the content of your screen.

Important: Not all languages or countries support all functions.

• Say “Hey Google” and press the Home button on your Android smartphone/tablet.
• Ping My screen shows what.

Learn more about people: Get to know well-known individuals.

• Watch a video to learn more.
• Music: You can find more information about a song or an artist within your music app.
• Restaurants: See menus, reviews, and locate a restaurant’s address.
• Search on/off the screen
• On your Android mobile device, say “Hey Google, open Assistant settings.”
• Select “All settings” and then “General.”
• You can spin on or off the screen.

You can find information based on what content you are looking at. Your Google Assistant will upload content to Google if the button is turned on. Google Assistant can be called up using spoken commands or by pressing the home button repeatedly. As many of you know, Google owns the long-press home button. Now, Tap is a function that scans your screen and provides relevant information. This was before Google Assistant existed. It was extremely practical and astonishingly precise.

Google Assistant was the first to include this function, and it was renamed “What’s On Your Screen.” It was not a permanent feature in Google Assistant, and it appeared intermittently in different A/B testing. The “What’s On My Screen” feature in Google Assistant now appears as a recommendation button on Google Assistant’s home screen. It responds to your touch by providing pertinent information based on what was displayed on the screen. It seems like the functionality may be more prominent in the new Google Assistant user interface. Learn about what’s on your screen.

What’s an APK?

These improvements might not be included in an upcoming release. However, an APK breakdown can often forecast potential capabilities that may appear in an update. These functionalities are not yet included in the live build. They could be removed by programmers at any point in the future. Our previous APK analysis revealed that Google is testing a new section called “My activities” in the Assistant panel. As we know, Google is currently testing the “on my screen” component that will be available in the Assistant panel. It will present the same results as you would get if you pressed the “what’s my screen” recommendation chip. This is currently ineffective.

This Assistant UI won’t launch with the “on your device” section. The UI test is still substantial and ongoing. As you can see from the substitute green background chosen (presumably in preparation to Material You’s a new concept system). We would love to see this feature in a prominent spot in the Assistant, but Google will not remove it from another A/B experiment. Google Assistant will also get a Suggestion Chips feature that would provide proactive Shortcuts ideas based upon your application usage habits, as discussed at Google I/O 2021.

Google Assistant’s ‘What’s On My Screen’ feature might make a comeback

It turns out that Where’s Waldo is very similar to What’s on My Screen, as they both excel at hiding-and-seek. Although the Google Assistant tool was unavailable for some time, it seems that it is now back in service and even has a new design. Our friends at XDA Developers found proof of this in an APK break down. The interface is still in development, but it is evident that the tool’s results are collapsible. It will be located directly below the My actions panel. This allows you to quickly execute your most frequently used Assistant instructions.

These bright colors are just markers. They are probably there to mark Android 12’s Material You theme. Read more about it here. This picture does not show how the Assistant will look. Refresh your memory by looking at what’s currently visible on your screen. This will show you activities. It could allow you to describe what is on the screen in another language or interpret it. It was activated previously by clicking on a suggestion card, but it is now expected to work automatically. We will be able to automatically open Google Assistant on any display. It will suggest actions automatically without us having to input any further information. We will keep an eye on the situation, even though the exact timing is not known.

On Android, you may customize your home screen

If there aren’t any open apps, your Home screen will not show up. Your main Home screen will display the date, weather, and a few other apps by default.

Important:

• These actions are only available on Android 10 or higher. Find out how to determine which version of Android your device is running.
• For a few stages, you will need to touch the screen.

To access the home screen

Your phone will inform you that you can:

• Start at the bottom of your screen and swipe upward.
• Select Home or.
• Some smartphones may allow you to have multiple Home screens.
• Swipe right or left to navigate between them.

Make your home screen stand out

Method 1 – Update a program

A series of your favorite programs will appear at the bottom of your screen.

• Removing a favorite app: Touch and hold the app to remove it from your favorites. Drag it around to move it around.
• To add a favorite application, swipe up from the bottom. Tap and hold the app. Place the app in a space that isn’t already occupied by your other favorites apps.

Method 2 – Modify the Home screen’s additional settings

• Tap and touch the blank area of your Home screen.
• Click the “Home” button.

Search it from the home screen

• To start typing your query, select Google
• To ask your question or instruct your phone to do something, say “OK Google”. You can also choose Assistant Assistant. Get to know your Google Assistant.

Deactivate or activate search bar motions

Sometimes, animations will be used in the search function on your home screen. For holidays and celebrations, temporary graphics can be used.

These animations can be activated or deactivated by following the instructions:

• You can tap and hold the manual search button.
• Select preferences from the More menu.
• You can change the impact of the search field.

Google Assistant’s What’s On My Screen feature restores search results

Tokenless inquiry is a much-used Assistant function that Google Lens has replaced. “What’s On My Screen” disappeared in May and has now returned to Android. A pill-shaped option was available for “What’s On My Screen” before. It may be located just beside “Share screenshot.” Clicking on the link will search for people, places and other objects within the current understanding. The content is displayed as cards that include links to third-party apps, social media platforms, maps listings, contact information and websites.

Customers have been able find the information they need to create calendar events using Now on Click since it was launched. This includes user accounts, dates, times, and so on. In May last year, the screen search button was almost always displaying the error “Nothing Found on Screen” and it disappeared completely in the months following. Reddit reports that “What’s On My Screen” is still functioning as before. The functionality has been updated to the server and is now back as of the last 24 hours.

Screen search is available on all devices with Google App Beta 10.95 or 10.96. Yesterday night, the update started rolling out. Google Lens, the technology of tomorrow, is more focused on the actual world than the content on your device. You can import any image into Lens and the Google app’s snap tool allows you to perform screen searches.

What’s on my Screen?

XDA Developers noticed this feature being reintroduced while doing its routine APK disassembly. The website examines every detail within the Android APK code. Sometimes, these APK teardowns reveal development work for a new feature. After the website discovered evidence that Google was trying to revive “what’s in my screen”, this time it was. Its virtual death. If you have forgotten the command, what’s on your screen is a useful way to find out more about what you are seeing. It may provide additional information about the song or look up famous people.

Sometimes, these APK teardowns show development work for future features. After the website discovered evidence that Google was trying to revive “what’s in my screen”, this time it was. It has been saved from virtual death. If you didn’t notice the initial command, what’s on my screen is a useful way to find out more about what you are seeing. It may provide additional information about the song or look up famous people in writing. It is important to take the APK disassembly with a grain of salt. Although developers often add code to support future enhancements, there is no guarantee that these will be implemented.

Google also appears to be able to modify the “what’s in my screen” command on Android. The most recent release did contain an interesting development. Google is currently working on an Android “my actions” feature. This feature allows you to save frequently used commands, so you don’t have to repeat them every time you want them fired. This version adds a new section, “on my screen”, to the “my actions” pane. This page is currently blank, and it’s tinted green to indicate that it is still being constructed. This section could automatically repeat the “what is on my screen” command. This was an APK dive so there is no way to predict when or if this functionality will be available. Google may finally be able to return this useful tool if it sticks to its original position.

It is likely that this useful feature of proficiency will soon return to all devices

Android has the “what’s my screen” command that appears and disappears in Android without Google noticing. However, the tech juggernaut may make it silently available. We hope it stays that way. You may also be aware that Google Assistant provides useful instructions for unlocking and locking your phone. Once it recognizes your voice, you can ask Google Assistant to open your phone.

FAQs