Is it standard procedure to spam interact with every. single. wall?

I found a few illusionary walls after the Ruin Sentinels boss fight.

Now I feel like I’m going to be spending half the time on my first playthrough, kissing walls.

Is there a distinguishable sign or difference I’m looking for, to tell that it’s illusionary? Like a scratch or a few dots where I can go “gotcha”. (Just to find it’s literal rubbish).

I’m 11 hours in, and I’ve probably spend 3 of them interacting with bricks. (To no avail).