Walls

Some build walls to keep people out.
Others build them to see who'd care enough to bring them down, or jump over to them.
They build their own prison with their own hands, though they don't really want it.
In both cases, the walls look just the same.
How can you tell whether it's a stay away or come hither wall?