They're four rudimentary three-dimensional shapes.
They represent a child's building blocks.
Sony have made a point to never say.
They represented intended functionality - "O" is "Enter/Okay"
WhatCulture's Head of Gaming.