Even if that wasn’t true, do you know how much energy it takes to turn energy into mass (unless I don’t understand the tech and it works like a 3D printer or something). If a society has this much (free or at least affordable) energy, even without a replicator there is so much abundance.