I’ve had this for the most time, social fear with exactly that thinking. I did overcome it in the last years though. I can’t really explain how but I internalized that other people can be like that too, so you’re not alone, and that when there are no rules, you can behave how it’s comfortable to you and that’s 100% fine.