The citizens of EU member states can work freely in each other’s countries without a visa. Would people from relatively poorer countries overwhelm those in relatively richer countries?

For example, countries like Bulgaria and Romania, while considered wealthy on a global scale, are relatively poor within the EU. Will people from relatively poorer countries like Bulgaria and Romania overwhelm those in relatively wealthier countries such as Germany, Sweden, and Denmark?