By now you probably know Cloud Policy Service which allows you to apply policies to your Office applications (https://config.office.com/).
Until now, policies would have been applied to specific group(s) of users.
Well, good news as now you can apply a policy to all users in your tenant.
You can only apply 1 policy with a scope set to all users.
If you want to set the scope to all users for an existing policy, just use the copy capability which will automatically set the scope to all users.
Keep in mind the priority is taking precedence, so if you have other policies with different settings with a higher priority, these settings will take precedence.
The policy with all users scope is showing as Tenant in the policy list