DHCP and static IP on a single interface: static IP disappears

I recently migrated my Ubuntu Server to an OpenStack environment. I needed two different IP-addresses, and it seemed me wise to keep the first (primary) IP-address…