After installing ARM Linux I did not get an IP Address from the DHCP Server. I logged in using a serial cable and checked whether dhcpcd command was working. I got an IP-address.
Checked whether the dhcpcd.service was enabled and that is where the problem lies.
Solution:
systemctl reload dhcpcd
Hopefully this helps others with the same problem.