If you attack a city that is still in cooldwon, you will not receive XP from city walls.
Wait for the cooldown to end before sending the troops to conquer it.