Yes it has to be connected using RJ45.
It can connect to another Airport (Express or Extreme) and very few others.
And this will extend the rang of your wifi connection.
But if you want to connect it to the other network, (in most cases) it has to be RJ45.