When you get off the boat, head towards Moon Hill, so called because of the hole in the middle in the shape of a half moon. If you have the strength, walk up the 800 steps to the top. The views from above are absolutely magnificent (1 hr, 9CNY).
Returning to Yangshuo from here will take about 30 minutes by bicycle.