In Manukan you find a resort that offers proper accommodation, the Sutera Sanctuary Lodges. They have beach and hill chalets, at not very affordable prices.
If you stay on the island you will be able to enjoy the beach without the tourist hordes. The last of the day-visitors will leave with the boat that departs at 17h00.