Well it seemed a lot tougher than I thought, and no one could remember the name of the place.
It is Fajã das Galinhas, one of the most remote villages on the island, in Câmara de Lobos.
Here is a reminder of one of my tours with the bus.
This is the view looking to the village.