We go inside a Victorian home with cosmopolitan decor and an endless stream of travellers