Cheltenham Milk Bar in Devonport is known for its ice cream and gelato, smoothies, and sweet treats like cinnamon scrolls and ginger slice, alongside good coffee, pies, and sandwiches. It offers outdoor seating and a relaxed atmosphere with music playing.