It might help to get a mini fridge just for keeping them, if you're concerned about other people's opinions. But at the end of the day, your health comes first, so other people's thoughts don't really matter.
And about the needle, the tip is only about 4mm, so you won't feel it pierce the skin...