Even though it is bitter, it should be eaten peel and all. The hair on the peel cleans the stomach from the inside.
The wiki does not say where to find Rabuta Berry yet.