First Joseph was hated for his God-given dream. Then he was sold into slavery by his own brethren. If that wasn't bad enough, he was falsely accused of a horrible crime, and ended up in prison.
I believe that every born again Christian should have a ministry. Perhaps their circumstances or past sin might disqualify some from specific types of ministry, but they should have a ministry nonetheless.
If you are right with God, don't worry about what others think. Serve selflessly. Overcome the persecution complex. Your ministry may be simple or seemingly invisible, but it is imperative that you serve the Lord wherever you are! Don't let bitterness rob you of the blessing of serving God!
Genesis 40:5-15, "And they dreamed a dream both of them, each man his dream in one night, each man according to the interpretation of his dream, the butler and the baker of the king of Egypt, which were bound in the prison. (6) And Joseph came in unto them in the morning, and looked upon them, and, behold, they were sad. (7) And he asked Pharaoh's officers that were with him in the ward of his lord's house, saying, Wherefore look ye so sadly to day? ( 8 ) And they said unto him, We have dreamed a dream, and there is no interpreter of it. And Joseph said unto them, Do not interpretations belong to God? tell me them, I pray you. (9) And the chief butler told his dream to Joseph, and said to him, In my dream, behold, a vine was before me; (10) And in the vine were three branches: and it was as though it budded, and her blossoms shot forth; and the clusters thereof brought forth ripe grapes: (11) And Pharaoh's cup was in my hand: and I took the grapes, and pressed them into Pharaoh's cup, and I gave the cup into Pharaoh's hand. (12) And Joseph said unto him, This is the interpretation of it: The three branches are three days: (13) Yet within three days shall Pharaoh lift up thine head, and restore thee unto thy place: and thou shalt deliver Pharaoh's cup into his hand, after the former manner when thou wast his butler. (14) But think on me when it shall be well with thee, and shew kindness, I pray thee, unto me, and make mention of me unto Pharaoh, and bring me out of this house: (15) For indeed I was stolen away out of the land of the Hebrews: and here also have I done nothing that they should put me into the dungeon."