I think deaf people would find it funny; it's not demeaning or anything. I would take the approach that you're trying to learn sign language but it isn't going very well, no one understands you, you tried to practice on the street and all the cars stopped, etc.
