The forearm velcro on my Joffas tore the hell out of my forearms. I put moleskin on the velcro that doesn't get used (and was rubbing my skin). I also started using long sleeves after that.
The moleskin solved the problem, but i ended up liking the long sleeves so much I've continued wearing them. If you really want to ditch the long sleeves maybe moleskin will help your issue.
Target, in the U.S., sells significantly large rolls of it for cheap.