I can't comment on the behavior of his students, but his ex-wife told the FBI that Feynman flew into violent rages and choked her on several occasions ( https://en.wikipedia.org/wiki/Richard_Feynman#Personal_and_p... ). I've always felt a bit queasy on reading that.
Another quote from that same link, from that same hateful person whose first grievance was that Feynman was just interested in calculations and playing the drum :
"I do not know—but I believe that Richard Feynman is either a Communist or very strongly pro-Communist—and as such is a very definite security risk."
I had read many books from and about Feynman, probably even more than the average HNer; first time I encounter such a claim. I do not believe in heroes and like to have my beliefs questioned, but in this instance I will still stand with Feynman. This case does not look like it is about violence.