No it shouldn’t. One guy’s casual comment doesn’t prove anything one way or the other about an institution practiced by millions of people throughout both hemispheres. And arguably even he was using the word “slave” metaphorically for rhetorical effect. This same source also says that the Irishman performs his duties like a horse “without thought or reason“. I wouldn’t take this author as the final authority on that.