Dubstheduke he was someone who was very easily irritated and often would fail because society seemed to be against him and what he was trying to do
This, my friend, is the most CRUCIAL part of your character. The reason for this character to become a villain is absolutely essential to building a solid villain these days, with all the "relatability" and "relativity" and "50 shades of morality" going around these days as compared to, say, 50 years ago.
Society is a common trope, but it's not very original and greatly overused. Sure, it's something we see every day, but you know, hammering home the idea isn't solving the problem either, now is it? It's like stating the problem but never offering a solution for it, which makes the characters weak in that respect. The villain has their solution, right? But what is yours? What is the hero's/protagonist's? Surely you aren't going to simply say "Humanity is better than that!" or something naive like that. After all, people can be quite nasty in real life, regardless of their backgrounds, and you can't really paint over it all with "your" solution; after all, there isn't really a solution. it'll all fall apart, starting with your villain, if you don't think about these kinds of things.
So I would suggest making it a little more complex than simply "society", or if you're going to go that route, at least make it something unique, rather than the cliched bullying or naivety routes.
One example? Perhaps the realization that everything around him is fake, a construct of the human imagination, where nothing is held sacred, and relationships, cordiality, and the concept of civility are merely feigned or acted out in the daily theater of misanthropy. It's important that your villain has this mental dystopia in their head, disillusioning them and driving them to do the things they do.
These kinds of "epiphanies" are somewhat more complex, and have to do with how the villain sees the world, rather than, y'know, "feeling" the world" through a punch in the gut or experiencing some traumatic event. It just makes them more interesting this way, and for some, more relatable.
It's also important that your villain has an idea of what they're trying to accomplish. Sure, this guy wants to be smart, and flawless in every respect, but to what end? Does he want to change society? Does he want to burn it to the ground? Or is he going to lord over it all, once he's reached the peak of society's hierarchy?
Dubstheduke But it's quite difficult to write a villain who is flawless, as you have to find a really good reason for them to lose in the end.
Not as hard as writing a good reason for them to be a villain in the first place. In fact, it's so important to have this reason, that it will play into every part of your villain's failure. It must, otherwise, there's no continuity. Perhaps it was something they overlooked while stewing in their illusory dystopia, some silver lining that no one showed him, or he never saw for his own bias.