Am i being childish or is my neighbor just really annoying and inconsiderate?

Well if he has had a very hard life it may have had a negative affect on him. I think you should be proud of yourselves for being so good to him. He might have a drinking problem or some other sort of emotional problem. It's not your fault he acted like that. You have done all you can to be nice. I wouldn't stop being nice. Maybe pull back your friendship with him a bit for your own sake. Watch out for him while he's driving. You might have to report him to the police for the bad driving if he keeps this up.