Am I wrong to be hesitant about entering into a biracial relationship?

I grew up in South Africa and it is very much the norm to date within your racial group, but I have met a man who is funny and smart and y and makes me laugh (is possibly a bit of a player) but is from an Indian family. He was born and raised in the UK, and IS British, and while I know on an intellectual level that there is nothing to stop us, but I don't know if it's my upbringing kicking in or if deep down at heart I'm some awful small minded bigot, but I am nervous about that aspect of the relationship. My family would NEVER accept it should it get serious, and even my friends would posibly be a bit taken aback as I would be the only one in our group dating someone not white. I am really attracted to him, and we get on so well, but I'm very confused and worried that I'm going to hurt him with a small minded outdated unacceptable way of thinking, but I can't seem to help being hesitant. Not sure what to do....