Yes it would be inappropriate. A doctor dating his patient is generally considered a breach of medical ethics. Even if you were the one to initiate the relationship, your doctor could face severe sanctions from his licensure board, and even his ability to practice.
You should do what every young person should learn to do when faced with a strong attraction to a person who is unavailable, or available only at grave expense to themselves. You should learn to walk away and move on, and do so gracefully. It is a hard lesson. It can be a difficult skill to learn and people fail at it all the time. But why would you want to bring so much hardship and pain on someone you wish to have a relationship with? And it is so much easier for you to do the right thing now than later.
