I'm not sure I can add anything to the thread other than moral support. I was the same way (as the thread starter). I got pretty good and people I know began to notice. So I did a couple of free jobs to help a friend and it boosted my confidence. Then more began asking, and at first it was for a few dollars, followed by a couple hundred dollars per session, and then I went and did the same thing many others do: website, business cards, some promotion. It began to take off and was exciting for a bit. But it quickly became a drag as I stopped caring about all the portraits I was doing. Head shots for new actors, senior pictures, engagement photos, kids in ballet, yada yada.
I enjoyed meeting people. That was cool. And my skills improved, but it wasn't satisfying. Also, I have a high level of anxiety in general, and I was always worried about making a customer upset. It never happened, but it was always a worry.
I did shoot a wedding and it was pretty much the tipping point. A Facebook friend asked as a favor, and it paid a couple hundred bucks. It was supposed to be a very informal, one-hour session in a local city park. But when I showed up it was actually formal, with the groom in full military dress and the bride in an exquisite gown. They wanted a lot of shots and the whole thing took about three hours.
To make matters worse, the bride had (possibly literally) a photographic memory, and remembered every single shot I took. I spent a couple weeks processing images because I'm the kind of person who has a difficult time saying no. I wouldn't say she was a difficult bride in that she was very kind. But she nit picked everything. The fact that she was very dark skinned and he was extremely pale was a challenge I wasn't expecting (I only met the friend asking for the favor), and when processing she would say her skin was too light or two dark. I had to rework every image a few times.
In the end she was extremely satisfied, and my processing skills improved significantly, but I know I made about $2.00 an hour on that job and that was when I decided I didn't like professional photography.
So I started winding down slowly. I shelved the business cards, took down the website, and slowly began to turn down some jobs until I no longer shot for strangers.
This year (2016) I did two jobs, both for free. I didn't enjoy them (but I still enjoyed seeing their happiness). They were for friends. Even with friends I get requests for more after delivering plenty of photos or requests to erase wrinkles, thin arms, etc.
So in 2017 I won't be doing any jobs at all. I'm totally over it. I am not a good business person, and I'm okay with that. I have a great teaching career that pays well, has benefits, and provides for the family. My wife has a business that she runs from home and she knows how to do it right in terms of laying down ground rules for the client. Her pricing is relatively high for what she does, but her service is excellent and she knows how to say no. Nobody takes advantage of her more than once.
As for photography, sometimes I go days or weeks without taking pics. But I'll never stop. I just learned to not think about it too much. It's a hobby and I don't want to worry about how important it is to me right now. I don't have to make decisions about the future of my photography. For now I'm just relaxing.
For the OP: keep some kind of digital camera, even if it's a point and shoot. But don't think too much about it. Just enjoy life.