If you ended up really getting into underwater photography, a cheaper option is just like a cheap tripod, where it's cost is just added to the proper tripod you buy later.
A DSLR setup, with housing, just 2 ports, a strobe, or two, ends up being a a lot of money and the money spent on a cheaper option is far less significant.
Again, the type of underwater you want to do, then the type you probably move to after some initial experiments will really determine what equipment is best.
Having some photographic and video experience, combined with what is available to most people: Youtube, which has endless examples of what is wrong with amateur video, I approached my first underwater video with some sensible thinking IMHO.
I got a 5kg weight (11 lbs) and attached my GoPro to that. Intention was some surfing and wave action where I would place it in the sand and just let it run.
For first attempt, with snorkeling gear, I placed the weight / GoPro in the sand in some rock pools at a beach, pointed up at about 45 degrees. I swam off a bit, not too far, so I could watch what happened. Sure enough, once I was a little distance away, I could see various fish swimming past the GoPro. The poor quality of the GoPro worked quite well. Only the centre part of the image has decent quality, the edges are very ordinary. So as a fish entered the frame, in the blurry edge part, it would attract your attention and as it moved into the centre of the frame where there is some quality you got a decent look at the fish before it swam off towards the other blurry edge.
The weight was overkill for this use but I had intended to place it in the sand under surf and catch surfing and wave action where more weight would be needed to keep it in place.