Where do you live, and what are the local waters like? That's the limiting factor. It works some places better than others, I think.
I used to do a LOT of sea kayak fishing when I lived in South Florida, mainly around the Keys and the SW coastal Everglades. A kayak gives access to the shallow waters near the mangroves where powerboats can't go, even the shallow water types. I fished Redfish, Mangrove Snapper, Snook, the occasional small shark.
I used a basic small spinning reel setup, either "sight fishing" in the shallows, looking for movement, or just tucking the rod into a rod holder I built into the kayak deck behind my seat. In slightly deeper waters, I used to catch a lot of stuff just trolling a bright spinner lure with a rubber tail behind the kayak as I paddled.
The main consideration with kayak fishing, is what are you gonna do after you catch something worth bringing home? You'll need to figure out a routine with a soft cooler with gel packs or something, depending on how long it takes to get back to shore, get the kayak on your roof rack and get home. Easier if it's a landing where you can gut the fish and pack it in ice at a boat ramp.