Just who will program the AI? It would seem that non-AI cannot program greater AI than the non-AI itself has. Thus we are left with a paradox that the AI we create is no more intelligent than our own. Gain=0.
Not necessarily so. Given the same program with more working room and better connections and faster synapses, we could well end up with something smarter than we are.
The question is whether an AI is self-aware. These things which are self-aware have the same rights we do, inherently --it's not a question of "should they", but whether they do, and that depends on self-awareness.
There are still some who maintain that any sufficiently complex neural system will give rise to self-aware intelligence. They tend to hold that intelligence cannot be programmed, that all that can be done is to give it basic algorithms and parameters and turn it loose to learn and see if it "wakes up".
Watson had some amazing capabilities, but understanding was not one of them. Of, he could follow human grammar and thus the questions, but his "thinking" process entailed sifting through reams of data to find something that fit his criteria for an answer. The most interesting thing about him was that the team had given him learning abilities, the capacity to create his own evaluation routines, and they had no clue in many instances why he "thought" as he did.
This is one reason there's a swath of AI people very interested in what's encoded into the structure of the human brain. The capacity for language is one, something made certain when the discovery was made that "baby talk" among siblings of the same age turns out not to be gibberish -- they've invented their own language, with it own vocabulary and grammar and everything!
In fact, though, there's still argument over how close we are to reverse engineering the brain. One of the big hurdles is that the brain wires itself -- and how do you get something made of silicon to do that?
There are also some who believe we'll never get good enough to create fully independent AI. Some believe, though, that what we may do is learn to 'scan' a brain and somehow transfer everything in it to a computer brain, making people effectively immortal... although that points to the question of whether the electronic copy is actually the same person.... I've written a couple of stories where such a transfer involves destruction of the brain, meaning you can't clone yourself into a computer as a backup, it's a one-way trip.