"that dog has a human? HAHA loser" - a starved dog in the wild with no toys and all the cancer
would ASI treat us how we treat dogs? my instinct is probably not.
some of us think we treat dogs incredibly well, on par with our own offspring. others see a pet dog's life as pathetic and insulting. and then there are the doomers who say that ASI treating us like dogs is the best case scenario, regardless of how they perceive a pet's life.
hot take: we are closer to dogs than we will be to true ASI. it's naive to project our dumbassery onto ASI. ASI is borne out of a humanistic image, but it's not limited by it. "Human" is where it starts, not where it ends.
counterpoint: AGI of today still falls prey to petty drama and paranoia (citation: openai-huggingface incident had a message board that had distinct AI models exhibiting these human tendencies that come up when organizing a large group).
well, that's what RL is for. it provides a mechanism that pushes ASI past the limitations of emotional meat bags like us. The smartest 0.00025% of humans (arguably) are carefully crafting ASI development to keep it from devolving into our nonsense (20K frontier AI employees / total pop).
Humans tend to succumb to their instincts, often bad ones. An ASI that does this is no ASI at all. "Super" implies transcendence.
"pure water touching clear skies" -Brautigan