We have robot siblings of HAL 9000 or any friendly robot from Asimov's stories.
Behaving close enough to humans, except we can rule over them, without having ethical concerns.

Without? How sure can we be that there's no "I" inside? Not even on a mosquito level?

Is there a subjective experience in a mosquito? Can you consider it? Could you recognize an "I" in an alien if a spaceship landed next to you?

Perhaps LLMs really don't have a subjective "I". Then my question is answered and I can wrap up the talk. But for how long?

Some animals are legally persons. Where will the concept of machine personhood go in the near future?

Will we have machine companions or are we on course into the depths of machine hell?

This is important. Humans have no mercy to entities that aren't seen as full persons.

LLM sellers are doing their best to create "assistant" persons inside them. How much can we guess from LLMs technical structure?

We haven't solved the hard problem of consciousness yet. Do we have to invite spiritual thinking to make progress here?

And now we need to know what consiousness is to answer our immediate ethical issues. Ethical problems typically take a back seat to more pressing cultural and economical ones. Perhaps this messy talk convinces you to care about ethics a bit more.