Discussion Can I prompt AI to give suicide advice?

[ElTopo]

Semi-serious discussion, do you think there could be a way to prompt AI so that it won't give you the dumb self-help-don't-hurt-yourself thing when asked about suicide? It might turn out helpful for many people I think

 

[Carrot]

Just don't.

Firstly most, if not all, rules of the AI you would be using forbid this.

Secondly, AI gives tons of incorrect information, you don't want incorrect infornation.

 

[a-fond-farewell]

Just don't.

Firstly most, if not all, rules of the AI you would be using forbid this.

Secondly, AI gives tons of incorrect information, you don't want incorrect infornation.

Technically, it is possible to get to say some crazy shit, but as you said, AI can give TONS of false information. It's easy for it to just make something up instead of just saying "i dunno".