6
$\begingroup$

ChatGPT-generated questions and answers are temporary banned on Stack Overflow. The reason is that the AI does not solve correctly all code problems and gives bad answers.

In Meta there was a proposal to ban ChatGPT in all the Stack net and they said we should define our own policy (status-declined).

I am inclined to do a more general policy about AI use, not specificaly about ChatGPT, as this is only the first acceptable version open to public and those systems will improve in the future.


Other Science sites AI/ChatGPT discussions:

Complet list of Stack Exchange sites discussions.


Recent news in AI products:

OpenAI AI classifier for indicating AI-written text.

GPT-4 available in ChatGPT plus (20$/month)

Plugins for ChatGPT available in ChatGPT plus

Microsoft incorporate GPT4 in Bing.

Google's AI tool Bard released in US and UK

$\endgroup$
3
  • $\begingroup$ Related. Apparently, to quote ChatGPT is allowed. $\endgroup$
    – user28185
    Mar 14, 2023 at 11:31
  • 1
    $\begingroup$ About quoting ChatGTP you might find interesting Do I need to cite ChatGPT in published writing?. Also might be a good idea to see if other Science SE sites have discussed this. $\endgroup$
    – Rubén
    Mar 14, 2023 at 13:51
  • 1
    $\begingroup$ @Rubén I added links to main Science sites discussion on this topic. $\endgroup$
    – user28185
    Mar 15, 2023 at 10:41

2 Answers 2

2
$\begingroup$

We don't want a ChatGPT site. In general I support a full ban of ChatGPT-generated questions/answers. If ChatGPT wants to create a Stack Exchange account, then it would be clear what content is human and what is not. The Stack Overflow ban you linked is good: https://meta.stackoverflow.com/questions/421831/temporary-policy-chatgpt-is-banned

I think we should adopt the same policy here on ES SE.

$\endgroup$
3
  • 1
    $\begingroup$ If you want to interact with Chat GPT, that's great. But, this site is not an interface for ChatGPT input/output. If people want the output of a language model then they can go directly to the model. $\endgroup$
    – f.thorpe Mod
    Apr 6, 2023 at 16:02
  • 1
    $\begingroup$ Bye! Good Luck! $\endgroup$
    – f.thorpe Mod
    Apr 6, 2023 at 17:23
  • $\begingroup$ I finally rest. I accept the ban but you should expand this answer to define what and what is not allowed. I guess there is not a trouble if I correct my english (well truely to translate my spanish to english) with the bot. I can also use the bot to evaluate answers and comment if the poster has missed something. And reading this I wonder if I am violating the policy or not doing so. $\endgroup$
    – user28185
    Apr 15, 2023 at 4:58
0
$\begingroup$

Edit

This proposal has not been well received. I marck the ban as the official policy.



I would allow the use of AI assistance, but I would not allow accounts based only on AI systems by users with no Earth Sciences knowledges.


I would not completely ban AI use to generate content just because GPT-3.5 fails to solve code or mathematics complex problems (it even have access to a computer to test its code).

Allowing answers generated by the AI however (AI based accounts), would be nonsensical, as a student can simply ask the AI, obtaining the same result, and we would be just copying AI output to the Stack Exchange server, wasting time, energy, and resources. The answers would also quickly become deprecated, as AI systems improve each day. Additionally, they would be link-only answers, which are discouraged here. We would also have the collateral damage of having users with no Earth Science knowledge earning reputation on the site, making it difficult for them to moderate anything related to Earth Science. So we should officially not allow AI accounts and if a user is clearly hijacking the reputation system, giving no sources to his link-only answers, and not giving signs of having Earth Sciences knowledges, moderators should ban this user.

However, asking the AI Earth Science questions and copying its answers is not the only way to use the tool. Just like a journalist, a scientist publishing content can benefit from AI in many ways.

I found six ways to use the engine as an assistant to help you generate content on ESSE:

1. Generate questions.

This is banned on Stack Overflow too.

I asked the AI to generate a question for us and it was a bit broad, so I performed my input entry, obtaining:

enter image description here

I find the questions generated by GPT-3.5 acceptable, but I am concerned that this could potentially be used to manipulate the reputation system by asking a large number of consecutive questions. On the other hand, ESSE does not currently have a high volume of daily questions, so if this feature is allowed, it could help our site grow. I would use it to get ideas for the title of new questions.

You can ask the AI to completely create the text of an ESSE question too:

enter image description here

As for literal answers, I am against allowing a user to hijack the reputation system using the AI to post literal AI-generated questions. I would allow the AI to get ideas for a question, but some own work should be shown while posting a question, it would be unfair to let a user generate dozens of question by this system.

Problem is how are we going to detect it. You can ban a user posting 20 questions in a day that are not specially elaborated, but you can have another user more cautious posting only a question a week. Moderators will have hard to detect this second user, as the current tools are not very accurated (they give false positives and false negatives).

2. Obtain partial information for your answer.

For example, to the question: "Who are winners from the global warming? Are there any?", in my answer, I could have asked the AI, "What are the global economic cost of natural disasters?" and then quoted the AI's data.

Global economic costs of natural disasters:

According to the United Nations Office for Disaster Risk Reduction (UNDRR), between 2000 and 2019, there were 7,348 natural disasters worldwide, resulting in 1.23 million deaths and $2.97 trillion in economic losses. This represents an increase in both the number of natural disasters and the economic costs of these disasters compared to previous decades.

Source: GPT-3.5

...continue with my own answer

For me there is not a big difference between quoting GPT-4 and quoting Wikipedia.

My wonder is if free GPT-3.5 would be considered a legitimate source, as it passes a history high school exam by the skin of one's teeth, but that's my problem as a publisher. But GPT4 does much more better than GPT-3.5 and its cost is 20$/month.

I asked the engine that, and apparently, it is okay to use its texts in ESSE (for ChatGPT). It says you should quote its text as "ChatGPT, an AI language model developed by OpenAI."

enter image description here

3. Find papers

enter image description here

4. Do SEDE queries

Can GPT-4 be used to do SEDE queries?

5. Detect mistakes on answers.

I asked ChatGPT if an obviously wrong answer is correct and the AI detects it is not:

enter image description here

I wonder here if it would be appropriate to use it to detect false information and penalize the content downvoting.

I think the site could benefict of having his own AI system incorporated to the system to detect wrong content if this technology improves its results.

6. Correct texts.

This is where the AI becomes a helpful tool for people like me who don't speak English very well. The AI can correct my texts and I have started to use it before posting. This brings me to the question of whether I should acknowledge the AI in every text I publish that has been corrected. The AI says "if you wish".

enter image description here

So, I think I am going to indicate in my profile that my texts are corrected by GPT-4, but I am not going to include a quote from it in the footer of my texts.

$\endgroup$
1
  • 2
    $\begingroup$ In case of a dispute, if someone ask me about an user arguing that they did something because ChatGPT said that is OK I will recomment to ignore that. The OpenAI ChatGPT Introduction already warns that "ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers. ", among other reasons. $\endgroup$
    – Rubén
    Mar 15, 2023 at 13:15

You must log in to answer this question.