OpenAI's much-touted model GPT-4, lauded for its multimodal abilities, including advanced image recognition, still has significant flaws. These glitches range from inventing facts to misinterpreting chemicals' images and hate symbols, according to a new paper from OpenAI.
To stay ahead of AI developments, look here first.
https://preview.redd.it/openais-gpt-4-with-vision-still-has-flaws-reveals-paper-v0-cgciz4lp3uqb1.png?width=1108&format=png&auto=webp&s=48f763f97abcd40ad509987777a2001c0c45ef59Unintended GPT-4V behaviors
-
GPT-4V has a tendency to hallucinate or invent facts with unwarranted confidence.
-
The model struggles to make correct inferences, sometimes creating fictional terms by wrongly combining text strings.
-
It misinterprets certain symbols of hate and can give incorrect answers in the context of medical imaging.
OpenAI’s mitigation strategies
-
OpenAI has implemented various safeguards to prevent GPT-4V's misuse, such as breaking CAPTCHAs or using images to infer personal details.
-
The company insisted that GPT-4V is not to be used for identifying dangerous chemicals from image structures.
-
OpenAI acknowledged it has a long way to go in refining the model and is working on it.
Discrimination and bias
-
When OpenAI’s production safeguards are disabled, GPT-4V displays bias against certain sexes and body types.
-
The paper reported offensive responses related to body positivity when prompted by an image of a woman in a bathing suit.
P.S. If you like this kind of analysis, I write a free newsletter that dissects the most impactful AI news and research. 1000s of professionals from Google, Meta, and OpenAI read it daily.
Hello,
I want to study automation to do two things for my job. I'm hoping someone can tell me the term or software to study that would solve my problem.
I'd like to code a bot to:
-
Check Excel column H, if value is "f1" send message 1, if "f2" send message 2, etc.
-
From here if it's "f1" I'd like it to open a notepad, copy and message "message 1", then
-
Open Web browser, click new message (a button on website A), paste phone number that was in the same row that "f1" was in but column B, and then paste message 1 and click send button
Please advise!
Does it not make sense that automation should be used for very dangerous jobs? I mean jobs that have a high rate of injury and things like that, I didn't know if for example no person ever had to work on live utility poles, isn't it good to automate very dangerous jobs like that?