Collaborative Intelligence Week in Review - 19Apr2024
Best business article(s) I read this week…
Reinventing the Organization for GenAI and LLMs
As I have discussed elsewhere, AI can be used for task sharing or completing work supervised and validated by humans. The author describes these situations and argues that generative AI's human-like qualities will affect organizational structure and hierarchy much more than previous foundational technologies. He presents three principles for reorganizing work around AI.
GPT versus Resident Physicians — A Benchmark Based on Official Board Scores
The authors compared the performance of ChatGPT-4 on residency examinations in five areas: internal medicine, general surgery, pediatrics, psychiatry, and obstetrics and gynecology. Their findings: GPT-4 ranked higher than most physicians in psychiatry, and it performed similarly to the median physician in general surgery and internal medicine. Its performance was lower in pediatrics and OB/GYN “but remained higher than a considerable fraction of practicing physicians.” Their conclusion: “These findings underscore the potential maturity of LLM technology, urging the medical community to explore its widespread applications.”
Best technical article(s) I read this week…
Appropriate reliance on GenAI: Research synthesis
The researchers reviewed 50 papers to identify:
the factors that may create situations in which users over-rely on generative AI,
effective mitigation strategies, and
work design strategies that can lead to appropriate reliance on generative AI.
Character is Destiny: Can Large Language Models Simulate Persona-Driven Decisions in Role-Playing?
The authors explore how well LLMs can simulate the decision-making of individual personas after being fine-tuned using characters from novels. It’s an interesting exploration.
News items I found interesting…
Stanford University’s Institute for Human-Centered AI published its seventh annual report on the state of AI and its influence on society. It’s always a great read, and it’s packed with data and visualizations.
Boston Dynamics unveils its new Atlas robot
The company announced its new Atlas robot. It is a fully electric humanoid robot designed for human collaboration and task assignment. The link in the title takes you to an NBC News item with a video demonstrating its abilities. (I considered putting this in the “Coolest thing I saw…” section, but it is more newsworthy given its demonstrated capabilities.
ReGenAI, the First Generative AI That Automatically Regenerates in Real Time
Dataminr announced a new AI-driven service that provides event briefs in real-time as the event unfolds. It is based on the company’s “multi-modal fusion AI” technology.
MIT is hosting this free virtual summit on May 2, 2024. Its theme is “empowering an AI-fueled workforce.” I will be attending. It features two speakers I am interested in hearing: Ethan Mollick, a professor at Wharton and the author of the “Reinventing the Organization for GenAI and LLMs” article referenced above, and Zeynep Ton, a professor at Sloan and the author of The Good Jobs Strategy, a book I recommend (which is currently free for those of you who have a Kindle Unlimited subscription).
Coolest thing I saw…
The company claims it can create your digital twin to help you “scale your expertise and availability, infinitely.” You can interact with their example clones. I thought their collection of philosophers was interesting.
A company that caught my eye…
I’ve written about this company before, but not in this section of the newsletter. As its name implies, it manufactures collaborative robots (cobots). This week, the company announced the completion of its Series B funding round, raising $100M, led by General Catalyst.