Safe Superintelligence

History

2024: Establishing a Company

On June 19, 2024, it became known that OpenAI co-founder Ilya Sutskever, a native of Nizhny Novgorod, created Safe Oversight Inc. Its goal is to develop a "safe and powerful artificial intelligence system."

According to Bloomberg, the founders of Safe Oversight also include Daniel Gross, an investor and former head of AI at Apple, and Daniel Levy, who previously worked at OpenAI. The startup will open representative offices in Palo Alto (USA) and Tel Aviv (Israel). As of June 2024, nothing is said about the amount of financial investments in the project.

CNBC

When developing a new AI platform, Safe Oversight will focus on security issues. According to the founders, the project "will be completely isolated from external pressure," that is, the team will not have to release products within a strictly agreed time frame or focus on competition. In other words, the startup expects to avoid commercial pressure in order to focus as much as possible on the task at hand.

A feature of our company is that its first product will be a safe superintendent, and before its creation we will not do anything else, "emphasizes Sutskever.

Market participants believe that Safe Superintelligence will have no problems raising money, given the extensive experience of its founders in the field of AI and the huge interest in this area as a whole. Sutskever says he has spent years on research related to AI security. According to him, he has a number of ideas on this score, but the details are not disclosed. Safe superintelligence is in a sense a throwback to the original concept of OpenAI: it is about creating a powerful system that is comparable to or even superior to the human brain.^[1]

Notes