| Developers: | XAI |
| Date of the premiere of the system: | November 2023 |
| Branches: | Internet services |
Content |
2024: Source Code Discovery
In March 2024, a startup xAI Elona Musk developing artificial intelligence technologies announced the discovery of the source code of its large language model (LLM) Grok-1. Developers, companies and enthusiasts around the world can use the platform.
The Grok-1 model is based on the Mix of Experts (MoE) architecture, which significantly increases the speed and quality of request processing. The number of parameters used is 314 billion. The basic model is trained on a large amount of text data, but is not configured to perform any specific task, for example, to conduct dialogs. The Grok-1 pre-training process was completed in October 2023.
Access to the source code of the model is provided under the terms of the Apache 2.0 license, which gives the right to use the software for any purpose, freely change and distribute changed copies, with the exception of the name. As of mid-March 2024, Grok-1 is one of the largest open source AI models. The xAI report notes that the release includes "base model weights and architecture."
It is noted that due to the large number of parameters, significant hardware resources are required to use the Grok-1 model, including AI accelerators based on GPUs. By publishing the Grok-1 code, Musk hopes to encourage other AI system developers to transfer their products to the open source community. On the other hand, the availability of code for powerful AI models raises concerns from some critics, who talk about the possible unethical and dangerous use of such platforms. In particular, AI systems can be used to generate deepfakes that mislead users.[1][2]
2023: Neural Network Launch
On November 6, 2023, xAI, which is owned by American entrepreneur Elon Musk, announced and launched its first neural network. It was named Grok.
Grok's artificial intelligence was created inspired by a guide from the book and film "Hitchhiker's Guide to the Galaxy," which tells about exciting adventures in space, the xAI press service said.
 | Our Grok AI has the ability to answer questions wittily and has a penchant for rebellion, so please do not use it if you do not appreciate humor! - emphasized in the company. |  |
According to the developers, the main advantage of the new AI model in xAI is that it receives real-time world information through platform X (formerly known as Twitter). Grok is supposed to be able to provide answers to provocative questions that other systems cannot answer.
It is reported that the development of the algorithm began with the creation of a prototype of a large language model (LLM) Grok-0 with 33 billion parameters. This test model is comparable in its capabilities to the LLaMA 2 indicators from Meta Platforms (the company is recognized as extremist in Russia, its activities are prohibited in the Russian Federation) in standard tests, but uses only half of its training resources. Over the past two months, the developers have managed to achieve significant improvements in terms of logical analysis and coding capabilities, which led to the creation of a significantly more powerful language model of the Grok-1.
According to Elon Musk, by November 6, 2023, Grok can only be accessed when purchasing a Premium + subscription on platform X. It is not specified when the neural network will be available to everyone[3]
Notes
| The site content is translated by machine translation software powered by PROMT. The machine-translated articles are not always perfect and may contain errors in vocabulary, syntax or grammar. Read original article If you find inaccuracies or errors in the results of machine translation, please write to editor@tadviser.ru. We will make every effort to correct them as soon as possible. |