Artificial intelligence pioneer seeks to democratize AI: Illia Polosukhin, one of the “Transformer 8” who invented the transformer neural network architecture at Google, left the company in 2017 to start his own AI venture, Near, with the goal of making AI more accessible and user-centric.
- Polosukhin co-wrote the seminal 2017 paper “Attention Is All You Need” with seven Google colleagues, laying the groundwork for modern generative AI systems like ChatGPT.
- While at Google, Polosukhin advocated for open-sourcing the transformer architecture, believing it was crucial for widespread adoption and innovation in the field.
- Google began using transformers in its translation services in 2018, leading to significant improvements, but the technology didn’t gain mainstream popularity until the launch of ChatGPT in late 2022.
Pursuing a vision of user-owned AI: Polosukhin’s decision to leave Google was driven by a desire to move quickly and bring AI directly to users, free from the constraints and processes of a large corporation.
- Near focuses on developing AI that prioritizes user privacy and sovereignty, a concept Polosukhin refers to as “user-owned AI.”
- He believes that for Google, an idea must have the potential to generate at least $1 billion to justify the investment and resources required to bring it to market.
- By striking out on his own, Polosukhin aims to create AI solutions that can be rapidly deployed and iterated upon based on user feedback and needs.
The transformative impact of the “Transformer 8”: The work of Polosukhin and his colleagues has had a profound impact on the field of artificial intelligence, paving the way for the current wave of generative AI tools and applications.
- Nvidia CEO Jensen Huang credited the “Transformer 8” with laying the foundation for the AI advancements we are witnessing today during the company’s annual developer conference in March 2024.
- The decision to open-source the transformer architecture has been crucial in enabling the rapid development and deployment of AI systems across a wide range of industries and applications.
Analyzing Deeper: While the transformer architecture has undoubtedly revolutionized the field of AI, questions remain about the potential risks and challenges associated with the widespread adoption of these technologies. As AI becomes increasingly sophisticated and integrated into our daily lives, it will be crucial to address concerns around privacy, bias, and the ethical implications of AI decision-making. Pioneers like Polosukhin have an important role to play in shaping the future of AI and ensuring that it is developed and deployed in a responsible and equitable manner.
AI pioneer Illia Polosukhin, one of Google's 'Transformer 8,' wants to democratize artificial intelligence