With this article we shall look more in detail at the relationship between Artificial Intelligence (AI) in its Deep Learning component, and computing power or hardware, a connection we started exploring with our previous article, “When AI Started Creating AI“. The foundations for understanding the link between AI-Deep Leaning and computing power being laid, the next article will focus on political and geopolitical consequences of this relationship, while considering a critical uncertainty uncovered here and according to which the evolution towards co-designing AI-Deep Learning architecture and hardware could alter the whole field.

相关的

人工智能、计算能力和地缘政治 (2): what could happen to actors with insufficient HPC in an AI-world, a world where the distribution of power now also results from AI, while a threat to the Westphalian order emerges

高性能计算竞赛和权力--人工智能、计算能力和地缘政治(3)。: The complex framework within which the responses available to actors in terms of HPC, considering its crucial significance need to be located.

Winning the Race to Exascale Computing – Artificial Intelligence, Computing Power and Geopolitics (4): The race to exascale computing, state of play, and impacts on power and the political and geopolitical (dis)order; possible disruptions to the race.

Our aim is to understand better how computing power can be at once driver, stake and force for AI expansion and the related emerging AI-world. Computing power is one of the six drivers we identified that not only act as forces behind the expansion of AI but also, as such, become stakes in the competition among actors in the race for AI-power (Helene Lavoix, “人工智能--力量、驱动力和赌注红色(团队)分析会, 2018年3月26日)。

In this article we show that AI-Deep Learning indeed needs large computing power, although varying across the different phases of computation and evolving with improvements. Even though advance of AI systems leads to a decreasing demand for computing power across the process of an AI-system’s creation, the very search for optimisation not only demands more computing power, but also leads to changes in the hardware field (which we shall see more in detail in the next article), and even, potentially, in terms of algorithms. Meanwhile, more computing power also means the capability to go further in terms of Deep Learning and AI, indeed confirming that computing power is a driver of AI expansion. Feedback loops or rather spirals are thus starting to appear between AI and its expansion and at least two of its drivers, computing power and “algorithms”.

We explain first the methodology used to uncover the link between AI-Deep Learning (DL) and computing power in a rapidly evolving ecosystem, and point out two likely new frontiers in the field of Deep Learning, namely Evolutionary Algorithms applied to Deep Learning in general and Reinforcement Learning. We also briefly present the three phases of computation of an AI-DL system. Then, we deep dive into each of the phases: creation, training or development, and inference or production. We explain each of the phase and the needs in terms of computing power for each of them. We then move beyond categorisation and explain the constant quest for improvement across the three phases, pointing out the balance that is sought between key elements. We notably emphasise there the latest evolution towards codesign of Deep Neural Network architecture and hardware.

The life of an AI-DL system and computing power in a rapidly evolving ecosystem – methodology

这是一篇高级文章。要访问这篇文章,你必须成为我们的 成员. 登录 如果你是一个会员。该文章的PDF版本可供会员使用。

FULL ARTICLE 3113 WORDS – pdf 11 pages


特色图片。 ORNL Launches Summit Supercomputer on Flickr (Public Domain) 30 May 2018.

由Dr Helene Lavoix (MSc PhD Lond)发布

Helene Lavoix博士伦敦大学博士(国际关系) ,是Red Team Analysis Society的总裁/CEO。她专门研究国际关系、国家和国际安全问题的战略预见和早期预警。她目前的工作重点是乌克兰战争、国际秩序和中国的崛起、行星越轨行为和国际关系、战略预见和预警方法、激进化以及新技术和安全。

加入对话

1 评论

发表评论

您的电子邮箱地址不会被公开。

本网站使用Akismet来减少垃圾邮件。了解您的评论数据如何被处理

ZH