AI Reference 037 Neural Networks & Deep Learning Wikipedia guided Primary sources linked

ImageNet and AlexNet

Definition

AlexNet's strong result in the 2012 ImageNet competition helped demonstrate the effectiveness of deep convolutional neural networks trained on GPUs and large image datasets.

What is ImageNet?

ImageNet is a large image database organized around WordNet concepts. The ImageNet Large Scale Visual Recognition Challenge gave computer-vision researchers a standardized benchmark with large numbers of labeled images.

What was AlexNet?

AlexNet was a deep convolutional network created by Alex Krizhevsky, Ilya Sutskever and Geoffrey Hinton. It won the 2012 ImageNet competition by a large margin compared with the previous generation of methods.

Why 2012 became a landmark

AlexNet combined a deep CNN, large labeled data and GPU training. The result convinced much of the field that deep neural networks could outperform hand-engineered vision pipelines when enough data and compute were available. Investment in deep learning accelerated rapidly afterward.

Related terms, defined

Neural Networks & Deep Learning GPUs and the Rise of Deep Learning GPUs perform many numerical operations in parallel, which fits the matrix and tensor workloads used in neural-network training and inference. Neural Networks & Deep Learning Deep Learning Deep learning uses neural networks with multiple layers of learned representations. Its modern rise combined larger datasets, better training methods and parallel hardware. Neural Networks & Deep Learning Attention Mechanisms Attention computes context-dependent weighted combinations of representations, allowing a model to emphasize information relevant to the current prediction. Neural Networks & Deep Learning The Transformer Architecture The Transformer was introduced in the 2017 paper “Attention Is All You Need.” It replaced recurrent sequence processing with attention-based layers, enabled highly parallel training and became the architectural basis of most modern large language models. Neural Networks & Deep Learning Encoder-Decoder Models Encoder-decoder architectures turn an input into internal representations and then generate an output sequence or structure conditioned on those representations.

Reference guide and primary sources

Wikipedia is used here as a terminology and history reference guide. Current model versions, institutional statistics and product-specific claims are also linked to first-party or institutional sources because those details can change faster than encyclopedia articles.

← Word Embeddings GPUs and the Rise of Deep Learning →