Technology & Innovation

Author

Carlos Barge

The “deep” in “deep learning” refers to the number of layers through which the data is transformed. Deep learning has a large number of layers as compared to classical neural networks. More layers capture more statistical invariances. Moreover, deep Boltzmann machines are universal approximators. In deep learning, each level learns to transform its input data into a slightly more abstract and composite representation.

The "deep" in "deep learning" refers to the number of layers through which the data is transformed.

Deep learning neural networks are usually trained by using iterative, gradient-based optimizer that merely drive the cost function to a very low value, rather than the linear equation solvers used to train linear regression models or the convex optimization algorithms with global convergence guarantees used to train logistic regression or SVMs.

The classical approach to training neural networks is to minimize a (regularized) loss using backpropagation, a gradient descent method specialized to neural networks. Modern versions of backpropagation rely on stochastic gradient descent (SGD) to efficiently approximate the gradient for massive datasets.

Recently, Restricted Boltzmann Machines (RBMs) are used for deep neural networks that belong to so called Energy Based Models. RBMs achieved state of the art performance in collaborative filtering. In deep learning architectures the idea of energy is used as a metric for measurement of the models quality.

Five main reasons why deep learning is so popular

  1. The deep learning networks can be efficiently implemented on massively parallel graphics processing units (GPUs).
  2. They are easy to implement.
  3. Deep learning networks can handle huge amounts of data
  4. Deep learning networks can perform feature extraction and classification in one model.
  5. As more and more data and computation power becomes available the use of deep learning will increase.
Free Pre-Assessment Request

Do you want to know how your competitors are doing business?

Tell us a little about yourself below to gain data for free


Hi What’s your name?

Next

Hi [First Name], what is your company’s name and website?

Previous

Next

Is your company looking for any data on the following services:

Previous

Next

Gotcha! Do you want to monitor any specific competitor or market?

List of Competitors

  • Add competitor…

Previous

Next

Finally, what’s your email address and your phone number?

Previous

Send

Your Data is on the Way!

Our data scientists team is working for you by collecting data and we’ll come back to you shortly with a pre-assessment and proposal.

WYgroup BI uses the information you provide to us to contact you about our relevant content, products, and services . You can unsubscribe from communications from HubSpot at any time. For more information, check out WYgroup’s Privacy Notice.
Comments

Leave a Comment:

Your email address will not be published. Required fields are marked *