_gradient_descent Struct Template Reference

Gradient descent. More...

#include <optimize.h>

Inheritance diagram for _gradient_descent:

[legend]Collaboration diagram for _gradient_descent:

[legend]List of all members.

Public Member Functions
	_gradient_descent (LM *lm, const Step &lr)
void	initialize ()
	Initialize local variables.
const Dir &	direction ()
	Search direction at w.
std::pair< bool, Step >	step_length (const Dir &)
	Should we go in direction d? How far?.
void	update_weight (Dir d, const Step &s)
bool	satisfied ()
	Stopping criteria.
Public Attributes
LM *	plm
Step	learning_rate
Protected Attributes
Dir	w
unsigned int	stp_cnt

---

Detailed Description

template<class LM, class Dir, class Step>
struct lemga::_gradient_descent< LM, Dir, Step >

Gradient descent.

Todo:

Add options for on-line or batch mode; documentation Why use get_weight() and set_weight(), not update_weight()? (how much is the performance decrease)

Definition at line 93 of file optimize.h.

---

Constructor & Destructor Documentation

_gradient_descent (  LM *  lm, const Step &  lr )  [inline]

Definition at line 97 of file optimize.h.

---

Member Function Documentation

const Dir& direction (   )  [inline]

Search direction at w. Reimplemented from _search. Reimplemented in _gd_momentum, and _conjugate_gradient. Definition at line 102 of file optimize.h.

void initialize (   )  [inline]

Initialize local variables. Reimplemented from _search. Reimplemented in _gd_adaptive, and _line_search. Definition at line 100 of file optimize.h.

bool satisfied (   )  [inline]

Stopping criteria. Reimplemented from _search. Reimplemented in _gd_adaptive, and _line_search. Definition at line 117 of file optimize.h.

std::pair<bool,Step> step_length (  const Dir &   )  [inline]

Should we go in direction d? How far?. Reimplemented from _search. Reimplemented in _line_search. Definition at line 107 of file optimize.h.

void update_weight (  Dir  d, const Step &  s )  [inline]

Reimplemented in _gd_weightdecay, and _gd_adaptive. Definition at line 111 of file optimize.h.

---

Member Data Documentation

Step learning_rate

Definition at line 95 of file optimize.h.

LM* plm

Definition at line 94 of file optimize.h.

unsigned int stp_cnt [protected]

Definition at line 121 of file optimize.h.

Dir w [protected]

Definition at line 120 of file optimize.h.

---

The documentation for this struct was generated from the following file:

• optimize.h

---