stimulusdelayreward
Class ActorCritic_PDAETLSTM_Monkey2

java.lang.Object
  |
  +--java.util.Observable
        |
        +--lnsc.page.AbstractObservableAgent
              |
              +--stimulusdelayreward.ActorCritic_PDAETLSTM_Monkey2

All Implemented Interfaces:

Agent, java.io.Serializable

public class ActorCritic_PDAETLSTM_Monkey2

extends AbstractObservableAgent

This is the basic monkey using the full model. It uses and ActorCritic model of the basal ganglia and it uses a eligibility traces driven version of LSTM (ETLSTM1) as frontal cortex. Both system runs in parallel and basal ganglia receives input from LSTM output at previous time step. LSTM are updates on their next input. LSTM are trained to predict their next inputs. DA signal from BG is used to modulate the LSTM learning rate.

See Also:

Serialized Form

Constructor Summary

ActorCritic_PDAETLSTM_Monkey2(int blockCount, int cellPerBlock, boolean inSquash, boolean outSquash, boolean gate2gate, boolean in2out, double LSTMlr, double ACMlr, int ACmodel, StateRepresentation ACStateRep, double lambda, boolean oppSignResetTraces)

Method Summary

void	endEpisode(State finalState) Used by the state space (or environement) to tell the agent that the episode is terminated.
void	newEpisode(State newState) Used to tell the agent that a new episode is beginning.
Action	requestAction(State currentState) Used by the State space (or environment) to request an action from the agent.
void	returnReward(State resultState, double reward) Used by the state space (or environement) to return the result from the last action done thought RequestActions.
DataSet	toDataSet() Similar to the toString method, but return state content in the form of a DataSet.
java.lang.String	toString()

Methods inherited from class lnsc.page.AbstractObservableAgent

getEvalMode, isAdaptive, isEvaluable, notifyObservers, setEvalMode

Methods inherited from class java.util.Observable

addObserver, countObservers, deleteObserver, deleteObservers, hasChanged, notifyObservers

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ActorCritic_PDAETLSTM_Monkey2

public ActorCritic_PDAETLSTM_Monkey2(int blockCount,
                                     int cellPerBlock,
                                     boolean inSquash,
                                     boolean outSquash,
                                     boolean gate2gate,
                                     boolean in2out,
                                     double LSTMlr,
                                     double ACMlr,
                                     int ACmodel,
                                     StateRepresentation ACStateRep,
                                     double lambda,
                                     boolean oppSignResetTraces)

Method Detail

endEpisode

public void endEpisode(State finalState)

Description copied from interface: Agent

Used by the state space (or environement) to tell the agent that the episode is terminated.

Parameters:

finalState - Final state of the episode.

newEpisode

public void newEpisode(State newState)

Description copied from interface: Agent

Used to tell the agent that a new episode is beginning.

Parameters:

newState - First stae of the episode.

requestAction

public Action requestAction(State currentState)

Description copied from interface: Agent

Used by the State space (or environment) to request an action from the agent. In that case the agent should returns its desired action.

Parameters:

currentState - The current state of the agent.

Returns:

The action to be done.

returnReward

public void returnReward(State resultState,
                         double reward)

Description copied from interface: Agent

Used by the state space (or environement) to return the result from the last action done thought RequestActions.

Parameters:

resultState - Resulting state from last action.

reward - Resulting reward from last action.

toDataSet

public DataSet toDataSet()

Description copied from interface: Agent

Similar to the toString method, but return state content in the form of a DataSet. Can be null.

Specified by:

toDataSet in interface Agent

Overrides:

toDataSet in class AbstractObservableAgent

Returns:

A DataSet containing a description of the State.

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object