(Q42881009)

9 November 2017

title

Internal-time temporal difference model for neural value-based decision making (English)

1 reference

https://api.crossref.org/works/10.1162/NECO_A_00049

9 November 2017

Internal-Time Temporal Difference Model for Neural Value-Based Decision Making (English)

1 reference

17 July 2024

1 reference

1 reference

1 reference

https://www.ebi.ac.uk/europepmc/webservices/rest/search?resulttype=core&format=json&query=SRC%3AMED%20AND%20EXT_ID%3A20858126

17 July 2024

1

Hiroyuki Nakahara

1 reference

https://www.ebi.ac.uk/europepmc/webservices/rest/search?resulttype=core&format=json&query=SRC%3AMED%20AND%20EXT_ID%3A20858126

17 July 2024

3

Sivaramakrishnan Kaveri

1 reference

https://www.ebi.ac.uk/europepmc/webservices/rest/search?resulttype=core&format=json&query=SRC%3AMED%20AND%20EXT_ID%3A20858126

17 July 2024

author name string

Sivaramakrishnan Kaveri

2

1 reference

9 November 2017

language of work or name

English

1 reference

National Center for Biotechnology Information

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/esummary.fcgi?db=pubmed&retmode=json&id=20858126

17 July 2024

publication date

21 September 2010

1 reference

full work available at URL

9 November 2017

http://intl-neco.mitpress.org/cgi/content/abstract/22/12/3062

online access status

open access

1 reference

https://www.ebi.ac.uk/europepmc/webservices/rest/search?resulttype=core&format=json&query=SRC%3AMED%20AND%20EXT_ID%3A20858126

https://www.mitpressjournals.org/doi/pdf/10.1162/NECO_a_00049

17 July 2024

1 reference

https://api.crossref.org/works/10.1162/NECO_A_00049

17 July 2024

1 reference

9 November 2017

volume

22

1 reference

9 November 2017

issue

12

1 reference

9 November 2017

page(s)

3062-3106

1 reference

maintained by WikiProject

9 November 2017

WikiProject Mathematics

0 references

cites work

The Kuramoto model: A simple paradigm for synchronization phenomena

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Specious reward: A behavioral theory of impulsiveness and impulse control

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Self in time: imagined self-location influences neural activity related to mental time travel

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Midbrain dopamine neurons encode a quantitative reward prediction error signal

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Intertemporal choice--toward an integrative framework

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Evolutionary economics of mental time travel?

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Self-projection and the brain

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Serotonin receptors in cognitive behaviors

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

What makes us tick? Functional and neural mechanisms of interval timing

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

The biology of time across different scales

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Neural systems implicated in delayed and probabilistic reinforcement

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Immediacy versus anticipated delay in the time-left experiment: a test of the cognitive hypothesis

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Properties of the internal clock

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Serotoninergic regulation of emotional and behavioural control processes

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Representation and timing in theories of the dopamine system

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Opponent interactions between serotonin and dopamine

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Long-term reward prediction in TD models of the dopamine system

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Prospective and retrospective temporal difference learning

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Serotonin, inhibition, and negative mood

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Reinforcement learning: the good, the bad and the ugly

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Learning about multiple attributes of reward in Pavlovian conditioning

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Adaptive timing in neural networks: the conditioned response.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Reinforcement learning in continuous time and space.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Metalearning and neuromodulation.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Modulators of decision making

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Multiple model-based reinforcement learning.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Interval timing as an emergent learning property

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Human time perception and its illusions

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

The temporal precision of reward prediction in dopamine neurons

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Time Discounting and Time Preference: A Critical Review

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Time, rate, and conditioning.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Neuronal activity related to elapsed time in prefrontal cortex.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Attentional modulation in visual cortex depends on task timing

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Scalar expectancy theory and Weber's law in animal timing

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Time left: Linear versus logarithmic subjective time

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Toward a neurobiology of temporal cognition: advances and challenges.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Prospection: experiencing the future

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Formal learning theory dissociates brain regions with different temporal integration.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

The neural basis of decision making.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

From physical time to the first and second moments of psychological time

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Neural mechanisms of acquired phasic dopamine responses in learning

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Basal ganglia orient eyes to reward

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

5-Hydroxytryptamine and interval timing behaviour

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

The neural representation of time

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Solving the distal reward problem through linkage of STDP and dopamine signaling

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

A representation of the hazard rate of elapsed time in macaque area LIP.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

The neural correlates of subjective value during intertemporal choice

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Timing in the absence of clocks: encoding time in neural network states

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

A behavioral theory of timing.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Influence of reward delays on responses of dopamine neurons.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Stable encoding of task structure coexists with flexible coding of task events in sensorimotor striatum

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Modeling the violation of reward maximization and invariance in reinforcement schedules

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Golden Eggs and Hyperbolic Discounting

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Representation of time by neurons in the posterior parietal cortex of the macaque

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Distinct systems for automatic and cognitively controlled time measurement: evidence from neuroimaging

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

The psychology of transcending the here and now

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Neural signature of fictive learning signals in a sequential investment task

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Stimulus representation and the timing of reward-prediction errors in models of the dopamine system

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Neural dissociation of delay and uncertainty in intertemporal choice.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Single-trials analyses demonstrate that increases in clock speed contribute to the methamphetamine-induced horizontal shifts in peak-interval timing functions.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Neuropsychological mechanisms of interval timing behavior

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

The neural basis of temporal processing

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Mathematical models and the experimental analysis of behavior

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Time discounting for primary rewards.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Separate neural systems value immediate and delayed monetary rewards

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Neuropharmacology of timing and time perception

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Effect of central 5-hydroxytryptamine depletion on inter-temporal choice: a quantitative analysis

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Neural economics and the biological substrates of valuation

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Computational roles for dopamine in behavioural control

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Imaging valuation models in human choice

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Midbrain dopamine neurons encode decisions for future action

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor sequences - a computational approach.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Dopamine neurons can represent context-dependent prediction error.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Extended LATER model can account for trial-by-trial variability of both pre- and post-processes

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Reward-dependent modulation of neuronal activity in the primate dorsal raphe nucleus

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Tonic dopamine: opportunity costs and the control of response vigor

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Temporal difference models and reward-related learning in the human brain

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

PVLV: The Primary Value and Learned Value Pavlovian Learning Algorithm

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

A spiking neural network model of an actor-critic learning agent

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Neural differentiation of expected reward and risk in human subcortical structures.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Transient firing of dorsal raphe neurons encodes diverse and specific sensory, motor, and reward events.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

The short-latency dopamine signal: a role in discovering novel actions?

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Neuronal activity dependent on anticipated and elapsed delay in macaque prefrontal cortex, frontal and supplementary eye fields, and premotor cortex

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

"Economics and Psychology"? The Case of Hyperbolic Discounting*

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Remembering the past to imagine the future: the prospective brain

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

A neural substrate of prediction and reward

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Low-serotonin levels increase delayed reward discounting in humans.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Humans can adopt optimal discounting strategy under real-time constraints.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Serotonin-mediated striatal dopamine release involves the dopamine uptake site and the serotonin receptor.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Differential encoding of losses and gains in the human striatum

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Synaptic computation underlying probabilistic inference

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Time and memory: towards a pacemaker-free theory of interval timing

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Anticipatory responses of dopamine neurons and cortical neurons reproduced by internal model

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Temporal difference model reproduces anticipatory neural activity

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Neural substrates of envisioning the future

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Loss of self-control in intertemporal choice may be attributable to logarithmic time-perception

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

A dopamine-acetylcholine cascade: simulating learned and lesion-induced behavior of striatal cholinergic interneurons

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops.

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Behavioral models of impulsivity in relation to ADHD: translation between clinical and preclinical studies

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Dopamine, learning and motivation

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

Decision making, impulsivity and time perception

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

History- and current instruction-based coding of forthcoming behavioral outcomes in the striatum

21 January 2018

1 reference

https://api.crossref.org/works/10.1162%2FNECO_A_00049

A Dual-Self Model of Impulse Control

21 January 2018

https://api.crossref.org/works/10.1162/NECO_A_00049

35

1 reference

Neural dynamics of adaptive timing and temporal discrimination during associative learning

17 July 2024

https://api.crossref.org/works/10.1162/NECO_A_00049

48

1 reference

Structure and function of the brain serotonin system

17 July 2024

https://api.crossref.org/works/10.1162/NECO_A_00049

57

1 reference

A framework for mesencephalic dopamine systems based on predictive Hebbian learning

17 July 2024

https://api.crossref.org/works/10.1162/NECO_A_00049

84

1 reference

Predictive reward signal of dopamine neurons

17 July 2024

https://api.crossref.org/works/10.1162/NECO_A_00049

107

1 reference

On sundials, springs, and atoms

17 July 2024

https://api.crossref.org/works/10.1162/NECO_A_00049

131

1 reference

Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory

17 July 2024

https://api.crossref.org/works/10.1162/NECO_A_00049

132

1 reference

17 July 2024

Identifiers

DOI

10.1162/NECO_A_00049

1 reference

journals/neco/NakaharaK10

9 November 2017

DBLP publication ID

1 reference

DBLP Dataset 2021-01-02

28 January 2021

1 reference