Udacity Accenture logo
Log InJoin for Free

Value Based Methods

Course

Apply deep learning architectures to reinforcement learning tasks. Train your own agent that navigates a virtual world from sensory data.

Apply deep learning architectures to reinforcement learning tasks. Train your own agent that navigates a virtual world from sensory data.

Advanced

4 weeks

Real-world Projects

Completion Certificate

Last Updated May 17, 2024

Skills you'll learn:
Value-based reinforcement learning • Prioritized experience replay • Deep q-networks • Double deep q-networks
Prerequisites:
Reinforcement learning fundamentals • Deep learning framework proficiency • Neural network basics

Course Lessons

Lesson 1

Study Plan

This lesson covers the study plan and prerequisites for this course.

Lesson 2

Deep Q-Networks

Extend value-based reinforcement learning methods to complex problems using deep neural networks.

Lesson 3 • Project

Project: Navigation

Train an agent to navigate a large world and collect yellow bananas, while avoiding blue bananas.

Taught By The Best

Photo of Dana Sheahen

Dana Sheahen

Content Developer

Dana is an electrical engineer with a Masters in Computer Science from Georgia Tech. Her work experience includes software development for embedded systems in the Automotive Group at Motorola, where she was awarded a patent for an onboard operating system.

Photo of Arpan Chakraborty

Arpan Chakraborty

Instructor

Arpan is a computer scientist with a PhD from North Carolina State University. He teaches at Georgia Tech (within the Masters in Computer Science program), and is a coauthor of the book Practical Graph Mining with R.

Photo of Kelvin Lwin

Kelvin Lwin

AI | Knowledge Architect

Kelvin had taught in US Academia and Industry within highly technical subjects of CS and AI/DL for a decade. He expanded into building AI Fullstack in China to have a broader global perspective for 3 years. Now he is combining AI, Empathy & Ethics informed by his 18 years of meditation to build new Educational AI for all.

The Udacity Difference

Combine technology training for employees with industry experts, mentors, and projects, for critical thinking that pushes innovation. Our proven upskilling system goes after success—relentlessly.

Demonstrate proficiency with practical projects

Projects are based on real-world scenarios and challenges, allowing you to apply the skills you learn to practical situations, while giving you real hands-on experience.

  • Gain proven experience

  • Retain knowledge longer

  • Apply new skills immediately

Top-tier services to ensure learner success

Reviewers provide timely and constructive feedback on your project submissions, highlighting areas of improvement and offering practical tips to enhance your work.

  • Get help from subject matter experts

  • Learn industry best practices

  • Gain valuable insights and improve your skills

Unlock access to Value Based Methods and the rest of our best-in-class catalog

  • Unlimited access to our top-rated courses

  • Real-world projects

  • Personalized project reviews

  • Program certificates

  • Proven career outcomes

Full Catalog Access

One subscription opens up this course and our entire catalog of projects and skills.

Month-To-Month

4 Months

Average time to complete a Nanodegree program

*Discount applies to the first 4 months of membership, after which plans are converted to month-to-month.
Deep Reinforcement Learning

(328)

2 months

, Advanced

Your subscription also includes:

Your subscription also includes:

Get Started Today

Value Based Methods

Month-To-Month

  • Unlimited access to our top-rated courses
  • Real-world projects
  • Personalized project reviews
  • Program certificates
  • Proven career outcomes

4 Months

Average time to complete a Nanodegree program
  • All the same great benefits in our month-to-month plan
  • Most cost-effective way to acquire a new set of skills
Discount applies to the first 4 months of membership, after which plans are converted to month-to-month.

Related Programs

Related Programs

Udacity Accenture logo

Company

Resources

Udacity Schools

Featured Programs

Only at Udacity

  • Facebook
  • Twitter
  • LinkedIn
  • Instagram
© 2011-2024 Udacity, Inc. "Nanodegree" is a registered trademark of Udacity. © 2011-2024 Udacity, Inc.
We use cookies and other data collection technologies to provide the best experience for our customers.