Week 5 - Deep Q Networks and Rainbow Algorithm

Submitted by hollygrimm on Mon, 07/09/2018 - 09:13

The first part of this week was spent working on homework 3 for CS294 "Using Q-Learning with convolutional neural networks" [4] for playing Atari games, also known as Deep Q Networks (DQN). (Source on GitHub)

Like last week, training was done on Atari Pong. I was able to improve my +6 score using Policy Gradients to receive a +20 reward after 5 million games with DQN:

Week 4 - Policy Gradients on Atari Pong and Mujoco

Submitted by hollygrimm on Sat, 06/30/2018 - 09:50

The first part of my week was spent working on the 2nd homework for CS294, Policy Gradients[1]. Source code: https://github.com/hollygrimm/cs294-homework/tree/master/hw2

The Policy Gradients algorithm determines the optimal policy using a parameterized Neural Network (NN) instead of a value function or action function.

Policy Gradient training was done on OpenAI’s Gym Environments: CartPole-v0 and InvertedPendulum-v0.

Week 3 - Imitiation Learning and Mujoco

Submitted by hollygrimm on Fri, 06/22/2018 - 16:16

This week I worked on Homework 1: Imitation Learning from the Fall 2017 CS294 course at Berkeley. Professor Levine is an amazing lecturer and the information he covers in one lecture is quite dense.

Imitation Learning is a form of Supervised machine learning for behavior. For this exercise, we were supplied with expert policies for six different OpenAI Gym Mujoco environments. Each environment has different observation and action spaces:

Single Voice Training and Synthesizing using WaveNet

Submitted by hollygrimm on Mon, 04/02/2018 - 14:49

Using WaveNet, a deep neural network, I was able to synthesize a ten second clip of Sylvia Plath's voice. WaveNet was trained without text sequences, so the generated speech is gibberish:




The network was trained on 1000+ audio clips from 80 minutes of poetry spoken by Sylvia Plath. Here is an example of one of the clips:

Eco-Friendly Acrylic Painting

Submitted by hollygrimm on Sun, 04/02/2017 - 14:30

Acrylic painting can be more eco-friendly than oil painting, but the chemical composition of pigments and binders should be investigated by all artists before purchasing paints. Some pigments can be toxic and others may contain heavy metals that should not be washed down the drain.

Start by reading the labels on each paint tube. In addition, the material safety data sheet (MSDS) [1] for your acrylic paint line can be helpful.

Here are the guidelines I use for Golden's acrylic line:

Notes from Professional Development Workshop at Harwood Art Center

Submitted by hollygrimm on Mon, 06/02/2014 - 14:33

When creating your artist's statement. Read two types of art writing:

  • Art reviews in magazines such as Art Forum and NYT to analyze what critics are looking for
  • Art statements and interviews to find how they articulate about their art

Not all artists are successful at articulating and theorizing about their art. See Picasso's essay on African work or Cindy Sherman's statements from the 80s.