For a deep dive into GPUs make sure to check out Tim Dettmer's excellent blog post.