Understanding Python generators and yield

I'm confused about Python generators. What's the difference between:

def get_numbers():
    return [1, 2, 3, 4, 5]

def get_numbers_gen():
    yield 1
    yield 2
    yield 3
    yield 4
    yield 5

When and why should I use yield? What are the memory benefits?