Is an exercise ball better for you than an office chair?

Exercise balls are said to be a great way to strengthen your spine and core while sitting. Should you start using one?