Each enabled theme in a site will have independent configurations for all of the site blocks.
When a theme is created, the configurations for all of the blocks associated with the default theme will be duplicated for the new theme. However the title text and styles for some of the blocks will be missing the title. In our case the tag and block title was missing for all or our right hand sidebars. They were there for the original default theme but not for the new theme.
Problem described here -- http://drupal.org/node/521668
Steps that produced this bug: