Adding an index on the source column of the locales_source table seem to increase performance. See here http://drupal.org/node/48563 I think this is worth considering for 4.7.