The site icon is only displayed on the panel for bookmarks that don't have a name. To display the favicon on the bookmarks bar instead of the site name:
Make sure the bookmarks bar is turned on. If the panel is disabled, click the key combination Ctrl + Shift + B, to enable it.
For more information, see the section Bookmarks.