SEO optimization - Waiviogit/waivio GitHub Wiki

  • We have a structure such that when search bots come, we give them a cached version of the page. Cached pages are stored in MongoDB. https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers#user_agent_version
  • We created separate branch where it is easy to see page that we give and possible to debug. #6133
  • Change page caching for SEO (using CDN) #6285
  • [SEO / shop] The text version does not contain descriptions of links; it is also useful to have pictures with alt texts in the full version #6005
  • [SEO / shop] Cont: 3277 (6036) - 1. link text "name - title"; 2. title; 3. title (from base object); 4. general menu #6152
  • [seo / title] Add an updated title to the object page name within the tab title (title tag) on social sites to provide more information to SEO bots. #6589
  • [SEO / post] there are no menus, comments, links to hashtags, objects and users are also important (top 30 likes, all re-blogs) #6006
  • [SEO / newsfeed] the cached version of text has no links, no content, no menus. Source is a little better, but without links. #6003
  • Fix sitemap, replace checklist word to object for lists and pages. #6896
  • [system / user] Move page generation from front-server to client browser (for users) #6748
  • SEO fixes #7217

"Not-seo" bots blocked:

  • Add mechanism that will block bots #6339
  • Redirect by sitemap for seo bots #6458
  • Fix Bot limits for non-seo bots (Do it for all social sites) #6395

Currently, we are blocking non-SEO bots if they access our sites more than 2500 times in total, or 500 times on a single site. SEO bots are not subject to blocking. Additionally, we implement a 302 redirect to Waivio for all bots if the page they intend to visit is not listed in the site's sitemap.