SEO optimization - Waiviogit/waivio GitHub Wiki

• We have a structure such that when search bots come, we give them a cached version of the page. Cached pages are stored in MongoDB. https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers#user_agent_version
• We created separate branch where it is easy to see page that we give and possible to debug. #6133
• Change page caching for SEO (using CDN) #6285
• [SEO / shop] The text version does not contain descriptions of links; it is also useful to have pictures with alt texts in the full version #6005
• [SEO / shop] Cont: 3277 (6036) - 1. link text "name - title"; 2. title; 3. title (from base object); 4. general menu #6152
• [seo / title] Add an updated title to the object page name within the tab title (title tag) on social sites to provide more information to SEO bots. #6589

"Not-seo" bots blocked:

• Add mechanism that will block bots #6339
• Redirect by sitemap for seo bots #6458
• Fix Bot limits for non-seo bots (Do it for all social sites) #6395

Currently, we are blocking non-SEO bots if they access our sites more than 2500 times in total, or 500 times on a single site. SEO bots are not subject to blocking. Additionally, we implement a 302 redirect to Waivio for all bots if the page they intend to visit is not listed in the site's sitemap.