This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Log in to ask a question

Dialogflow Data Store Agents - Website URLs - Content Retrieval Problem from Google Sites

Posted on 03-11-2024 08:09 AM
tagus
Bronze 3
Bronze 3
Reply posted on --/--/---- --:-- AM

retrieval_website_forum.pngHello Community,

I have set up a website using Google Sites and added it as a data source to my Dialogflow agent. It's indexed correctly, yet I'm facing a "NOT_FOUND" error when querying information that is available on the site.

Could the use of Google Sites be the reason for this retrieval issue with Dialogflow's Data Store? If anyone has insights or experience with the compatibility of Google Sites as a data source for Dialogflow, your guidance would be invaluable.

Looking forward to any suggestions or troubleshooting tips you may have.

Thank you!

1 2 85
Topic Labels
2 REPLIES 2

Posted on --/--/---- --:-- AM
piyush_garg
Bronze 2
Bronze 2
Reply posted on --/--/---- --:-- AM

Hi @tagus

1. check the robots.txt might be it is not allowing google to scrap 

2.meta tag of the webpage which can be no-index

 

0 Likes

Posted on --/--/---- --:-- AM
tagus
Bronze 3
Bronze 3
Reply posted on --/--/---- --:-- AM

Hi @piyush_garg,

Thanks for the pointers! I looked into the robots.txt via Google Search Console but hit a snag, as it's only available for Domain or host-level URL-prefix properties. My site is hosted directly on Google Sites without a custom domain, using the standard sites.google.com URL. This setup also limits my ability to directly check or edit the meta tags, including the "no-index" tag you mentioned.

0 Likes