Big Blue Interactive The Corner Forum  
Back to the Corner
 

Archived Thread

NFT: Question for web developers

EricJ : 4/12/2017 8:20 pm
I am adding more pages to my web site. As I am doing this, I am creating a new sitemap file and uploading it into the root directory to make sure all new pages are included.

Do I need to do the same with the robots.txt file? I would think no since I am allowing access to all pages as seen below. Just would like to verify from an expert.

User-agent: *
Allow: /

A follow up question that is potentially more difficult.
Two months ago I screwed up and accidentally deleted a couple of my key words for a very high ranking page. I attempted to put them back the best I could but I honestly did not remember them all. So, I went from page 1 or 2 in searches to page 14 now. Is there any tool that can go back in time and show the key words associated with a web page?
Search for your site on the Wayback Machine  
schabadoo : 4/12/2017 8:31 pm : link
Good chance they indexed your site, looking at your robots text.
RE: Search for your site on the Wayback Machine  
EricJ : 4/12/2017 9:12 pm : link
In comment 13425906 schabadoo said:
Quote:
Good chance they indexed your site, looking at your robots text.


Thanks I just checked it out. It shows me the content but not the tags/keywords.
RE: RE: Search for your site on the Wayback Machine  
schabadoo : 4/12/2017 9:17 pm : link
In comment 13426001 EricJ said:
Quote:
In comment 13425906 schabadoo said:


Quote:


Good chance they indexed your site, looking at your robots text.



Thanks I just checked it out. It shows me the content but not the tags/keywords.


Did you view the source?
RE: RE: RE: Search for your site on the Wayback Machine  
EricJ : 4/12/2017 9:30 pm : link
In comment 13426010 schabadoo said:
Quote:
In comment 13426001 EricJ said:


Quote:


In comment 13425906 schabadoo said:


Quote:


Good chance they indexed your site, looking at your robots text.



Thanks I just checked it out. It shows me the content but not the tags/keywords.



Did you view the source?


I am not seeing where to find that. All that is displayed is the content. I must be doing something wrong. any help would be appreciated. My e-mail address is in my profile. I can send you the web page link if you are able to help me.
schabadoo...  
EricJ : 4/12/2017 10:44 pm : link
thanks so much for your help brother! you are awesome
RE: schabadoo...  
schabadoo : 4/12/2017 11:17 pm : link
In comment 13426206 EricJ said:
Quote:
thanks so much for your help brother! you are awesome


Anytime. Glad I could help.
Back to the Corner