Create a folder with "noindex, no follow?"

G

Gregg

I know you can add <meta name="robots" content="noindex, nofollow"> so a file
is not listed in search engines. Can I do something similar for a folder?
Then I can move all my old pages into the "noindex, nofollow" folder so they
won't come up in search engines (I don't want to delete the old pages,
because I may need to use them again in the future).
 
S

Steve Easton

You would need to do this using an entry in the robots.txt file like this:

User-agent: *
Disallow: /foldername/


However, doing it this way tells anyone who cares to look at the robots.txt file by opening
it in a browser that you have a folder named foldername that you don't want people to look
at. All they would have to do is open the folder in their browser.

Have you considered storing these files in the _private folder??
That way nobody, including search bots can open it.


--
Steve Easton
Microsoft MVP FrontPage
95isalive
This site is best viewed..................
...............................with a computer
 
G

Gregg

I didn't know about _privatefolder. So if I create a folder called
"_privatefolder" (instead of what I now use is a folder called, "oldpages")
anything I put in that folder will be unavailable to locate in search
engines?
 
T

Tom [Pepper] Willett

In your FP web is a folder called "_private" without the quotation marks.
That's what Steve was referring to.
--
===
Tom [Pepper] Willett
Microsoft MVP - FrontPage
---
FrontPage Support:
http://www.frontpagemvps.com/
About FrontPage 2003:
http://office.microsoft.com/home/office.aspx?assetid=FX01085802
===
|I didn't know about _privatefolder. So if I create a folder called
| "_privatefolder" (instead of what I now use is a folder called,
"oldpages")
| anything I put in that folder will be unavailable to locate in search
| engines?
|
| "Steve Easton" wrote:
|
| > You would need to do this using an entry in the robots.txt file like
this:
| >
| > User-agent: *
| > Disallow: /foldername/
| >
| >
| > However, doing it this way tells anyone who cares to look at the
robots.txt file by opening
| > it in a browser that you have a folder named foldername that you don't
want people to look
| > at. All they would have to do is open the folder in their browser.
| >
| > Have you considered storing these files in the _private folder??
| > That way nobody, including search bots can open it.
| >
| >
| > --
| > Steve Easton
| > Microsoft MVP FrontPage
| > 95isalive
| > This site is best viewed..................
| > ...............................with a computer
| >
| > | > > I know you can add <meta name="robots" content="noindex, nofollow"> so
a file
| > > is not listed in search engines. Can I do something similar for a
folder?
| > > Then I can move all my old pages into the "noindex, nofollow" folder
so they
| > > won't come up in search engines (I don't want to delete the old pages,
| > > because I may need to use them again in the future).
| > >
| >
| >
| >
 
G

Gregg

I don't currently have a folder called _private, but I can obviously create
one (and start throwing all all my old pages in it). Is this correct and the
solution to my problem?
 
T

Tom [Pepper] Willett

By default, FronPage always creates one when you create a web. Do you
actually have a web created and open while working on your site? Or are you
just working on a page without having a web site open? Have you checked
"show hidden folders"?
--
===
Tom [Pepper] Willett
Microsoft MVP - FrontPage
---
FrontPage Support:
http://www.frontpagemvps.com/
About FrontPage 2003:
http://office.microsoft.com/home/office.aspx?assetid=FX01085802
===
|I don't currently have a folder called _private, but I can obviously create
| one (and start throwing all all my old pages in it). Is this correct and
the
| solution to my problem?
|
| "Tom [Pepper] Willett" wrote:
|
| > In your FP web is a folder called "_private" without the quotation
marks.
| > That's what Steve was referring to.
| > --
| > ===
| > Tom [Pepper] Willett
| > Microsoft MVP - FrontPage
| > ---
| > FrontPage Support:
| > http://www.frontpagemvps.com/
| > About FrontPage 2003:
| > http://office.microsoft.com/home/office.aspx?assetid=FX01085802
| > ===
| > | > |I didn't know about _privatefolder. So if I create a folder called
| > | "_privatefolder" (instead of what I now use is a folder called,
| > "oldpages")
| > | anything I put in that folder will be unavailable to locate in search
| > | engines?
| > |
| > | "Steve Easton" wrote:
| > |
| > | > You would need to do this using an entry in the robots.txt file like
| > this:
| > | >
| > | > User-agent: *
| > | > Disallow: /foldername/
| > | >
| > | >
| > | > However, doing it this way tells anyone who cares to look at the
| > robots.txt file by opening
| > | > it in a browser that you have a folder named foldername that you
don't
| > want people to look
| > | > at. All they would have to do is open the folder in their browser.
| > | >
| > | > Have you considered storing these files in the _private folder??
| > | > That way nobody, including search bots can open it.
| > | >
| > | >
| > | > --
| > | > Steve Easton
| > | > Microsoft MVP FrontPage
| > | > 95isalive
| > | > This site is best viewed..................
| > | > ...............................with a computer
| > | >
| > | > | > | > > I know you can add <meta name="robots" content="noindex,
nofollow"> so
| > a file
| > | > > is not listed in search engines. Can I do something similar for a
| > folder?
| > | > > Then I can move all my old pages into the "noindex, nofollow"
folder
| > so they
| > | > > won't come up in search engines (I don't want to delete the old
pages,
| > | > > because I may need to use them again in the future).
| > | > >
| > | >
| > | >
| > | >
| >
| >
| >
 
G

Gregg

Sadly, I never knew what that folder was for...and had stopped noticing it
long ago. I will start putting the pages I don't want picked up by search
engines in that folder. Thanks!

Tom [Pepper] Willett said:
By default, FronPage always creates one when you create a web. Do you
actually have a web created and open while working on your site? Or are you
just working on a page without having a web site open? Have you checked
"show hidden folders"?
--
===
Tom [Pepper] Willett
Microsoft MVP - FrontPage
---
FrontPage Support:
http://www.frontpagemvps.com/
About FrontPage 2003:
http://office.microsoft.com/home/office.aspx?assetid=FX01085802
===
|I don't currently have a folder called _private, but I can obviously create
| one (and start throwing all all my old pages in it). Is this correct and
the
| solution to my problem?
|
| "Tom [Pepper] Willett" wrote:
|
| > In your FP web is a folder called "_private" without the quotation
marks.
| > That's what Steve was referring to.
| > --
| > ===
| > Tom [Pepper] Willett
| > Microsoft MVP - FrontPage
| > ---
| > FrontPage Support:
| > http://www.frontpagemvps.com/
| > About FrontPage 2003:
| > http://office.microsoft.com/home/office.aspx?assetid=FX01085802
| > ===
| > | > |I didn't know about _privatefolder. So if I create a folder called
| > | "_privatefolder" (instead of what I now use is a folder called,
| > "oldpages")
| > | anything I put in that folder will be unavailable to locate in search
| > | engines?
| > |
| > | "Steve Easton" wrote:
| > |
| > | > You would need to do this using an entry in the robots.txt file like
| > this:
| > | >
| > | > User-agent: *
| > | > Disallow: /foldername/
| > | >
| > | >
| > | > However, doing it this way tells anyone who cares to look at the
| > robots.txt file by opening
| > | > it in a browser that you have a folder named foldername that you
don't
| > want people to look
| > | > at. All they would have to do is open the folder in their browser.
| > | >
| > | > Have you considered storing these files in the _private folder??
| > | > That way nobody, including search bots can open it.
| > | >
| > | >
| > | > --
| > | > Steve Easton
| > | > Microsoft MVP FrontPage
| > | > 95isalive
| > | > This site is best viewed..................
| > | > ...............................with a computer
| > | >
| > | > | > | > > I know you can add <meta name="robots" content="noindex,
nofollow"> so
| > a file
| > | > > is not listed in search engines. Can I do something similar for a
| > folder?
| > | > > Then I can move all my old pages into the "noindex, nofollow"
folder
| > so they
| > | > > won't come up in search engines (I don't want to delete the old
pages,
| > | > > because I may need to use them again in the future).
| > | > >
| > | >
| > | >
| > | >
| >
| >
| >
 
T

Thomas A. Rowe

The _private folder doesn't not protect content from search engines such as Google, MSN, etc. only
the FP search component.

--
==============================================
Thomas A. Rowe (Microsoft MVP - FrontPage)
==============================================
If you feel your current issue is a results of installing
a Service Pack or security update, please contact
Microsoft Product Support Services:
http://support.microsoft.com
If the problem can be shown to have been caused by a
security update, then there is usually no charge for the call.
==============================================

Gregg said:
Sadly, I never knew what that folder was for...and had stopped noticing it
long ago. I will start putting the pages I don't want picked up by search
engines in that folder. Thanks!

Tom [Pepper] Willett said:
By default, FronPage always creates one when you create a web. Do you
actually have a web created and open while working on your site? Or are you
just working on a page without having a web site open? Have you checked
"show hidden folders"?
--
===
Tom [Pepper] Willett
Microsoft MVP - FrontPage
---
FrontPage Support:
http://www.frontpagemvps.com/
About FrontPage 2003:
http://office.microsoft.com/home/office.aspx?assetid=FX01085802
===
|I don't currently have a folder called _private, but I can obviously create
| one (and start throwing all all my old pages in it). Is this correct and
the
| solution to my problem?
|
| "Tom [Pepper] Willett" wrote:
|
| > In your FP web is a folder called "_private" without the quotation
marks.
| > That's what Steve was referring to.
| > --
| > ===
| > Tom [Pepper] Willett
| > Microsoft MVP - FrontPage
| > ---
| > FrontPage Support:
| > http://www.frontpagemvps.com/
| > About FrontPage 2003:
| > http://office.microsoft.com/home/office.aspx?assetid=FX01085802
| > ===
| > | > |I didn't know about _privatefolder. So if I create a folder called
| > | "_privatefolder" (instead of what I now use is a folder called,
| > "oldpages")
| > | anything I put in that folder will be unavailable to locate in search
| > | engines?
| > |
| > | "Steve Easton" wrote:
| > |
| > | > You would need to do this using an entry in the robots.txt file like
| > this:
| > | >
| > | > User-agent: *
| > | > Disallow: /foldername/
| > | >
| > | >
| > | > However, doing it this way tells anyone who cares to look at the
| > robots.txt file by opening
| > | > it in a browser that you have a folder named foldername that you
don't
| > want people to look
| > | > at. All they would have to do is open the folder in their browser.
| > | >
| > | > Have you considered storing these files in the _private folder??
| > | > That way nobody, including search bots can open it.
| > | >
| > | >
| > | > --
| > | > Steve Easton
| > | > Microsoft MVP FrontPage
| > | > 95isalive
| > | > This site is best viewed..................
| > | > ...............................with a computer
| > | >
| > | > | > | > > I know you can add <meta name="robots" content="noindex,
nofollow"> so
| > a file
| > | > > is not listed in search engines. Can I do something similar for a
| > folder?
| > | > > Then I can move all my old pages into the "noindex, nofollow"
folder
| > so they
| > | > > won't come up in search engines (I don't want to delete the old
pages,
| > | > > because I may need to use them again in the future).
| > | > >
| > | >
| > | >
| > | >
| >
| >
| >
 
G

Gregg

So, the previous posts were incorrect? Where would you place pages you do not
want to be picked up by search engines (without deleting them since I may
want access to them in the future)? Can you create a folder and give the
folder some kind of no-search permissions?

Thomas A. Rowe said:
The _private folder doesn't not protect content from search engines such as Google, MSN, etc. only
the FP search component.

--
==============================================
Thomas A. Rowe (Microsoft MVP - FrontPage)
==============================================
If you feel your current issue is a results of installing
a Service Pack or security update, please contact
Microsoft Product Support Services:
http://support.microsoft.com
If the problem can be shown to have been caused by a
security update, then there is usually no charge for the call.
==============================================

Gregg said:
Sadly, I never knew what that folder was for...and had stopped noticing it
long ago. I will start putting the pages I don't want picked up by search
engines in that folder. Thanks!

Tom [Pepper] Willett said:
By default, FronPage always creates one when you create a web. Do you
actually have a web created and open while working on your site? Or are you
just working on a page without having a web site open? Have you checked
"show hidden folders"?
--
===
Tom [Pepper] Willett
Microsoft MVP - FrontPage
---
FrontPage Support:
http://www.frontpagemvps.com/
About FrontPage 2003:
http://office.microsoft.com/home/office.aspx?assetid=FX01085802
===
|I don't currently have a folder called _private, but I can obviously create
| one (and start throwing all all my old pages in it). Is this correct and
the
| solution to my problem?
|
| "Tom [Pepper] Willett" wrote:
|
| > In your FP web is a folder called "_private" without the quotation
marks.
| > That's what Steve was referring to.
| > --
| > ===
| > Tom [Pepper] Willett
| > Microsoft MVP - FrontPage
| > ---
| > FrontPage Support:
| > http://www.frontpagemvps.com/
| > About FrontPage 2003:
| > http://office.microsoft.com/home/office.aspx?assetid=FX01085802
| > ===
| > | > |I didn't know about _privatefolder. So if I create a folder called
| > | "_privatefolder" (instead of what I now use is a folder called,
| > "oldpages")
| > | anything I put in that folder will be unavailable to locate in search
| > | engines?
| > |
| > | "Steve Easton" wrote:
| > |
| > | > You would need to do this using an entry in the robots.txt file like
| > this:
| > | >
| > | > User-agent: *
| > | > Disallow: /foldername/
| > | >
| > | >
| > | > However, doing it this way tells anyone who cares to look at the
| > robots.txt file by opening
| > | > it in a browser that you have a folder named foldername that you
don't
| > want people to look
| > | > at. All they would have to do is open the folder in their browser.
| > | >
| > | > Have you considered storing these files in the _private folder??
| > | > That way nobody, including search bots can open it.
| > | >
| > | >
| > | > --
| > | > Steve Easton
| > | > Microsoft MVP FrontPage
| > | > 95isalive
| > | > This site is best viewed..................
| > | > ...............................with a computer
| > | >
| > | > | > | > > I know you can add <meta name="robots" content="noindex,
nofollow"> so
| > a file
| > | > > is not listed in search engines. Can I do something similar for a
| > folder?
| > | > > Then I can move all my old pages into the "noindex, nofollow"
folder
| > so they
| > | > > won't come up in search engines (I don't want to delete the old
pages,
| > | > > because I may need to use them again in the future).
| > | > >
| > | >
| > | >
| > | >
| >
| >
| >
 
T

Thomas A. Rowe

You can keep pages in any folder within your web, just make sure you do not and have never had any
link to them, otherwise users will get 404s.

Personal, if it is not being used on the web, then remove it from the web. Store in a folder on your
HD.

--
==============================================
Thomas A. Rowe (Microsoft MVP - FrontPage)
==============================================
If you feel your current issue is a results of installing
a Service Pack or security update, please contact
Microsoft Product Support Services:
http://support.microsoft.com
If the problem can be shown to have been caused by a
security update, then there is usually no charge for the call.
==============================================

Gregg said:
So, the previous posts were incorrect? Where would you place pages you do not
want to be picked up by search engines (without deleting them since I may
want access to them in the future)? Can you create a folder and give the
folder some kind of no-search permissions?

Thomas A. Rowe said:
The _private folder doesn't not protect content from search engines such as Google, MSN, etc.
only
the FP search component.

--
==============================================
Thomas A. Rowe (Microsoft MVP - FrontPage)
==============================================
If you feel your current issue is a results of installing
a Service Pack or security update, please contact
Microsoft Product Support Services:
http://support.microsoft.com
If the problem can be shown to have been caused by a
security update, then there is usually no charge for the call.
==============================================

Gregg said:
Sadly, I never knew what that folder was for...and had stopped noticing it
long ago. I will start putting the pages I don't want picked up by search
engines in that folder. Thanks!

:

By default, FronPage always creates one when you create a web. Do you
actually have a web created and open while working on your site? Or are you
just working on a page without having a web site open? Have you checked
"show hidden folders"?
--
===
Tom [Pepper] Willett
Microsoft MVP - FrontPage
---
FrontPage Support:
http://www.frontpagemvps.com/
About FrontPage 2003:
http://office.microsoft.com/home/office.aspx?assetid=FX01085802
===
|I don't currently have a folder called _private, but I can obviously create
| one (and start throwing all all my old pages in it). Is this correct and
the
| solution to my problem?
|
| "Tom [Pepper] Willett" wrote:
|
| > In your FP web is a folder called "_private" without the quotation
marks.
| > That's what Steve was referring to.
| > --
| > ===
| > Tom [Pepper] Willett
| > Microsoft MVP - FrontPage
| > ---
| > FrontPage Support:
| > http://www.frontpagemvps.com/
| > About FrontPage 2003:
| > http://office.microsoft.com/home/office.aspx?assetid=FX01085802
| > ===
| > | > |I didn't know about _privatefolder. So if I create a folder called
| > | "_privatefolder" (instead of what I now use is a folder called,
| > "oldpages")
| > | anything I put in that folder will be unavailable to locate in search
| > | engines?
| > |
| > | "Steve Easton" wrote:
| > |
| > | > You would need to do this using an entry in the robots.txt file like
| > this:
| > | >
| > | > User-agent: *
| > | > Disallow: /foldername/
| > | >
| > | >
| > | > However, doing it this way tells anyone who cares to look at the
| > robots.txt file by opening
| > | > it in a browser that you have a folder named foldername that you
don't
| > want people to look
| > | > at. All they would have to do is open the folder in their browser.
| > | >
| > | > Have you considered storing these files in the _private folder??
| > | > That way nobody, including search bots can open it.
| > | >
| > | >
| > | > --
| > | > Steve Easton
| > | > Microsoft MVP FrontPage
| > | > 95isalive
| > | > This site is best viewed..................
| > | > ...............................with a computer
| > | >
| > | > | > | > > I know you can add <meta name="robots" content="noindex,
nofollow"> so
| > a file
| > | > > is not listed in search engines. Can I do something similar for a
| > folder?
| > | > > Then I can move all my old pages into the "noindex, nofollow"
folder
| > so they
| > | > > won't come up in search engines (I don't want to delete the old
pages,
| > | > > because I may need to use them again in the future).
| > | > >
| > | >
| > | >
| > | >
| >
| >
| >
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Similar Threads


Top