September 9, 2003 - 3:39pm
This should not create a
This should not create a problem. As long as the link tot he article gets fed into the Bot (like when it crawls across a page that links to it) it will get exactly what the server sends to it. Doesn't matter that it doesn't really exist that way until the server assmebles it for transmission. The 'bot doesn't know the difference.
September 9, 2003 - 4:19pm
This should not create
QUOTE
This should not create a problem. As long as the link tot he article gets fed into the Bot (like when it crawls across a page that links to it) it will get exactly what the server sends to it. Doesn't matter that it doesn't really exist that way until the server assmebles it for transmission. The 'bot doesn't know the difference.
I think that's my problem then. The Article links don't even exist on my site until you search for one....does that make sense.
See what I mean...
http://www.livingartsministries.org/minist...icles_front.php
There is never a time when the list of Articles is complete on my site...I don't think that's good. Maybe I could maintain a crawler-type page of them somewhere....I haven't tried to build one of those yet, but it's on my to-do list.
What do you think?
Countless thanks - Doug
September 9, 2003 - 9:25pm
Ahh, I see.Yes, that will
Ahh, I see.
Yes, that will create a problem for you.
Something that would be of great help to you is a straight up, text based site map that is linked directly from your home page. It should have a link to every possible page on your site. Then a SE could tear up your site by hitting that one page. This is recommended for pages with heavy graphic based menus as well.
September 10, 2003 - 1:15am
Doug are you able to do a DB
Doug are you able to do a DB query that lists out all the articles, and then have your sitemap page like Jim mentioned listing out all the articles with links?
It's probably not a bad idea to have a way of browsing the articles too, whether by date, author, category or title. This would help SE's find your articles too.
September 10, 2003 - 12:30pm
Yeah, that's definitely where
Yeah, that's definitely where I'm going to go with this. I'll just run the query on the site map page itself to list through all the articles. I've been wanting to make a crawler page for some time now...gotta do it.
Paul...I'm not sure I understand the second part of your recommendation...
QUOTE
It's probably not a bad idea to have a way of browsing the articles too, whether by date, author, category or title. This would help SE's find your articles too.
Did you mean a different browsing method than what I have set up now for SUBJECT and AUTHOR? I have been wanting to expand the search criteria, but haven't had time...sigh
Well, I thank everyone for the input. I'm excited to make a crawler for the site. More to come as I get into it.
God bless all - Doug
Hello again,
I thought this one might belong in this Category, so here it is.
Question - I've got these Articles whose <head> and <meta> sections are generated on the fly as they're located in the database, with the actual article content being stuck in the middle of the Header and Footer. I would like people to be able to find the articles, but don't know how to get them recognized since the entire Article really never exists, it just gets put together on request.
I know you all must have some thoughts on this...I'm not too well versed in that Search Engine and Meta stuff...I'm trying, but haven't gotten to far. So...where do you turn?
As always, my heartfelt thanks in advance!
God bless you - Doug
New Brothers Fellowship