Harvestman Listbox Section

Top row, left to right

• Pages Crawled, with count. Developed data, not an exact copy of a Spider list
  1. A list of the URLs actually crawled and reported
  2. A list of title and keyword listings, in the same order as URLs
  3. A list of descriptions, if available, or text samples, in the URL order
• Control of the Que
• List of links found that point outside the selected Domain
• String-search tool

Bottom row, left to right

• Editing textbox, listboxes are hard to edit, use the copy-buttons to copy lists to here for selection and copy-out
• The stack of copy-buttons
  1. Copy only the URL listbox in to editing area
  2. Copy page details data with the URL (grouping by index number) to the editing area
  3. Copy the list of links to other domains
  4. Copy the list of string-match data
  5. Copy the list of links that could not be crawled (bad/broken)
  6. Copy the listing of keywords missing from page text..
     Google will lower our rank if we lie about keywords!
• Missing keyword tool, not a copy of a Spider list. A search is made for each keyword in the list, and, if not found in the body text (after the Spider strips out link-texts!), an error is added to this list
• List of bad links, a copy of Spider data. A link was found while crawling that pointed to a page that was not readable, or, a link included an un-escaped querry.

Last edited =