Stack Overflow
Stack Overflow

Questions tagged [sitemap.xml]

An XML sitemap that describes the pages on a website. They are used to give search engines information about the links on a website which they may not be able to discover by crawling.

116 questions
17
votes
3 answers

MVC: How to route /sitemap.xml to an ActionResult?

I've got a SitemapActionResult that overrides the ActionResult, and delivers a SEO sitemap.xml when http://www.sprelle.no/Home/SiteMap is hit. So far so good. What I would like, though, is to serve the sitemap.xml when Google visits /sitemap.xml.…
HaakonL
  • 173
  • 1
  • 1
  • 4
14
votes
3 answers

crawl links of sitemap.xml through wget command

I try to crawl all links of a sitemap.xml to re-cache a website. But the recursive option of wget does not work, I only get as respond: Remote file exists but does not contain any link -- not retrieving. But for sure the sitemap.xml is full of…
dohomi
  • 171
  • 1
  • 7
11
votes
6 answers

Algorithm to calculate a page importance based on its views / comments

I need an algorithm that allows me to determine an appropriate field for my website's sitemap based on the page's views and comments count. For those of you unfamiliar with sitemaps, the priority field is used to signal the importance of…
stacker
  • 14,641
  • 17
  • 46
  • 74
8
votes
2 answers

How to build sitemap.xml for AngularJS website?

I have setup an AngularJS application which is using ui-state router. It has some static pages and other than that it has profile pages which generate dynamic page based on profile id. For SEO purpose I have used PhantomJS and generate HTMLs to give…
Mayur Champaneria
  • 239
  • 5
  • 16
7
votes
2 answers

Multilingual sitemap.xml file

I have a website that has more than 1 language and I would to optimize my sitemap.xml so it will include all available languages - I found this guide on Google Webmaster Tools to use XHTML to provide all available URLs (one for each language) and…
nirpeled
  • 178
  • 1
  • 2
  • 8
6
votes
2 answers

How to generate xsi:schemalocation attribute correctly when generating a dynamic sitemap.xml with LINQ to XML?

I am generating a dynamic sitemap.xml According to sitemaps.org this is the header for a sitemap.xml
Carlos Muñoz
  • 17,397
  • 7
  • 55
  • 80
4
votes
1 answer

Cant figure out how to route my NON-MVC site from sitemap.xml to another .aspx page

When searching google the only solutions for this come up for MVC websites. My asp.net 4.0 site is not MVC. I want requests for sitemap.xml to load another dynamic .aspx page so I can generate links for google on the fly. I have spent hours…
masteroleary
  • 1,014
  • 2
  • 16
  • 33
4
votes
1 answer

`next-sitemap` duplicated language in alternate ref path (href)

..I have a Next.js application with multi-language support (English as the default language and German as the secondary one - English is on https://mywebsite.com and German on https://mywebsite.com/de). I'm using next-sitemap to generate a sitemap…
Lukas Bals
  • 79
  • 5
4
votes
0 answers

In SEO, what takes precendence, robots.txt or sitemap.xml?

I have a wordpress site where I want to stop search engines from crawling an entire directory. I know that I can do this in the robots.txt file (in the root of the site) by adding a "Disallow" line for that directory. However... In the same site I…
lamarant
  • 3,243
  • 2
  • 25
  • 30
4
votes
2 answers

Ajax request rejected due to Origin 'null', origin IS the same and NOT on localhost or local file

SOLVED?, almost.. This is related to how Chrome (47.0.2526.73) handles xml files. I don't know the details, but this code works perfectly fine in Firefox (43.0.4). I'm still curious as to why this is, or how to get it to work in Chrome. What…
JimParris
  • 61
  • 6
4
votes
1 answer

htaccess exclude sitemap.xml and robots.txt from https

Hey Stack Overflowers. I have been stumped and cannot get this correct, I just want to exclude two files, in the root directory, robots.txt and sitemap.xml from https. The rest of the site over https, no problem. I got this: # Forcing HTTPS #…
JCVA
  • 43
  • 1
  • 6
4
votes
2 answers

sitecore - allow access to sitemap.xml while disallowing other xml files

In our sitecore 6.6.0 (rev. 130404) project we have a sitemap.xml file in the root folder. However that file cannot be accessed from the browser because of a configuration in web.config.
ravinsp
  • 4,150
  • 2
  • 32
  • 43
3
votes
1 answer

How to create sitemap dynamically in Angular 12?

I need to create a sitemap page as my Marketing Team requires this page for SEO purposes. They have an old website built with WordPress and it shows the following: How can I achieve this functionality in Angular 12?
Faisal Jawad
  • 79
  • 1
  • 7
3
votes
2 answers

How to create a dynamic sitemap with mongodb, node.js, express and EJS?

I'm trying to create a dynamic sitemap for my website, it has lots of pages that change often. The sitemap needs to be accessed from www.mywebsite.com/sitemap.xml My current attempt queries the database for all the pages, get's each pages url and…
CopyPasteThankYou
  • 85
  • 1
  • 9
3
votes
2 answers

Are wildcards allowed in sitemap.xml file?

I have a website that has a directory that contains 100+ html files. I want crawlers to crawl all the html files that directory. I have already added following sentence to my robots.txt: Allow /DirName/*.html$ Is there any way to include the…
userlite
  • 135
  • 2
  • 5
1
2 3 4 5 6 7 8