Skip to main content

mod rewrite - How to check is canonicalized domains are being used? Apache 301 redirect does not preserve referrer



I have multiple domains which are setup to redirect (301) to my main domain. However I know some of these domains have little to no value in terms of SEO and I would like to get rid of them. But a concern of mine is that there may exist backlinks under these domains.



I checked google analytics and none of these domains came up, but I decided to confirm they would registered if they were used. Unfortunately in testing, my Apache 301 redirect does not seem to preserve the referring URL. I know this is largely dependent on the client, but it seems the consensus is that most of the time this is preserved.




  1. Are there any settings in modern browsers which instruct them to remove a referrer when redirected? I'm getting this behavior in Firefox, Chrome and IE.


  2. Is there anything I can do on the server side which may influence a client to preserve the referrer?

  3. If this is a dead end, what other methods are there to check if there are any backlinks or usages of these aliased domains?



Here is my redirect:



## Redirect non www to www
RewriteCond %{HTTPS} off [OR]
RewriteCond %{HTTP_HOST} !^www\.example\.com$ [NC]
RewriteRule ^(.*)$ https://www.example.com$1 [R=301,L]


Answer



An referrer is not the same as a redirect.



If you call a page e.g. http://www.example.com and on the page you have one or more resource like Images, CSS and JavaScript files, the browser will get them as well. If the Browser do so he send the original page, in our case this is http://www.example.com as a referrer to the server. Even this is optimal all modern browser do so. There is only one exception if the origin page is a https URL but the resources is http.



Now a redirect is something completely different. If you request is going to a server and the server responds with a 301 redirect the browser understand that the location has changed and therefor requesting the new location.



But if a 301 is for a resource (image,css,js,etc.) the refer will usually send again to the new location. The same exception applies here with https and http (see above).




A referrer will not be send by the Browser if a user enter a URL into the browser e.g http://example.com and this URL will be redirected to http://www.example.com, because http://example.com is not the referring page it was just redirected to a new location.



Now to the possible solution: you could add some UTM Parameters to your redirect https://en.wikipedia.org/wiki/UTM_parameters . This will be tract by Google Analytics. So you see if a page was called with this UTM Parameters and that means that it was called by a redirect. You can do statistic of how many times that page is called with this parameter or what source was the most used etc. Of course if someone have disabled JS or have any Anti-Tracking plug in than you will not see this call in your statistic.



## Redirect non www to www
RewriteCond %{HTTPS} off [OR]
RewriteCond %{HTTP_HOST} !^www\.example\.com$ [NC]
RewriteRule ^(.*)$ https://www.example.com$1?utm_source=%{HTTP_HOST}/%{REQUEST_URI}%?{QUERY_STRING}&utm_campaign=redirect [R=301,QSA,L]

Comments

Popular posts from this blog

linux - iDRAC6 Virtual Media native library cannot be loaded

When attempting to mount Virtual Media on a iDRAC6 IP KVM session I get the following error: I'm using Ubuntu 9.04 and: $ javaws -version Java(TM) Web Start 1.6.0_16 $ uname -a Linux aud22419-linux 2.6.28-15-generic #51-Ubuntu SMP Mon Aug 31 13:39:06 UTC 2009 x86_64 GNU/Linux $ firefox -version Mozilla Firefox 3.0.14, Copyright (c) 1998 - 2009 mozilla.org On Windows + IE it (unsurprisingly) works. I've just gotten off the phone with the Dell tech support and I was told it is known to work on Linux + Firefox, albeit Ubuntu is not supported (by Dell, that is). Has anyone out there managed to mount virtual media in the same scenario?

hp proliant - Smart Array P822 with HBA Mode?

We get an HP DL360 G8 with an Smart Array P822 controller. On that controller will come a HP StorageWorks D2700 . Does anybody know, that it is possible to run the Smart Array P822 in HBA mode? I found only information about the P410i, who can run HBA. If this is not supported, what you think about the LSI 9207-8e controller? Will this fit good in that setup? The Hardware we get is used but all original from HP. The StorageWorks has 25 x 900 GB SAS 10K disks. Because the disks are not new I would like to use only 22 for raid6, and the rest for spare (I need to see if the disk count is optimal or not for zfs). It would be nice if I'm not stick to SAS in future. As OS I would like to install debian stretch with zfs 0.71 as file system and software raid. I have see that hp has an page for debian to. I would like to use hba mode because it is recommend, that zfs know at most as possible about the disk, and I'm independent from the raid controller. For us zfs have many benefits,

apache 2.2 - Server Potentially Compromised -- c99madshell

So, low and behold, a legacy site we've been hosting for a client had a version of FCKEditor that allowed someone to upload the dreaded c99madshell exploit onto our web host. I'm not a big security buff -- frankly I'm just a dev currently responsible for S/A duties due to a loss of personnel. Accordingly, I'd love any help you server-faulters could provide in assessing the damage from the exploit. To give you a bit of information: The file was uploaded into a directory within the webroot, "/_img/fck_uploads/File/". The Apache user and group are restricted such that they can't log in and don't have permissions outside of the directory from which we serve sites. All the files had 770 permissions (user rwx, group rwx, other none) -- something I wanted to fix but was told to hold off on as it wasn't "high priority" (hopefully this changes that). So it seems the hackers could've easily executed the script. Now I wasn't able