Ubuntu web browsers do not properly identify host

Bug #584758 reported by ethana2
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Chromium Browser
Unknown
Unknown
Epiphany Browser
Invalid
Unknown
Mozilla Firefox
Won't Fix
Unknown
epiphany-browser (Ubuntu)
Confirmed
Wishlist
Micah Gersten

Bug Description

As a consequence of not identifying their host OS properly, Ubuntu browsers fail to identify it correctly in all cases but one (stock Firefox).

As a result, 1/3 or more of Ubuntu users are not correctly recognized by online statistics.

There are two possible solutions:
Properly, promptly, and consistently package the latest versions of every popular browser for Ubuntu with correct useragents, or
Get upstream browser developers to use uname to set host OS useragent information.

Revision history for this message
In , ethana2 (ethana2) wrote :

The useragent I pasted into the bug form is only correct because I'm running the version of Firefox that came with Ubuntu.

Revision history for this message
In , Davemgarrett (davemgarrett) wrote :

The user agent identifies the browser, not the system. (i.e. the "agent" of the user that's accessing things) The distro name only really belongs in the UA when it's that distro's build.

Revision history for this message
In , ethana2 (ethana2) wrote :

As an end user, it is more important to me that my useragent identifies my OS than it identify the actual browser. I expect to be given W3C compliant code regardless of this string. When useragents are integrated into actual code paths, people just get discriminated against, like how my mom has to use an extension to lie to government web sites about her browser so she can log in and whatever else.

I just want correct statistics.

Revision history for this message
In , Philip-chee (philip-chee) wrote :

Moving component DevTools=>General but probably should be in Core or toolkit.
Probably WONTFIX however.

Revision history for this message
In , Davemgarrett (davemgarrett) wrote :

By the way, the "Linux i686" part is already derived from "uname -sm".
https://developer.mozilla.org/en/User_Agent_Strings_Reference

I'm running Kubuntu Lucid and what I get with "uname --all" is:
Linux dave-laptop 2.6.32-22-generic
#33-Ubuntu SMP Wed Apr 28 13:27:30 UTC 2010 i686 GNU/Linux

I don't think the info you're looking for is in uname as stated. I'll just rename the bug to state the intent instead.

I agree with Philip that this is probably WONTFIX, not just because UAs aren't really for this but also because of plenty of other arguments in the other direction to limit exposed info for privacy reasons.

Revision history for this message
In , Philip-chee (philip-chee) wrote :

Also the current trend is towards shorter UA strings not longer.

Revision history for this message
In , Matti-mversen (matti-mversen) wrote :

bug 57555 wants a shorter UA, see also bug 566423

Revision history for this message
ethana2 (ethana2) wrote :

As a consequence of not identifying their host OS properly, Ubuntu browsers fail to identify it correctly in all cases but one (stock Firefox).

As a result, 1/3 or more of Ubuntu users are not correctly recognized by online statistics.

There are two possible solutions:
Properly, promptly, and consistently package the latest versions of every popular browser for Ubuntu with correct useragents, or
Get upstream browser developers to use uname to set host OS useragent information.

Changed in firefox:
status: Unknown → New
Revision history for this message
Waleed Hamra (w-hamra1987) wrote :

ok, i installed chromium, and checked the user agent reported to websites:
Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/533.2 (KHTML, like Gecko) Chrome/5.0.342.9 Safari/533.2

which looks fine to me...

i cant try firefox since i already have a self-built trunk installation, which also reports:

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.3a5pre) Gecko/20100502 Firefox/3.7a5pre GTB7.1

what exactly is it that you notice is incorrect in your browsers' user-agent?
i agree that the U is kinda cryptic, but U is for Ubuntu.

Changed in epiphany-browser:
status: Unknown → New
Revision history for this message
ethana2 (ethana2) wrote :

Mozilla/5.0 (X11; U; Linux i686; en-ca) AppleWebKit/531.2+ (KHTML, like Gecko) Safari/531.2+ Debian/squeeze/sid () Epiphany/2.30.2

..Blog sites identify my Epiphany as running on Debian, not Ubuntu.

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.3) Gecko/20100423 Ubuntu/10.04 (lucid) Firefox/3.6.3

..and that's stock Firefox.

The U does not mean Ubuntu.

Revision history for this message
ethana2 (ethana2) wrote :

Web browsers created in the United States, such as Netscape Navigator and Internet Explorer, use the letters U, I, and N, to specify the encryption strength in the user agent string. Until the US government allowed encryption with keys longer than 40 bits to be exported, in 1996, vendors shipped various browser versions with different encryption strengths. "U" stands for "USA" (for the version with 128-bit encryption), "I" stands for "International"--the browser has 40-bit encryption and can be used anywhere in the world--and "N" stands (de facto) for "None" (no encryption).[5] Following the lifting of export restrictions, most vendors supported 256-bit encryption.

http://en.wikipedia.org/wiki/User_agent

Revision history for this message
ethana2 (ethana2) wrote :

http://images.cheezburger.com/completestore/2010/5/22/129190627850293860.png

Since Ubuntu users are early adopters, I believe this bug affects around 30-40% of us. I've used firefox prereleases and epiphany for years, and even my mom is an avid Chrome fan. I notice more geeks using Chrome these days than I notice using Firefox.

This bug, by way of stastistics-collecting sites, is now deterring development of proprietary applications for ubuntu, and thereby its end-user adoption, on an absolutely colossal scale by making the Ubuntu market appear significantly smaller than it actually is.

Revision history for this message
In , Gervase Markham (gerv-mozilla) wrote :

The purpose of user agent strings is not to enable Linux distribution popularity contests.

https://developer.mozilla.org/en/User_Agent_Strings_Reference documents how the amount of information about the Linux used was _reduced_ for security reasons. I don't think we are planning to revisit that decision.

Gerv

Revision history for this message
Micah Gersten (micahg) wrote :

Based on upstream Mozilla comments, I think we're going to mark this Won't Fix as well. Here's the document linked from the upstream Mozilla Bug about Mozilla User Agents, the concerns involved, and the relevant RFCs: https://developer.mozilla.org/en/User_Agent_Strings_Reference
I think Chromium and Epiphany would have similar ideas about Security/Privacy concerns.
Please report any other issues you may find.
I'll continue to monitor this in case Epiphany and/or Chromium decide differently.

Changed in ubuntu:
importance: Undecided → Wishlist
status: New → Won't Fix
Revision history for this message
ethana2 (ethana2) wrote :

That only means it can't be fixed *properly*, so the Ubuntu packages for these browsers must all be modified. I've done a little bit of packaging before, so I'll have to try and see if I can figure that out or hire someone who can.

Revision history for this message
Micah Gersten (micahg) wrote : Re: [Bug 584758] Re: Ubuntu web browsers do not properly identify host

First of all the Firefox builds that we make already have Ubuntu in
them since they're *our* builds. As for the other browsers, we should
follow the conventions set by upstream for their User Agents. User
agents are not made for what you want to do.

On 05/24/2010 01:55 PM, ethana2 wrote:
> That only means it can't be fixed *properly*, so the Ubuntu packages for
> these browsers must all be modified. I've done a little bit of
> packaging before, so I'll have to try and see if I can figure that out
> or hire someone who can.
>

Changed in firefox:
status: New → Won't Fix
Revision history for this message
ethana2 (ethana2) wrote :

Please tell me what useragents are for.

Revision history for this message
Micah Gersten (micahg) wrote :

A user agent is to tell the web server what type of browser is
requesting content so that appropriate content can be returned.

Here are the related RFCs:
http://www.ietf.org/rfc/rfc1945.txt
http://www.ietf.org/rfc/rfc2068.txt

On 05/25/2010 10:24 PM, ethana2 wrote:
> Please tell me what useragents are for.
>

Revision history for this message
ethana2 (ethana2) wrote :

Then it is important that my browser identifies my OS as Ubuntu.
To see this in proper use, see:

google.com/chrome

Revision history for this message
ethana2 (ethana2) wrote :

I would consider my seeing a .dmg, .rpm, or .msi on that page to be inappropriately served content.

Revision history for this message
Micah Gersten (micahg) wrote :

It's not about the OS, but the platform. This page correctly shows me
the page for Linux.

On 05/25/2010 11:52 PM, ethana2 wrote:
> Then it is important that my browser identifies my OS as Ubuntu. To
> see this in proper use, see:
>
> google.com/chrome
>

Are you seeing that? I tried in 4 different browsers (Firefox,
Epiphany, Arora, Konqueror) and all show me the Linux page.

On 05/25/2010 11:53 PM, ethana2 wrote:
> I would consider my seeing a .dmg, .rpm, or .msi on that page to
> be inappropriately served content.
>

Revision history for this message
ethana2 (ethana2) wrote :

Because useragents are currently unreliable, they have to rely on a *second* page asking the *user* to identify their platform and choose their executable using a radio button. We can fix that.

Revision history for this message
ethana2 (ethana2) wrote :

If you think "linux" is the proper way to identify a platform, I trust you'll help me get stock Firefox and Epiphany (which identify as Ubuntu and Debian, respectively) fixed to that effect?

Revision history for this message
Micah Gersten (micahg) wrote :

Again, the point of a user agent is for rendered content to be proper,
not necessarily downloadable content. Google is doing this correctly.

On 05/26/2010 12:20 AM, ethana2 wrote:
> If you think "linux" is the proper way to identify a platform, I
> trust you'll help me get stock Firefox and Epiphany (which identify
> as Ubuntu and Debian, respectively) fixed to that effect?
>

Revision history for this message
ethana2 (ethana2) wrote :

Keep in mind the most popular linux variant very soon will be Google Android.

The kernel actually means very little in terms of what the platform actually is nearly irrelevant in determining what content is appropriate to return.

Revision history for this message
Micah Gersten (micahg) wrote :

If you want this fixed, you need to file an RFC for it. This is not
the purpose of the user agent as specified in the RFCs that I provided.

On 05/26/2010 12:18 AM, ethana2 wrote:
> Because useragents are currently unreliable, they have to rely on a
> *second* page asking the *user* to identify their platform and choose
> their executable using a radio button. We can fix that.
>

Revision history for this message
ethana2 (ethana2) wrote :

I don't mind paying someone to fix this myself, but would I have to file an RFC in order to get the fixed packages accepted into Ubuntu main and universe repositories, while stock Firefox *already* has useragent information that doesn't fall within the RFCs you linked here?

Revision history for this message
Waleed Hamra (w-hamra1987) wrote :

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.3a5pre) Gecko/20100502 Firefox/3.7a5pre GTB7.1

this is from a firefox compiled from source without any source modifications. a *stock* firefox as you may call it. i dont see it listing ubuntu anywhere.

Revision history for this message
Fabien Tassin (fta) wrote :

Not wanted in Chromium by upstream. I wrote a patch once, they rejected it.

Changed in epiphany-browser:
status: New → Invalid
Revision history for this message
Micah Gersten (micahg) wrote :

It seems that Epiphany Browser in Ubuntu is affected by this and is the only app with an issue here. Therefore, I am assigning this task to that package. I will make a patch for this.

affects: ubuntu → epiphany-browser (Ubuntu)
Changed in epiphany-browser (Ubuntu):
assignee: nobody → Micah Gersten (micahg)
status: Won't Fix → Triaged
Revision history for this message
Micah Gersten (micahg) wrote :

This particular bug has already been fixed and is a duplicate of bug 578717, so it is being marked as such. Please look at the other bug report to see if there is any missing information that you can provide, or to see if there is a workaround for the bug. Additionally, any further discussion regarding the bug should occur in the other report. Please continue to report any other bugs you may find.

Changed in epiphany-browser (Ubuntu):
status: Triaged → Confirmed
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.