[TOPBLOCKER] 7digital previews do not play in the scope

Adding a bug task for ubuntu-rest-scopes, since that is where the 7digital results come from (the Music page on the dash is just aggregating them).

Using scopes-client, the data for the audio tracks in the previews looks like e.g:

  {
    "length":209,
    "source":"http://previews.7digital.com/clip/39903197?oauth_nonce=96292359&oauth_timestamp=1413518820&oauth_consumer_key=7d7e9ja2evm7&oauth_signature_method=HMAC-SHA1&oauth_version=1.0&oauth_signature=L0xPZSEB2DnM%2BJxrCZMFiv2gPms%3D",
    "title":"01. County Line",
  }

It looks like 7digital performs some user agent sniffing for these URLs, since requests for this URL with wget result in a 403 forbidden error, but successfully send the MP3 data if I use a blank or nonsense user agent. Presumably the in-dash playback is being blocked in a similar fashion.

So to sum up, the questions are:

 1. what UA does the dash send when it tries to play audio in previews?
 2. If that UA is generic and shared by apps on other platforms, we should probably change it.
 3. If that UA is unique to Ubuntu, then 7digital is explicitly blocking us and someone needs to get in contact with them to sort it out.

The URL is coming from the server is ok, like the one pointing James above, or this example:

  http://previews.7digital.com/clip/40202347?oauth_nonce=05780389&oauth_timestamp=1413816139&country=US&oauth_consumer_key=7d7e9ja2evm7&oauth_signature_method=HMAC-SHA1&oauth_version=1.0&oauth_signature=FVgXk5tzbSyyB6/g/78GO8REavA%3D

The problem is that at some point it's get mangled. See what unity8 logs in the device (unity8-dash.log):

  Setting media to: QUrl( "http://previews.7digital.com/clip/40202347?oauth_nonce=05780389&oauth_timestamp=1413816139&country=US&oauth_consumer_key=7d7e9ja2evm7&oauth_signature_method=HMAC-SHA1&oauth_version=1.0&oauth_signature=FVgXk5tzbSyyB6/g/78GO8REavA=" )

(pay extra attention to the last character in the URL)

Changing the project to unity8 as for Saviq recomendation in IRC.

I looked at it before (I even think there was a bug already...), it seems to be QUrl that unescapes things in the params.

After initial testing, it looks like something like this needs to get used:
    url.setPath(path,QUrl::DecodedMode);

As the default mode, QUrl::TolerantMode as well as QUrl::StrictMode result in the '%3D' getting mangled.

seems it's gonna take a little digging.
pushing out target date
assign to saviq so it's not lost

I found this which might be the problem:

QUrl AalMediaPlayerControl::unescape(const QMediaContent &media) const
{
    if (media.isNull())
        return QUrl();

    return QUrl::fromPercentEncoding(media.canonicalUrl().toString().toUtf8());
}

I tested this with a small commandline thing, and fromPercentEncoding() can mangle that url
:
QString str = "http://previews.7digital.com/clip/40202347?oauth_signature=FVgXk5tzbSyyB6/g/78GO8REavA%3D";
 qDebug() << QUrl::fromPercentEncoding(str.toUtf8());

output: "http://previews.7digital.com/clip/40202347?oauth_signature=FVgXk5tzbSyyB6/g/78GO8REavA="

This above is in qtubuntu-media, we need to look through why it's using that code and whether we can improve this!

With the linked branch for qtubuntu-media, I can see that it's passing through an unmodified URI to playbin. However, when it tries to play the 7digital stream, I'm seeing a not authorized HTTP return code from souphttpsrc. How exactly does a user get authenticated to be able to play a 7digital stream?

The url returned by the scope now seems wrong:

http://previews.7digital.com/clip/40673459?oauth_nonce=99903452&oauth_timestamp=1415099166&country=scopes-api%3D0.6.7+14.10.20141014-0ubuntu1&oauth_consumer_key=7d7e9ja2evm7&oauth_signature_method=HMAC-SHA1&oauth_version=1.0&oauth_signature=5m0Dbus44WScuZ0WshMXhLxFLZw%3D

Website says:
"Value of parameter country is not valid: scopes-api=0.6.7 14.10.20141014-0ubuntu1"

set active tasks to critical to express that it's a [TOPBLOCKER]

The fixes for this bug are currently pending QA sign off.

This bug was fixed in the package qtubuntu-media - 0.7.1+15.04.20141107-0ubuntu1

---------------
qtubuntu-media (0.7.1+15.04.20141107-0ubuntu1) vivid; urgency=low

  [ Jim Hodapp ]
  * Fix URI encoding issue related to playing remote URIs like from
    7digital (LP: #1381930)

  [ Ubuntu daily release ]
  * New rebuild forced
 -- Ubuntu daily release <email address hidden> Fri, 07 Nov 2014 03:23:56 +0000

This bug was fixed in the package qtubuntu-media - 0.7.1+15.04.20141107~rtm-0ubuntu1

---------------
qtubuntu-media (0.7.1+15.04.20141107~rtm-0ubuntu1) 14.09; urgency=low

  [ Jim Hodapp ]
  * Fix URI encoding issue related to playing remote URIs like from
    7digital (LP: #1381930)

  [ Ubuntu daily release ]
  * New rebuild forced

qtubuntu-media (0.7.1+15.04.20141105.2-0ubuntu1) vivid; urgency=low

  [ thomas-voss ]
  * Get rid of custom ref-counting and reuse pre-created object. (LP:
    #1387959)
 -- Ubuntu daily release <email address hidden> Fri, 07 Nov 2014 03:17:43 +0000

This bug was fixed in the package unity-scopes-api - 0.6.7+15.04.20141107.1~rtm-0ubuntu1

---------------
unity-scopes-api (0.6.7+15.04.20141107.1~rtm-0ubuntu1) 14.09; urgency=low

  [ Pawel Stolowski ]
  * Fix parameter order for the smart scopes preview request. (LP:
    #1381930)
 -- Ubuntu daily release <email address hidden> Fri, 07 Nov 2014 20:23:45 +0000

marking the remaining Ubuntu task as high to get off rtm list