Follow Up on HTML5 Video in IE9


Our recent post generated many comments and questions. The discussion of intellectual property rights is complex and invites many different points of view. This is a good opportunity to talk through the certainty and uncertainty relative to our goals for IE9 from Microsoft’s point of view.

Developers have consistently conveyed that they want certainty and predictability in the underlying browser platform. We want to deliver a great HTML5 experience in IE9 with great certainty.  The goal of certainty informs a lot of choices, such as which of the many standards still under construction we’ll pursue. Browser developers have to make decisions like this all the time.

For many reasons, H.264 video offers a more certain path than other video formats and does so in a way that delivers a great HTML5 experience for developers and end-users. First and most important, we think it is the best available video codec today for HTML5 for our customers. Relative to alternatives, H.264 maintains strong hardware support in PCs and mobile devices as well as a breadth of implementation in consumer electronics devices around the world, excellent video quality, scale of existing usage, availability of tools and content authoring systems, and overall industry momentum – each an important factor that contributes to our point of view.

H.264 also provides the best certainty and clarity with respect to legal rights from the many companies that have patents in this area.  The rights for implementations of the H.264 standard (see this Wikipedia article about the standardization process) are managed by MPEG-LA as part of a program that has been in place for many years. This long-standing licensing program for a codec that is in broad usage today in the industry provides a stable system from which we can support our customers. As experts will note, there is never complete certainty in an area like this one.

Some comments asked for examples to support the statement in the previous post about “The rights to other codecs are often less clear, as has been described in the press.” One comment linked to a Streaming Media article; other examples are easy to find.

Intellectual property is a complex topic. As it’s not an engineering topic and this is an engineering blog, the remarks here are by definition limited.  On the topic of whether one person’s codec does or doesn’t use someone else’s intellectual property, the only opinion that ultimately matters is a court’s.  Many people seem to assume that availability of source code under an open source license implies that there are no additional costs, or that the code has properly secured necessary intellectual property rights from all rightful owners.  Our experience and the experience of others indicate otherwise, and the web standards groups have discussed this issue as well. For other codecs, it’s not clear today how the rights will be determined for commercial scenarios and what the costs will be. By virtue of existing commercial use in a wide variety of products implemented by a large number of companies, H.264 minimizes uncertainty for consumers and developers.

Several comments speculated about Microsoft’s financial interest in the codec. (Microsoft participates in MPEG-LA with many other companies.) Microsoft pays into MPEG-LA about twice as much as it receives back for rights to H.264. Much of what Microsoft pays in royalties is so that people who buy Windows (on a new PC from an OEM or as a packaged product) can just play H.264 video or DVD movies. Microsoft receives back from MPEG-LA less than half the amount for the patent rights that it contributes because there are many other companies that provide the licensed functionality in content and products that sell in high volume. Microsoft pledged its patent rights to this neutral organization in order to make its rights broadly available under clear terms, not because it thought this might be a good revenue stream. We do not foresee this patent pool ever producing a material revenue stream, and revenue plays no part in our decision here. 

There were many questions about royalties, and a lot of speculation in the comments about licenses and payments. The majority of H.264 video content on the web today is royalty-free.   MPEG has said that individuals can create video files in the H.264 format and distribute them and play them over the internet for non-commercial purposes without further obligation on licensed platforms like Windows. We are aware that this commitment is set to expire in 2016, but fully expect to commit to supporting the extension of this license and associated terms beyond that date. In general, distributing encoders or decoders or offering sophisticated pay-for-video requires a license from MPEG-LA.  Third-party applications that simply make calls to the H.264 code in Windows (and which do not incorporate any H.264 code directly) are covered by Microsoft’s license of H.264. 

Some comments pointed to language in our Windows EULA that comes directly from MPEG-LA and reinforces many of these terms. As with all licensing programs, there are limitations and issues, which people have pointed out.  The functionality we provide is technology we license and we follow the terms of that license.

Several comments asked about Microsoft’s support for plug-ins (like Flash and Silverlight). Of course, IE9 will continue to support Flash and other plug-ins. Developers who want to use the same markup today across different browsers rely on plug-ins. Plug-ins are also important for delivering innovation and functionality ahead of the standards process; mainstream video on the web today works primarily because of plug-ins.  We’re committed to plug-in support because developer choice and opportunity in authoring web pages are very important; ISVs on a platform are what make it great. We fully expect to support plug-ins (of all types, including video) along with HTML5.  There were also some comments asking about our work with Adobe on Flash and this report offers a recent discussion.

We’ve read some follow up discussion about support for more than the H.264 codec in IE9’s HTML5 video tag. To be clear, users can install other codecs for use in Windows Media Player and Windows Media Center.  For web browsers, developers can continue to offer plug-ins (using NPAPI or ActiveX; they are effectively equivalent in this scenario) so that webpages can play video using these codecs on Windows. For example, webpages will still be able to play VC-1 (Microsoft WMV) files in IE9.  A key motivator for improving the codec support in Windows 7 was to reduce the need that end-users might have to download additional codecs.  The security risks regarding downloadable codecs and associated malware are documented and significant. By building on H.264 for HTML5 video functionality, we provide a higher level of certainty regarding the security of this aspect of browsing and our web platform.

The biggest obstacle to supporting more than H.264 today is the uncertainty. When there’s industry consensus and confidence that the uncertainties are resolved, we’ll be open to considering other codecs. Until then, we’ll continue with our current plans to deliver great HTML5 video in IE9 with certainty for consumers and developers.

Dean Hachamovitch

List of articles referenced

AVC/H.264 Licensors

Fake codecs that drop widely spread malware

Google may face legal challenges if it open-sources VP8 codec

H.264 Already Won—Makes Up 66 Percent Of Web Videos

H.264 licensing body won’t charge royalties for HTML5, other Web streams

IE Blog: HTML5 Video

JPEG patent case steams forward

Mac OS X malware posing as fake video codec discovered

Malware Posing As Youtube Codec

Media Streaming with Windows 7

Microsoft Security Intelligence Report Volume 8

Microsoft Sued Over JPEG Patent

MPEG LA’s AVC License Will Continue Not to Charge Royalties for Internet Video that is Free to End Users

NPAPI

Open letter to Steve Jobs: Thoughts on Flash

Re: Codecs for <video> and <audio> from Silvia Pfeiffer on 2009-07-29 (public-html@w3.org from July 2009)

Comments (191)

  1. Anonymous says:

    Many years ago there were emails – still easily found with a search – showing how the management of Microsoft wanted to give Netscape users "a jarring experience" by purposely insuring it could not integrate with Windows at the time.  And the "browser is part of the OS" which lead to an IE vulnerability being a kernel vulnerability, to say nothing of all the Active X (it might be completely malicious, but it would have a digital signature). You didn’t even have the "Internet Explorer" trademark but sued the actual owner into bankruptcy.

    Nice to know that nothing has changed at Microsoft.  Still evil, locking people within the box defined by the Gates from Hell.

    Bad security, make it jarring to make even trivial changes, then saying it is all to give your customers a good experience.

    You have a long history.  And very little of it is good.

  2. Anonymous says:

    “Intellectual property is a complex topic. As it’s not an engineering topic and this is an engineering blog, the remarks here are by definition limited.”

    You might limit discussion of financial topics also, because you don’t have clue about it or you think we are so stupid and not going to notice this crap:

    “Microsoft pays into MPEG-LA about twice as much as it receives back for rights to H.264.”

    If three companies form a patent-pull and set the price to X for each license. So of course Microsoft will receive less then X back.  X= A+B+C where the A is the pay back to MS and B+C is the pay back to other two companies. But you conveniently forget that other two companies should pay license also. And if you do 3rd grade math you will now that for the members of the pool the license cost will balance with the profits form the license royalties.  The profit for Microsoft and Apple will come form the license royalties paid by non-members. Based on your statement I know that MS is receiving 50% from each non-member.

    No wonder that MS and Apple are pushing H.264!

  3. Anonymous says:

    @Aaron "…a lot a bloggers and sites will not be able to finance the large royalty fees…"

    Due to there being so much crap on bloggers and various other websites, that’s no bad thing.

  4. Anonymous says:

    So far I’ve been quite pleased with Microsoft’s products in recent years, but this decision on H.264 is so ass backwards and such full of BS that I can’t even contemplate what is going through the heads of the people that are deciding this.

    It’s funny that you stated that H.264’s patent status is "certain" and others "aren’t certain", and then turn around and claim that "developers want a single platform to standardize on."

    Guess what…If I want to provide video content to my site users for a PROFIT, I should have not to pay royalties on the delivery mechanism used unless I personally felt I had the absolute choice in the matter.

    The very fact that HTML5 by default will *ONLY* support h.264 means I do not have a choice in the matter, and that if I want to use HTML5 to deliver content for a fee, I need to pony up some money.

    Sorry, not going to happen. The rest of the internet will continue to use Flash while very few websites and people will find themselves using HTML5/H.264.

    No, H.264 is not going to a way to get a blanket revenue stream from every streaming site on the internet. Whoever thinks that’s going to be a possibility is smoking something REALLY good.

  5. Anonymous says:

    More "happy words" from Microsoft. In actuality this is NO different than the song and dance Microsoft engaged in over ODF and OOXML. Dig beneath the baffling BS storm from Microsoft and what you find is it is all about keeping control in the hands of greedy corporations unwilling to accept the idea of an "OPEN" Internet despite the fact that the open Internet has made them billions over the years. Nothing more than Microsoft and the other corporate fat cats wanting complete control. Ignore the song and dance, demand open standards everywhere.

  6. Anonymous says:

    Reminder:

    – Ogg is a container format. It can mix 255 streams (audio, video, text) of any type in any number. It’s been in use for a while, and is currently the most used container for Vorbis audio.

    – Vorbis is an audio codec, developed solely for high quality audio encodes, contrary to MP3 which was at first a format for low bitrate audio. It is currently used on several Microsoft games, and World of Warcraft (how’s that for ‘not big enough’?).

    – Theora is a video codec based on On2’s VP3 codec, using technologies patented by On2. On2 gives a royalty free, irrevocable, unlimited license for these patents on every VP3 derivative work. VP3 dates back 10 years  (and its patents are older than that), and as such it is unlikely that submarine patents could impede it for long. The format describes only the output stream, meaning that you can use whatever method you want to create or unpack a Theora stream – allowing stuff like workarounds to step around most incidental patents. h.264 is so intricate, that can’t work.

    – Currently, Safari supports Ogg, Vorbis and Theora if Quicktime is installed. Leaving IE 9 as the only browser without any Theora support whatsoever.

    In short, IE 9 could support Ogg and Vorbis without any problem. Theora, I agree, might be a bit trickier. However, IE should NOT prevent video tags from processing anything but h.264, and allow users to install a Theora decoder. After that, it’s the plugin’s author responsibility.

    C’mon guys, don’t be dumb – keep support for h.264, alright, but allow Theora to be supported too…

  7. Anonymous says:

    I do not wonder why MS always walks the shitty way, you will DIE SOON, PREPARE!

    p.s. if you invest more into Bing you might be able to become an information company. You have the power to place your search system onto your desktops, that power won’t last forever, use it and you will be able to rival google in their own domain. You have already lost the browser and OS war, and you know it. If it happens that you implement a true yellow box for NT5’ish/win7’ish apps and Win8 brings a real secure, easy to use, sleek interface, you might yet again triumph. Besides that Bing is your only chance as you have lost on all the other markets.

  8. Anonymous says:

    To the idiots who think Microsoft has financial gain in h264 support: By implementing h264 in IE9, they will have to pay royalties to MPEGLA (unless IE9 is covered by Win7). Microsoft won’t gain money for shipping with h264: they will infact have to pay themselves for every IE9 copy.

    Ogg would be suitable only until some patent troll surfaces, and sues every major tech company for implementing it. It’s the equivalent of shooting yourself in the foot, as far as Microsoft is concerned. Using H264 is a financial loss, but at least a calculated one, while Ogg is like walking on a (patent) minefield.

    And h264 is way better quality wise as well.

  9. Anonymous says:

    @Matt,

    If you don’t know where mpeg4 plays in all this, and especially if you think my link was spam, you shouldn’t be commenting in this thread. It makes you look bad and sound like Dean Hachamovitch.

  10. Anonymous says:

    It’s interesting Microsoft removed my post in response to being accused of posting a spam link yet leaves the false accusation in place.

  11. Anonymous says:

    Is this going to affect me viewing porn.

    If not I don’t care

    Bill!

  12. Anonymous says:

    ok enough with this H.264 vs other codecs BS and just release something, ANYTHING already!  Chrome seems to do a new (and faster!) release every few weeks and you’re still debating which video codec to support as you watch the IE market share slip more and more every day! At what % marketshare will you go "oh crap, we really need to a adopt a modern/frequent release schedule to keep up!"

  13. Anonymous says:

    I am making this comment from Google Chrome. ’nuff said.

  14. Anonymous says:

    thank you for this great info, I was looking for, really thanks

  15. Anonymous says:

    No one uses IE, only non internet saavy people do, and they are dying out quicker then you think…

  16. Anonymous says:

    I hoped that you’ll at least support wmv/vc-1 and hope that we’ll be able to choose which codecs we’ll use in IE9. So far the idea of using H.264 is great – I think that this and other HTML 5 extensions’ll change the web as we know it.

    However, you should not drop plugins yet, as these have some important features, that are not covered in HTML.

    We hope to see more inventions and samples with the next build of IE9.

  17. Anonymous says:

    The least you could do is name the major competing codec and what it’s pros and cons are. You just come off as legally afraid to do anything else.

    Well at least I hope that’s it and not that you are supporting this codec to make it hard for new multi-platform independent browsers to start up.

  18. Anonymous says:

    This post does not make it clear why VC-1 was not added as well. It is also a standard with industry momentum that has a lot of hardware support and has near identical licensing as h.264.

    It also has a lot of advantages in using a lot less computing power to decode video essentially making it a greener codec than h.264 and much easier for mobile devices batteries.

  19. Anonymous says:

    "At the end of the day, we’re building a browser for the Windows customer. Listening to that customer, in whatever form that takes, is not just important, it defines what we’re here to do." LIARS. WINDOWS CUSTOMERS WANT XP SUPPORT FOR IE9 WHICH YOU ARE NOT DOING. DID YOU NOT READ THOSE HUNDREDS OF COMMENTS ASKING FOR XP SUPPORT WHEN IE9 WAS UNVEILED?

  20. Anonymous says:

    The reason is enforced format lock-in, a widely used method with Microsoft products.

    It has nothing to do with developer convenience, especially for open source based development which this decision will have a direct negative effect, due to the complications related to H.264 licensing.

    And, considering convenience; it is the opposite of what you would call the situation when your video content is in a different format than the one enforced by the browser. Plugin-based video content is, and this is obvious, not the convenient solution.

    Except for these reasons, it shows MSIE unwillingness to cooperate with open standards, as H.264 should not be the defacto standard, which it would be, if MSIE exclusively supports only this format. It should only be one of the options.

  21. Leo Davidson says:

    "For other codecs, it’s not clear today how the rights will be determined for commercial scenarios and what the costs will be."

    It’s not clear today what the costs for H.264 will be, either.

    All we know is that MPEG-LA reserve the right to charge for just about everything (even *hosting* the files, it seems) but have promised not to charge for most things for a few years. That just makes them sound like crack dealers giving the first hit free, to me.

  22. Leo Davidson says:

    Just adding to my previous reply:

    MPEG-LA could solve the trust issue by legally promising to continue to only charge reasonable prices for reasonable things forever, instead of only for a few years.

    (Obviously "reasonable" would have to be defined, but if the licence cost was linked to inflation + some maximum percent, or whatever, that’d work.)

    If the MPEG-LA did that then they’d stop looking like crack dealers giving out the first hit for free.

    It reminds me of (UK) politicians bringing in draconian laws and verbally promising that they won’t abuse the laws, yet refusing to make those promises part of the conditions of the laws.

    If they really plan to be reasonable (and they may well do) then they should have no problem putting that in the contract.

    If they did that then most of the problems would go away.

  23. Anonymous says:

    Why not support Theora (.ogv)? It is an open-source video format whose codec can be included in a browser or any other programs at no costs. This is clearly stated in its website (http://www.theora.org/benefits/).

    In my opinion, Microsoft should support a variety of multimedia formats so that developers will not have to spend more time making things work. Should Microsoft limits its support for new web standards, Internet Explorer will lose market share, as we have seen, to other browsers as a consequence.

  24. Anonymous says:

    "Until then, we’ll continue with our current plans to deliver great HTML5 video in IE9 with certainty for consumers and developers."

    You act as if H.264 was some kind of certainty. It is most definitely not. H.264 is the most uncertain of choices because:

    – The commercial clause as put forth by MPEG-LA is very vaguely defined, thus exposing anybody who touches it to a huge risk.

    – Pricing for royalties are not quoted, and it is practically certain that they would put anybody out of business except big media conglomerates, thus representing an unquantifiable infinite risk.

    – Royalty free usage for personal use might end 2015, by which time an unspecified number of users and possibly businesses would be exposed to an unlimited amount of risk.

    – H.264 and its lock-in of video codecs might be found to be illegal under antitrust and price-fixing laws, therefore exposing anybody who touches it to an infinite risk of this technology being prohibited, limited, crippled or stagnated.

    – H.264 is put forth by a large committee, virtually guaranteeing that it will change little, and therefore exposing users and businesses to the infinite risk of being locked into yet another stagnant technology.

    H.264 is the next GIF, and personally I don’t fancy another 20 years in which some strangulating monopolistic standard cripples the web, the effects of which still reverberate in todays image support in browsers. Trying to make H.264 the standard for video is guaranteeing a GIFicationof web video and another 20 years or more of stagnation in the field of web video.

  25. Anonymous says:

    Too much emotion in this debate for firm decisions so early on to be purely in the public interest.

    Members of the working group really need to stop making statements and using language that is clearly chosen in an attempt to influence a draft specification that is still years from candidacy.

    There is no doubt H.264 is the current obvious choice (in 2010), but it is also no reason why the rendering conduit cannot be wide open for publisher choice into the future and render the debate a non-issue.

    This would be about as absurd as delivering user agents today that will only natively render GIF images out of the box.

    Show the global community some respect; the internet would not exist as it is today (for our own profiteering) if not for the open development and resistance to railroading.

  26. Anonymous says:

    Great post, can’t wait for IE9!

  27. Anonymous says:

    H.264 may be represented by 60% of web video offers, but right now it is only represented by 25% of the market share of web video capable installed browsers. Whereas ogg-theora is represented by 75% of web video capable installed browsers.

    The two H.264 proponent browsers are Safari and IE9. In order to fill the ogg-theora/H.264 gap, both Safari and IE9 would need to grow by over 25% in browser market share as opposed to IE6/7/8/Firefox. This is unlikely to happen within the next 18 months as Safari doesn’t grow that fast, and Microsoft has shown that is incapable of replacing older versions of its browser in a timely manner.

    Therefore the particular decision of IE9 *NOT* to support ogg-theora makes life especially much more difficult and uncertain for both consumers and developers. The decision will delay and hinder the arrival of web-video for another 2 to 3 years, because for users and developers there’s no single sure way of supporting video in 100% of web video capable browsers regardless of other risks and uncertainties either H.264 or ogg-theora represents and regardless of their technical merits or drawbacks.

  28. Anonymous says:

    The real question is: I agree that theora is not clear as of its patents, but if google publishes a new format, with the right licence to use it, would you implement it right away ?

    I mean, would we have to wait till IE 10. Is your decision set in stone for ie9 or are you allowing it to evolve ?

    I’d appreciate a clear answer, such as "whatever happens, we will stick to h264 ONLY", or "if a decent format with correct licence is made public, we will consider it".

    Thanks in advance

  29. Anonymous says:

    again, wich audio codecs will ie9 support. video without an audio-stream is a little bit boring. will ie9 support the audio-element?

  30. Anonymous says:

    First, thanks for this new post. This explain clearly your choice and your position and answer a lot of questions.

    I only have the impression that you are taking a shortcut to implement html5 video tag and you do not give any options for the future.

    Maybe that’s not your team goal but the focus should be on fixing the html5 specs to define a clear, royalty-free codec.

    MPEG LA objectives are commercials = to make as much money as possible : http://www.mpegla.com/main/Pages/PoolBenefits.aspx

    So implementing this codec only in your next browser and believing that everything will be ok in the future is naive to say the least.

    I think that your aiming only for the passing grade instead of giving a thoughtful and viable solution for the longterm.

  31. Anonymous says:

    Thanks for this informative post, Dean. Can’t wait for IE9!

    BTW, the guys that are claiming for ogg support should check this Ed Bott post first: http://blogs.zdnet.com/Bott/?p=2086.

    You also could go out and sayd the same stuff to Steve Jobs here: http://www.apple.com/hotnews/thoughts-on-flash/. Oh, wait, you can’t – because unlike Microsoft, Apple don’t like to open their posts to comments!!! After all, everything they do is for the benefit of the consumers, right…? (not).

  32. Anonymous says:

    Apple seems to have the same Problems:

    http://hugoroy.eu/jobs-os.php

    A browser without codecs is bad, a browser without fast codecs is bad but open source-browsers that uses codecs that are based on illegal copyright violating sources sould be banned. – Well, maybe I just don’t like the Mozilla HackFox browser.

    Even if we have to run wmp, it would be better than no support at all. Just integrate the UAC for that pupose in an easy way, and we’re all much happier.

  33. Anonymous says:

    Wait, I am a bit confused. We can only run the other codecs when using a plug-in? Why can’t the video tag also play any other codec that is installed on the user’s computer, and have IE9 specifically make sure that H.264 comes bundled? Security? If that is the case why allow it in WMP/WMC?

    Don’t get me wrong, I think H.264 is a better format than OGG, and I do understand why other browsers support just OGG. I am in the camp of someone that wants it to just work. Right now I will output both formats for my users and would love to be able to cut that down in the future. I just don’t understand why the video tag can’t be made to work with everything the user has.

    And can we please get a comment on the audio tag? Will it be supported? What format will that support? If it’s something beyond mp3, wave, or ogg I would really like to know as I have code I would need to update.

  34. Anonymous says:

    Video aside, why isn’t IE9’s focus Silverlight? Isn’t HTML5 just playing into the hands of Google?

  35. Anonymous says:

    Dear Microsoft, I want to hear you mention Ogg Theora. And I want you to talk about On2 VP8 which rumors are Google will unveil in a couple of weeks and free up licence free as HTML5 video codec.

    You, Microsoft, if you want to sound like you are playing nice to the FOSS crowd, simply need to state that you WOULD be interested in supporting On2 VP8, and that you would even be interested in supporting Google in proving to the industry that that specific open source and free codec would in fact be usable and not be in conflict with the Mpeg LA patents.

    You need to state that you would find it good for the industry that there were to be an open source and free video codec which also performs well compared to Mpeg LA patented codecs.

    Especially if adding Ogg Theora 2.0 support in IE9 only requires few megabytes of codec code, then you should state that you will not have a problem supporting that.

  36. Anonymous says:

    @tz. Yeah, MS is evil. And the fact that you can post that in a MS blog, no less (but not anywhere in an Apple one, for that matter) is very telling indeed…

  37. Anonymous says:

    Current H.264 patent litigation

    http://bit.ly/9vNGZW

  38. Anonymous says:

    I don’t think any amount of explaining is going to quell the cry for true interoperability with other codecs.

    How Microsoft and Apple could make such an absurd assumption that one single codec can rule them all is beyond me.  Lord of the Rings, anyone?

    The other thing that got me was this:

    "Developers have consistently conveyed that they want certainty and predictability in the underlying browser platform."

    If we’re talking about IE, then that’s an alternate universe that this statement has even begun to manifest.  I think it’s more applicable to say that developers have consistently conveyed that they want IE to follow standards, which, by definition, provides certainty and predictability.

    MY WEBWARE SHOULD WORK THE SAME ACROSS ALL BROWSERS THAT ADHERE TO STANDARDS!

    The entire IE family of products is a perfect example of how NOT to provide "certainty and predictability" except where security (or lack thereof) is concerned.  I can’t say it has done anything for page rendering because…and not to put too fine a point on it…it’s simply not happening with all these hacks I have to put in place.

    So Microsoft won’t support Theora.  Then I choose not to support IE and I most certainly will not support H.264.  I’m a webware developer, Microsoft.  I want standards and I want something open that I can readily use and not have to pay huge amounts of cash for in the future.

    "We are aware that this commitment is set to expire in 2016, but fully expect to commit to supporting the extension of this license and associated terms beyond that date."

    That doesn’t spell "certainty" to me…sounds more like the parable of the scorpion and the fox…

  39. Anonymous says:

    I wonder how many of the "MS is evil, Theora is good" comments come from people who actually read what this blog says.

  40. Anonymous says:

    Steve Jobs mailed:

    "A patent pool is being assembled to go after Theora and other "open source" codecs now."

    http://hugoroy.eu/jobs-os.php

  41. Anonymous says:

    Why not support both H.264 and Ogg Vorbis?

  42. Anonymous says:

    Rob, your (spam?) link says nothing about h264.

  43. Anonymous says:

    This is great news. Very logical roadmap. Thanks.

  44. Anonymous says:

    Florian, you’ve clearly conveyed that you don’t know anything about "antitrust and price-fixing laws" so why would anyone believe anything you say?

    Jadd, please be polite and actually read before commenting. Thanks.

  45. Parrotlover77 says:

    "We’re committed to plug-in support because developer choice and opportunity in authoring web pages are very important; ISVs on a platform are what make it great."

    You guys need to have a talk with the Windows Phone 7 team about developer choice, since there isn’t any in WP7.

    That aside, I like the direction IE9 is going.  H.264 is the best choice IMHO if you were to choose only a single codec for HTML5 video.  I’m glad to see you are open to other codecs, should other browsers make a different choice.  I’m hoping they don’t because I think a single codec and a single standard for this will make video support a lot easier for web developers in the long run.  

    Has the IE team communicated with Mozilla/Apple/Opera about using H.264 exclusively?  If there’s buy-in from the other browser vendors, I think a lot of fears will be eased.

  46. Anonymous says:

    Come January 1, 2011, MPEG-LA could drastically increase its license fees on H.264. It could start charging companies like YouTube (Google) a per-stream fee. If there is no alternative, patent-unencumbered codec available then web video will be all but dead.

    The arguments against Theora aren’t really there. Every argument speaks of patent problems, but fail to specify one. It’s just a lot of "maybe" and "possibly".

    Why not invest a bit of effort, if Microsoft is unsure of Theora’s patent issues, into research them for yourselves? Xiph.org already has, but if you’re unwilling to take their word for it then invest some effort to educate yourselves.

    Steve Jobs speaking of "a patent pool being assembled" is nothing more than fearmongering. The simple fact of the matter is that there is no patent pool. Such weak threats have been thrown out there since before it was published in 2004.

    That’s six years Theora has been available. And the number of lawsuits so far? Zero.

    And there never will be. It would be a devastating blow to MPEG-LA if it were proven in a court of law that Theora was patent unencumbered. Why pay a license fee for MPEG when there’s a free codec that provides just as good quality?

    Which is why you will always hear of these vague claims of "patent pools" and some "major lawsuit" is waiting in the wings, ready to pounce upon Xiph.

    Well they better move fast as a lot of those MPEG-LA patents will be up in a few years.

  47. Anonymous says:

    Ruthsarian, you’re plainly confused. MPEG-LA *is* a patent pool, no "assembly" required.

  48. Anonymous says:

    http://lists.xiph.org/pipermail/theora/2010-April/003769.html

    There you go. Straight from Xiph. The statements from MPEG-LA about all video codecs being patent encumbered are simply not true. It’s just a bunch of FUD to keep big corporations (Hello Microsoft) from finding suitable free alternatives and MPEG-LA losing out on another revenue stream.

    Again. Microsoft, you need to educate yourselves before you make such important changes in what technology you implement. Your rash decisions affect millions of people.

  49. Anonymous says:

    ROFL… yeah, xiph is a credible source. Unfortunately, the legal system isn’t really based on asking the defendent "Did you break the law?" and acquitting them if they say "no."

  50. Anonymous says:

    I agree with Ruthsarian; it’s just not a fair race. Free stuff starts off with so many walls dressed up.

  51. Anonymous says:

    The same FUD being spread about Theora is almost identical to the FUD that was spread about Linux. "We are analyzing our legal options. Linux obviously infringes on patents. We’re going to do stuff to people who use it."

    If Apple, Microsoft et. al. are so certain that Theora is breaking patents, then show your cards. Otherwise, don’t try to pretend that implementing H.264 over Theora is anything other than a money grab by the usual gang of monopolists.

  52. Anonymous says:

    "This post does not make it clear why VC-1 was not added as well."

    VC-1, despite its origins, is a codec also governed by the MPEG-LA. Its licensing is pretty much identical to that of H.264, so supporting VC-1 in IE9 doesn’t really buy anybody anything. Microsoft also (ironically) pays MPEG-LA for the right to include VC-1 support in Windows.

    "MY WEBWARE SHOULD WORK THE SAME ACROSS ALL BROWSERS THAT ADHERE TO STANDARDS"

    Then you should lobby W3C to actually explicitly add Ogg Vorbis/Theora support to HTML5 as it’s currently not a part of the standard. Why get mad at Microsoft for not implementing something that’s not a part of the standard? Microsoft is 100% following the HTML5 spec.

    "it shows MSIE unwillingness to cooperate with open standards"

    Which open standards? Ogg? Theora? These formats and codecs are open SOURCE, but they’re not standards. In order for something to be considered a standard it must be ratified by an industry group or standards committee like SMPTE or ISO.

  53. Anonymous says:

    As a web developer who watched Real destroy their market lock through greed, it is disappointing to see patent trolls continue to hobble innovation in web technology.

    Dean, the moment you make the statement that you’re an engineer, not a lawyer, your blog post becomes irrelevant. Any argument about the performance or legality of one codec against others must be backed with evidence, and Microsoft’s track record on supposed IP violations in Linux makes it virtually impossible to take statements of this ilk as anything other than FUD. If you plan to speak for your corporation, understand that you have debts to pay.

    FWIW I think HTML5 is for the most part a terrible idea. On the surface it comes across as a convenience for developers, but in practice it cannot be implemented fully by a browser vendor without licensing; I suspect it won’t be long before the geolocation feature is hit by a submarine patent. To an end user, this smacks of oligopolistic practices which have no place in a document renderer. You’d be entitled to call this comment paranoia, but remember your employer had to settle out of court with Eolas and will probably have to do the same with i4i.

  54. Anonymous says:

    Quote:

    "For web browsers, developers can continue to offer plug-ins (using NPAPI or ActiveX; they are effectively equivalent in this scenario) so that webpages can play video using these codecs on Windows."

    What does this mean? Does it mean that someone can make a plugin which allow the video tag to play any kind of Video which the plugin can decode? Or will we again end up with a situation where we have to make special html to explorer 9, to trigger the correct plugin even if the user have it installed?

  55. Anonymous says:

    EXPLOITATION. IE is and has always been exploitation of the web for none but Microsoft’s gain. This is not changing. The more I see things like this in IE, the less I see progress, because with every one step forward, there are two steps back.

    There’s a reason that everybody else (Except Apple) supports Ogg Theora/Vorbis for the video tag. Mozilla supports it because it’s patent free. Mozilla can’t afford to license H.264. Opera refuses to pay a license for H.264. Google supports it because they "aren’t evil". Microsoft doesn’t support it and Apple doesn’t support it. WHY? Because they are members of the H.264 patent pool. They have royalties to gain.

    This is completely inexcusable. Without actual standards, the web is fragmented. With only support of H.264, when the HTML5 video tag reaches primetime, IE 9 becomes another IE 6.

    Microsoft, quit the browser market, or actually work with an existing rendering engine. Obviously there isn’t enough competence at Microsoft to realize that an open web is more important than lock-in or profit.

  56. Anonymous says:

    andrew it’s soooo cute that you think Dean will actually ever read these comments!

    martin a plugin to render other codecs would require special html (an object tag) like Flash does in order to be invoked. they’re explicitly not making the codec in the video tag itself pluggable.

  57. Anonymous says:

    tim: I think you need to understand what a "corporation" is legally required to do

    (answer: generate profit for shareholders).

  58. Anonymous says:

    The following statement is instructive:

    …"H.264 minimizes uncertainty for consumers and developers."

    IOW:  The reason to choose H.264 in IE, exclusive to truly free codecs, is pure and simple FUD.

    This is why IE is loosing market share hand over fist versus others.  MS is not listening to their technical base that wants free and open standards, and we are choosing to not take what is being force-fed to us any more.

    If you do not support Ogg/Theora — you loose, because we just say, "Oh, so, you can’t play our movie??? — Hmm, well, here… here’s a better, faster, more secure alternative browser for you.  It’s crunchy, you’ll love it!"  — and, they will.

  59. Anonymous says:

    As long as you can still download Firefox and Linux .iso, IE 9 looks like a fully functional release to me…

    Oh, and why bother writing blog entries about H264.  The reason that you don’t support Theora is not technical or Legal – it’s because you haven’t been kicked in the arse by the EU and US Anti-trust regulators enough 🙂

  60. Anonymous says:

    Microsoft are yet to present any form of web browser to the public which follows any single w3c specification correctly.

    Achieve that first and then try to support draft specifications.

    Users are already voting with their feet on IE and it’s time Microsoft had a serious re-think about the browser because by the time html 5 is final, IE will be irrelevant as a direct result of not supporting web standards correctly.

    Now that Microsoft’s position is clear and IE’s market share is rapidly falling, developers can start to exclude IE from accessing content it is incapable of supporting.

    Internet explorer needs the web. The web does not need Internet explorer.

    There is a very deep hatred for IE amongst the professional web development community and developers are now so sick of needing to price support for IE separately, that many developers have started to add features turned off or missing when IE is used to visit the site.

    Microsoft needs to try to win back the trust of web developers by supporting standards correctly.

    This announcement goes nowhere towards doing so.

    Way to go to provide your customers with a slow, irrelevant and featureless web experience.

    Not a single usable version of Internet explorer released to date and yet still no lessons learned.

    Every other browser software distributor tries to provide as much choice as they can for their users, while Microsoft is insistent on focusing on what choices it’s users and developers should not have.

    Wake up and start putting your customers first.

    The web is about standards and choice. Not about what your abysmal web browsing software will not do.

  61. Anonymous says:

    There are perfectly good reasons to support h264 for Microsoft – you have all the patent mess sorted out, you have wested interest in media-serving space to continue to be locked down.

    But that does not make you a good player in web space. For your strategic purposes of trying to keep barrier to entry for free software high, you are spreading Fear, Uncertainty and Doubt about Theora and OGG.

    Either you know about possible exact patents that are being violated and in this case as a good player in web space you would need to disclose them, or you are on the other side helping to gather them and being quiet because of that (in which case you are a hypocrite).

    Now there is the third option too. You neither know about patents Theora might violate neither are you trying to find them. I find that third option the most believable – You are basing decisions on your strategic interests and not on technical or legal merits.

    How many lawsuits are there about Theora? Zero. Until any of them materialize, the talk about uncertainty is FUD. A well known tactics that should stop.

    If this is engineering blog, act like engineers,  put out a concrete data about what you know about Theora. Give us the facts, not FUD.

  62. Anonymous says:

    Why dont you do what micrsosoft allways does best. Give the community an api that we can use to add theora  to ie 9 html 5 video tag. Then we could choice of a free webformat or a more closed one. The security issue could always be solved in one way or another ( by digitally signing or only allow codec download from certain vendor site).

    Best Regards Anders

  63. Anonymous says:

    If Microsoft implemented OGG and then got sued would you foot the legal bills? Would you hire the people who got fired or had their careers ended for making that decision.

    Of course there are no lawsuits against ogg…The guys with deep pockets don’t use it. If there are patents that can be used against it then they won’t be shown until there is someone with deep pockets shipping ogg. The patent guys don’t care about preventing you from watching videos, they care about taking money from Apple.

    Working for a large technology company (not Microsoft or Apple) I can tell you that many decisions are made about technology on a legal basis for legal certainty. No one with hundreds of millions to lose really wants to see if ogg is unencumbered.

  64. Anonymous says:

    Seriously, you’ll point to blog comments made *within the same week* you made your post to back up your argument about rights issues?

  65. Anonymous says:

    You talk about "certainty and predictability", from my point of view as a developer, that would be if each browser uses the same codec. Right now Apple and Microsoft chose H.264, but I’m not sure if Google, Opera and Mozilla will do the same. If they don’t, then there is no "certainty and predictability", because then we have to encode in multiple formats to support each browser.

    I’m ok with H.264, whatever works you know, it’s just that I’m disappointed that in of you (all browser-vendors) for not being able to agree on one standard.

  66. Anonymous says:

    @Will

    Why should anybody believe what you say?

    Now I’ll explain to you the term "monopoly". Monopoly is when one company or conglomerate controls one particular market by having their product being the predominant one.

    Monopolies happen, luckily H.264 is not (yet) a monopoly in Browsers, however it pretty much is the predominant product in the recording/editing/distribution sector.

    Now I’ll explain to you anti trust. This happens when a company that does have a Monopoly (like MPEG-LA already has it on recording/editing/distribution for for video codecs) missuses their strong position to shut out competition of that market.

    You might ask, well, what’s bad about a market without competition, and I leave that to you as an enlightening exercise (hint, you may use wikipedia).

  67. Anonymous says:

    Are you really explaining to us that choosing the exact opposite as what the other big web browser (firefox) already does is a good choice for web developers ???

    No web developer is stupid: the html5/video tag is doomed, the install base of flash will never be beaten without ie and firefox implementing the same codec, so we are stuck with flash as the only cross browser video player (if mobile phone are ignored as their screen size require a separate encoding anyway).

  68. Anonymous says:

    @Leo (not Davidson)

    >Members of the working group really need to stop

    >making statements and using language that is

    >clearly chosen in an attempt to influence a draft

    >specification that is still years from candidacy.

    That’s all a part of being in the working group. You get to influence the specification. The working group is not just some magic impartial council that carves standards into stone tablets without regard for what its members want.

    Microsoft, along with the other members, is invited to comment on how the standards should be molded.

  69. Anonymous says:

    @Ruthsarian: You are out of date with your claim that H.264 fees could start as soon as January 2011. Earlier this year MPEG LA announced that there will be no royalties on internet video that is fre to end-users until Jan 1st 2016, and this post by Microsoft suggests that it may well continue past that date too.

    For the first time in my life I feel sorry for Microsoft.

    The voice that seems to be largely missing from these debates is that of all the different companies that provide video services on the web.

  70. Anonymous says:

    Serious question: what would Microsoft do if Google decided to encode all YouTube video in a different codec (not H.264)?

  71. Anonymous says:

    I’m disappointed that Theora will not be implemented in IE9. This seems like a step backwards. Once we hit year 2014 a lot a bloggers and sites will not be able to finance the large royalty fees set out by the MPEG-LA.

    The optimal solution would be to support Theora and H264. At least this would allow everyone to use HTML5 video.

  72. Anonymous says:

    @ Aaron: Its not 2014, its 2016, and even then they may not start charing. Do you really think they would try to charge people who cant afford to pay? Generally people only come after their slice of the pie if there is actually a pie worth sharing there. Where video is not monetized I very much doubt they will bother.

  73. Anonymous says:

    A lot of people are glossing over what might end being more important: The lack of a Canvas tag in MS’ IE9 Implementation.

  74. Anonymous says:

    Theora is better because it’s open. EOD

  75. Anonymous says:

    Audio – obviously going to be AAC (AAC and h.264 go together in the .mp4 container)

    h.264 – clear on legal end (and MS is already paying for it, why not use it?), excellent compression/quality, hardware acceleration, large mobile device support, large support in terms of software editors/encoders/players, large supply in content

    VC-1 – similar/same as h.264, except not quite as much much mobile device support and very little supply in content

    ogg – somewhat murky legal end (some person who helped develop could jump in with claims and cause a mess), compression not as good as h.264, little to no hardware acceleration, very little mobile device support, smaller support in software/encoders, very little content uses it

    This could all change in the FUTURE, but this is how things are NOW

  76. Anonymous says:

    @ravewulf: As mentioned previously, IE9’s AUDIO element will support MP3 and AAC.

  77. Anonymous says:

    @Mike I doubt Google will go with something that doesn’t have broad support. They want as many people as possible to be able to use their products, regardless of browser or OS. As W3C adds more codecs in the future, browsers and content will adapt to it.

    @EricLaw [MSFT] Thanks for clarifying (I hadn’t checked, just went with what most use with h.264 video) 🙂

  78. Anonymous says:

    @ravewulf: Regarding theora murky legals, I dont think it even needs to be someone who helped develop it, its about patents that cover any of the concepts used to make the compression & format work.

    For there to be a totally safe codec from a legal point of view, someone would need to come up with a method of compression that was completely new, not covered by any of the existing patents out there, then they would need to be recognised as the owner of this intellectual property, and then declare that they were giving it to the world for free forever.

    Either that or wait for all the existing aptents that cover things like H.264 to expire, which will be a very long time away.

  79. Anonymous says:

    @ravewulf

    "ogg – somewhat murky legal end (some person who helped develop could jump in with claims and cause a mess)"

    It’s sad that people have to resort to lies. But shows also fear. The question then is why? Why does this CODEC (ogg theora) that according to them is so bad, has so much legal uncertainty, has so little support causes them so much fear that they have to lie to justify their words and actions?

  80. Anonymous says:

    @Jack If you want to believe that legal uncertainty surrounding Theora does not exist then thats your choice, but please dont call people liars on this issue unless you would like to personally cover us all for any legal hassles if it does turn out that any of theoras methods are covered by someone elses patent.

    It may well be true that there are other reasons why some would be interested in spreading FUD about Theora, but that does not mean that patent woes for Theora are impossible. I have a feeling we will find out before too long.

  81. Anonymous says:

    1) Microsoft takes their legal decisions based on news sources without credibility.

    2) Microsoft uses insinuations and innuendos but not facts to exclude other CODECs

    3) Their decision is not based on monetary reasons because they don’t receive enough money from the MPEG Cartel

    4) Non-commercial use is useless for the web. Most of the web runs on advertising, this excludes 99% of the people that wants to put video on the web

    6) Most of the hardware and software sold in prosumer market don’t include an H264 license to allow commercial use anyway!

    5) This puts newcomers, startups and small business at great financial disadvantage

    6) The standards for the web have always been royalty-free! Video should too!

    7) It’s that the MPEG and their members, including Microsoft and Apple, want to eliminate competition at any cost and impose a extortion scheme

    8) Lack of competition will be bad for consumers and bad for technological innovation!

    9) Microsoft’s hypocrisy is immense: at the time of OOXML standardization Microsoft claimed that having more than ONE file format was good for consumers. Now that’s no longer the case.

    10) It’s just another step to the end of a FREE and OPEN internet. Big corporations will always subvert these organizations. Microsoft, Apple, Google, Nokia…

  82. Anonymous says:

    @Steve Watkins

    "If you want to believe that legal uncertainty surrounding Theora does not exist then thats your choice, but please dont call people liars on this issue unless you would like to personally cover us all for any legal hassles if it does turn out that any of theoras methods are covered by someone elses patent."

    You’re seeing things upside down! It’s you that have to provide PROOF that Theora infringes. Until then I will do the right thing. Call liars LIARS!

    If people fear patent suits for using Theora, then they will also fear patents suits for using H264. Both are the same position.

  83. Anonymous says:

    @EricLaw [MSFT]

    Why not support the Vorbis format with <audio> tag? Nobody has been arguing against it, it just seems to get lost in the hubbub about Theora and <video>… And Microsoft ALREADY USES Vorbis in the Xbox consoles, so they obviously feel it a good codec.

    As for <video>, supposedly, Dirac is going to be VC-2. It’s not confirmed, but we’ll see. As for H.264, nobody seems to notice that the "free" license for H.264 and AAC only apply if you are making ZERO revenue. This means, no advertisements, no "donations", no monetary "subscriptions", etc.

    Because of this, it is legally infeasible to use H.264/AAC for most sites aiming to use <video> that don’t already pay for the H.264/AAC license. Rather, I’d use either Dirac/FLAC, Dirac/Vorbis, Theora/FLAC, or Theora/Vorbis. Most likely Theora/Vorbis since that has the most support in the HTML 5 browser space, with Chrome, Firefox, and Opera supporting it.

    I realize that Theora is terrible for HD quality video, which I believe Dirac excels at. So technically both bases should be covered. I’m also aware that Firefox’s HTML5 backend does include support code for Dirac, it just is disabled currently.

    Obviously, Chrome’s HTML5 backend supports it, since it uses ffmpeg, which supports a smörgåsbord of codecs.

    Opera can have Dirac plugged into it since it uses GStreamer for its HTML 5 engine.

    So, Microsoft, when will you be implementing Ogg support for HTML 5? 😉

  84. Anonymous says:

    My vote is for VP8.  Understanding that this is not yet "open", if it is opened, it would seem to make a lot of lives easier and just make sense.  I wish MS would consider this option but I’m not optimistic.

  85. Anonymous says:

    A free and open format (that doesn’t require you to pay a license fee for development) would be far better than H.264. Ogg is a very good option that is well supported in many modern operating systems.

    This is a real chance for MSFT to show they do want to participate, instead of EEE.

  86. Anonymous says:

    When Microsoft if making a decision, they should stand on a Microsoft side.

    From Microsoft point of view, whenever they add a codec into IE, it will aldo be included in Windows. Microsoft must be made sure that they do not need to pay layalty later on for the codec.

    Otherwise, considering the number of Windows/IE copy on the market, it will be very difficult for Microsoft to manage.

    This is also the reason that Microsoft did not include Codec for DVD play in Windows XP.

  87. Anonymous says:

    JoeJaz, any announcement from Google that they’re making VP8 "open" is worthless *unless* they provide developers who implement it a warranty of indemnification (as Microsoft does for their major products) saying that Google’s legal team will defend implementors from lawsuits, and Google’s assets will be at risk, not the implementors. It would be a huge win for the internet, but I’m not holding my breath. Instead, expect to see Google make a meaningless announcement that gets lots of press but ultimately means little.

  88. Anonymous says:

    Hey Microsoft, are you so proud that you can’t even be bothered to mention Vorbis or Theora by name?

  89. Anonymous says:

    To the people who are suggesting all the obscure formats, VC-1, Dirac, VP8, Ogg etc etc:

    H.264 can be decoded in hardware by most portable devices, including the Zune, iPod and many (most) video-capable cellphones. The future is mobile.

  90. Anonymous says:

    @Paul Eccles

    Those formats are not obscure. Ogg Vorbis, for example is used in games quite a lot. VC-1 is used in Blu-ray Discs. (I’ll give you Dirac).

    There is no logical reason to artificially limit IE9.

    Microsoft may as well go back to IE6.

  91. Anonymous says:

    "# re: Follow Up on HTML5 Video in IE9

    Monday, May 03, 2010 8:10 AM by Jones111

    Steve Jobs mailed:

    "A patent pool is being assembled to go after Theora and other "open source" codecs now."

    http://hugoroy.eu/jobs-os.php&quot;

    Interestingly enough, the patent troll/pool Jobs was talking about has just filed… against Apple! Not Ogg (Which Mozilla, Google and Opera all contain.) H.264 appears to be risky.

    Looks like no codec is safe.

  92. Anonymous says:

    Matt:

    Microsoft provides indemnification for h.264? Or does MPEG-LA?

    Neither does? I thought so.

    They can’t indemnify against patents, just like Xiph.org or Google can’t: If the patent holder denies a license, that’s their right. And with patents there’s no need to be "reasonable and non-discrimatory".

    If in 2 weeks ACME Corp. comes up with a patent that h.264 necessarily infringes on and doesn’t want to license it to Microsoft at all, IE9 will ship without h.264.

    And there’s nothing that MPEG-LA or Microsoft could do about it.

    For real-world examples of this, look at any tech trade fair: Devices are taken from display by customs because of MP3, not for Vorbis. It doesn’t matter if those devices and their vendors have proper licensing with Thomson/mp3licensing.com: Sisvel prefers to stay independent with their patent.

    How is h.264 safer from that than any other codec?

  93. Anonymous says:

    @Paul Eccles:

    "H.264 can be decoded in hardware"

    Nice try, still wrong: H.264 can be decoded by codec functions in hardware that are driven by firmware.

    h.264 is too complex to be handled in hardware completely. The accelerated functions will be generic enough to be adaptable to other codecs as well, and those codec functions usually support other codecs besides h.264, such as VC-1, MPEG-4, RealVideo.

    Support for Theora would be a matter of a firmware update.

    Also, those h.264 decoders usually only provide baseline support. To be able to decode more advanced h.264 profiles, the devices have to fall back to software-only again, until the firmware is similarily enhanced.

    When comparing h.264 with Theora for mobile devices with similarily optimized codecs, h.264 will suffer from its higher decoder complexity (yay for committee based designs that needlessly bloat the feature set), so should Theora take off and be supported by the firmware, it will actually be a better choice.

  94. Anonymous says:

    What this article says: "We’re considering the VIDEO tag to mean ONLY H.264"

    You might as well come out and implement a <H264> tag yourself. I mean, why listen to other people?

  95. Anonymous says:

    What if <IMG> only supported JPEG? Can you see the issues that might arise from that?

  96. Anonymous says:

    This was posted earlier in this thread, but it deserves repeating:

    http://lists.xiph.org/pipermail/theora/2010-April/003769.html

    Video codecs are NOT any more of a patent minefield than any other area of software development, it is just that codecs produced through industry groups like MPEG-LA are overly encumbered with trivial patents due to the distorted fashion in which they are produced.

    Do you see Microsoft refusing to implement SVG because of a ‘submarine patent risk’? Or Canvas? Or CSS3? No, but implementing these is no less or more risky than implementing a royalty-free video codec such as Ogg Theora. The difference is that Microsoft is invested in the MPEG standards group and while it may not currently profit from the patents it holds for H.264, it still helps to prevent competition from non-members, as they have to pay royalties and cannot cross-licence patents like the members can.

  97. motercalo1 says:

    I think it’s gonna really be great.

  98. Anonymous says:

    The IEBlog is pretty boring these days. Microsoft announces what they’re going to do. Most developers and users read it and think "oh, that’s interesting" and move on with their day. And then the trolls and zealots appear and fill the comments with the usual load of FUD and spam, none of which will make any difference at all. Rinse. Repeat. It’s all so boring. I wish that MS would get back to talking about technical things so that the trolls and crazies get bored and go away.

  99. Anonymous says:

    @Bored:  You’re so boring… 😛

  100. Anonymous says:

    This fiasco reminds me of the bad old days of Embrace, Extend, Extinguish. As usual, IE is the last browser to implement the HTML5 standard, and as usual, they’re looking to kill open standards in the process.

    There’s nothing open or free about H.264. It’s a patent-encumbered format, with Microsoft holding the lionshare of the patents in the H.264 pool. By *only* supporting this anti-standard, Microsoft is intentionally trying to swing its patent weight around and distinguish competition from open source browsers like Firefox.

    Shame on Microsoft. H.264 is anti-open, anti-free, and anti-competitive. It has no place on the web and Microsoft knows it.

  101. Anonymous says:

    @PG:

    "h.264 is too complex to be handled in hardware completely."

    That’s incorrect. Video cards which support DXVA decoding for H.264 (that’s most Nvidia and AMD cards) support full GPU decoding of the compressed bitstream. It’s called Profile D or VLD Profile, look it up: http://download.microsoft.com/download/5/f/c/5fc4ec5c-bd8c-4624-8034-319c1bab7671/DXVA_H264.pdf

    The codecs currently supporting DXVA decoding in Windows are MPEG-2, H.264 and VC-1. The support is a combination of decoder hooks, driver APIs and GPU hardware support.

  102. Anonymous says:

    Here’s a suggestion:

    Anybody referring to Ogg as a "codec" should henceforth have their comments and opinions entirely disregarded. If you don’t know the difference between a file format and a codec, you’re probably not qualified to contribute to this discussion so please stop trolling.

  103. Anonymous says:

    Okay, let’s say Microsoft implements Theora and Vorbis support, then it becomes clear that one of these or both codecs infringe patents in the MPEG-LA patent pools: Would it matter for Microsoft? I don’t think so, because MS has these patents already licensed, unlike Mozilla. So the only risk for MS would be if Theora or Vorbis infringe a patent MS has not licensed, wouldn’t it?

  104. Anonymous says:

    Microsoft is listening. Excellent steps.  

  105. Anonymous says:

    « When there’s industry consensus and confidence that the uncertainties are resolved, we’ll be open to considering other codecs. »

    So we have to await the final battle against Theora/Vorbis?

    Is this what Steve Jobs was talking about in his email?

  106. Anonymous says:

    I was pleased to note that this blog entry links to a Wikipedia article. It serves to underscore the relevance and value that Wikipedia has for a great many people. It is, therefore, extremely disheartening to know that Internet Explorer 9 will be incapable of native support for all of Wikipedia’s content.

    Mozilla, Opera Software and Google support both Ogg Theora and Ogg Vorbis in their browser software. Activision Blizzard uses Ogg Vorbis audio in World of Warcraft. Bungie’s Halo, published by Microsoft Game Studios, uses Ogg Vorbis audio on Windows and OS X. It is clear that in these cases the risk of using open media formats was found to be acceptable.

    Internet Explorer 9 has the opportunity to make a significant contribution to the open web through the support of open media formats. I encourage Microsoft to take that opportunity.

  107. Anonymous says:

    I am estatic that Microsoft is adopting HTML5 and h.264. This is truly great news for consumers! The move to open standards is much appeciated.

    My only requests are that you provide a version of ie9 with no activex support compiled in to improve security  and that you fully support HTML5’s canvas feature.

  108. Anonymous says:

    @IEteam, i would like to ask something to you, guys, this has been said lot of times here, but i would like to put again on the table this issue:

    Please *consider* the possibility of a radical migration of IE engine.  Choose Webkit, choose Gecko , what you like, but please do something to boost standards support in the *short* term.

    Google did it ( Chrome Frame ), why don’t you?

    I.e:

    "Virtually all of Chrome’s April expansion came at the expense of Microsoft Corp.’s Internet Explorer, which dropped 0.7 percentage points to finish the month at 59.95%, the first time that IE has fallen under the 60% mark." (*)

    Thanks for listening.

    (*) http://www.computerworld.com/s/article/9176240/Chrome_again_beats_Firefox_in_browser_gain_race  

    (retrieved 2010/05/03 )

  109. Anonymous says:

    A wise decision. This will have the effect of further marginalizing Internet Explorer, and give you guys more of an opportunity to finally lay this beast to rest. I also recommend supporting only AAC audio, and only the WMV container, and possibly finding other ways to shoot yourselves in the foot with views that are polar opposite to Mozilla and just as extremist.

  110. Anonymous says:

    ombarg sez "Six out of ten browser users use IE. You’re clearly not successful since you’ve only got 50% more marketshare than all of your competitors combined (including those that run on platforms you don’t). So you should adopt the rendering engine used by your weaker competitors."

    Errr. yeah. That makes sense.

  111. Anonymous says:

    "And really, now that we see multiple large companies with experienced legal teams and non-trivial exposure committed to shipping Theora I think we’re kidding ourselves when we attempt to analyze this as a legal issue. It’s not. It’s a business/political decision. The market is now going to battle it out.  Enjoy the show."

    http://lists.whatwg.org/pipermail/whatwg-whatwg.org/2009-May/020015.html

  112. Anonymous says:

    Well this makes it easy then: we can just encode all our videos in Ogg Theora, and blame Microsoft (as always) whey they don’t work in IE. Nobody would be surprised: IE hasn’t supported anything resembling an up-to-date standard in years, so why would anyone expect IE9 to? (Note: I’m not saying Ogg Theora is more modern or up-to-date than H.264, just that not many would be surprised if IE didn’t support something most other browsers do.)

  113. Anonymous says:

    I don’t see how the choice of H.264 would be anticompetitive against Mozilla, as someone claimed. According to the post:

    "Third-party applications that simply make calls to the H.264 code in Windows (and which do not incorporate any H.264 code directly) are covered by Microsoft’s license of H.264"

    so there is no reason why Firefox would have to pay to implement H.264 on Windows (which is the only platform where IE competes against it).

    As for the whole patents/fees issue: discussing what might happen in 5+ years in this industry is bound to be inaccurate and/or irrelevant. For the time being, H.264 seems the most reasonable choice. And if it turned out to be wrong, there is plenty of time to fix it.

  114. Anonymous says:

    Mac: You should read the discussion in https://bugzilla.mozilla.org/show_bug.cgi?id=435339

  115. Anonymous says:

    I also can’t wait for IE9, and think you guys are doing great things! As a Web Developer I’ve backed IE since version 4 (however in fairness I was absent for IE6 fiasco).

    What gets me is that Apple is basically saying the same thing about H.264 but I’ll bet no one is sending them nasty comments… oh yeah that’s right you can’t leave comments (Not that they would be bothered to read them anyway, apple’s far too busy prosecuting its consumers these days) And with all the I-products backing it I would go with h.264 too. Though I would personally like to see the clout those products cary deminish.

    I would like to request that IE9 be made a mandatory update for windows

    I would also like to see IE add the ability to provide Windows IE9 feature updates for things like this. If (for example) some new technology came out that replaced h.264, you’d be able to impliment an update changing IE9’s support. I think the ability to add new features as they come along, instead of having to wait 2 version later would have a drastic impact on IE’s market share. Just a thought.

    Keep up the good work!

  116. Anonymous says:

    I applaud Microsoft for following the ISO standard for consumer audio video.

    H.264 is the successor to the DVD. When you argue against H.264, that is like arguing against the DVD. Both DVD and H.264 enable consumers to choose any device from any manufacturer and still see video content. It enables publishers to publish one video product and be playable on any device from any manufacturer. This is good for everybody involved.

    There is no need to support any codec other than H.264 in the video tag. If you’re not using ISO standard video, you don’t need W3C standard markup. If you are going to be nonstandard, you are choosing to be seen by just a small fraction of the Web. In that case, you might as well use a plug-in.

  117. Anonymous says:

    Seriously. Can supporting both codecs (H.264 *and* Ogg Theora.. is "Ogg Theora" in MS’s list of banned words on blogs or something? Not mentioned once by name!)  really be that horrible of a nightmare? Sounds like they’re playing their same old game. Ho, hum.

  118. Anonymous says:

    @Jordan: Perhaps they are not as short sided as you? There are more codecs than h.264 and Theora. Do they need to list every single codec that exists each post make the whiners happy? What they are are talking about applies not only to Theora but to VP8 (which is even listed in the title of one of their links) and others.

  119. Anonymous says:

    I don’t see why Microsoft should follow through MPEGLA’s lead.

    Clearly, Microsoft hasn’t learnt a lesson after the MP3 licensing ambush.

  120. Anonymous says:

    I understand and agree with Microsoft’s arguments that H.264 is a great codec and that its legal story is more predictable than that of other codecs.

    However, I also understand the arguments of others who worry mostly about the fact that they may eventually be required to pay royalties for H.264.

    How about going one step further, Microsoft? Use your leverage as a leading software company and the fact that you are one of the licensors of MPEG LA to lead an effort that attempts to make MPEG’s H.264 baseline profile royalty-free, similar to what JPEG did with its own baseline profile. Notice that this would need to be done only to the baseline profile, and more advanced profiles could continue to be royalty-bearing. This way, we can have the best of both worlds, and other browser makers would have no reasons not to support H.264.

  121. Anonymous says:

    Dean, you say "Third-party applications that simply make calls to the H.264 code in Windows (and which do not incorporate any H.264 code directly) are covered by Microsoft’s license of H.264." … and then "As with all licensing programs, there are limitations and issues, which people have pointed out."

    This is quite subtle. So all third party apps are "covered" in the sense that Microsoft’s license applies to them, but they must still respect the limits of that license, right? In particular, third party apps that wish to use the codec for "commercial use" (whatever that is; a lot of developers will need lawyers, I guess) are actually not "covered" in the normal sense of the word.

    In light of that, I still think your declaration that "Third-party applications that simply make calls to the H.264 code in Windows … are covered by Microsoft’s license of H.264" is potentially very misleading. A large number of apps that do just that could find themselves paying royalties or on the receiving end of a lawsuit from the MPEG-LA.

  122. Anonymous says:

    Ogg Theora was the *original* recommendation for the <video> tag… but then Microsoft decided to use H.264.

    Why!? Do web developers now have to provide two versions of every video, one for IE and one for other browsers? Is this not what happened with stylesheets, and Microsoft’s hasLayout "feature"?

    I originally had high hopes for IE9, but I am very disappointed. Thanks a lot Microsoft.

  123. Anonymous says:

    <blockquote>MPEG-LA could solve the trust issue by legally promising to continue to only charge reasonable prices for reasonable things forever, instead of only for a few years.</blockquote>

    MPEG-LA does not determine the licenses. That is up to the licensees. And those have already committed to charge reasonable prices as participant in the standardization proces of h.264 or as a participant of the blu ray association. Also the patent pool will get smaller over the next 5 years as some patent overrun the 20 years making the share for other patent holder bigger even without a price rise.

    So your suggested doom scenario of a steep price rise is not on the cards. The parties involved in the patent pool have every reason to keep prices reasonable.

  124. Anonymous says:

    I’m confused about these points:

    "For web browsers, developers can continue to offer plug-ins (using NPAPI or ActiveX; they are effectively equivalent in this scenario) so that webpages can play video using these codecs on Windows. For example, webpages will still be able to play VC-1 (Microsoft WMV) files in IE9."

    1) You say that developers can offer plug-ins using NPAPI, but your hyperlink for NPAPI goes to a Wikipedia article that states that IE no longer supports NPAPI plug-ins!

    2) Does this mean that a plug-in will be required in order to play VC-1?  Will the plug-in be provided with IE and installed by default, or will it be a separate download?

  125. Anonymous says:

    @Alex: "GPU hardware support."

    What does this GPU hardware support consist of? Most likely (from looking at implementations of the codec acceleration with GPUs on other platforms) by pushing some shader _program_ into the GPU.

    So while this program is designed for the special purpose features of a GPU, these features are still relatively generic.

    Case in point: AMD released a new video driver that provides support for additional h.264 profiles for some of their chips. Were GPU video decoding "entirely in hardware", this wouldn’t be possible.

    So yes, this is software, Theora support can be added (on the OMAP platform they do this already), and Theora on GPU will likely require less resources than h.264 on GPU.

  126. Anonymous says:

    Can we get any comment on why Microsoft don’t allow 3 party components/developers to add support for additional codecs in the video tag?

    And on an additional note: Why don’t you re-use the existing Windows (player) codec system. That would make the entire problem go away, because then users could play $FORMAT video if they had the codec installed. (And there is already codec support for Theora).

    And on an additional note: What about audio support? (Both in the video itself, and the <audio> tag?

  127. Leo Davidson says:

    @hAl, come on, let’s not have a stupid argument of semantics. Pretend I said "the members of MPEG-LA" rather than "MPEG-LA" if you must.

    If you are so certain that all members have all agreed to be reasonable until all their patents expire, where is that in writing, please?

    If they are all really going to do that and really mean it then it will be no problem for them to make it legally binding, instead of the current vague promises not to charge anyone for certain uses for a few years, after which all bets are off.

    If it is in writing somewhere then my idea was already done before I suggested it and all is well, but AFAIK there is no such legal promise.

  128. Leo Davidson says:

    Switching sides of the debate for a moment, I’d defend Microsoft’s decision not to open up the <video> tag to all codecs installed on people’s machines.

    For whatever reason, video codecs & demuxers tend to be the most bug-ridden, crash-prone, unstable, security-flawed software on the planet.

    (I guess it’s caused by the same phenomenon which makes almost all media playback UIs completely non-standard. 🙂 )

    It gets even worse when you have a soup of different codecs and demuxers on machines (as many people do), as well as so many differnet versions and builds of different codecs/demuxers, etc. There are also added complexities with 64-bit (since the 32- and 64-bit worlds see different codecs).

    If you want to produce a stable, secure and predictable web browser (or video plugin) then you need to have control over the code which deals with video. That doesn’t mean it has to be baked into the browser but it does mean you don’t want to open the browser up to running any old codec/demuxer.

  129. Leo Davidson says:

    Clarification: When I say "have control over the code which deals with video", I don’t mean you must necessarily own that code, but that it must be vetted and whitelisted as "okay".

    Whether that vetting & whitelist process is open to modification by third party developers and/or end users is another discussion.

    The one thing you really, really do not want to do is have web browsers automatically passing untrusted data from the web to the existing video codec free-for-all that makes so many desktop video apps crash today.

  130. Anonymous says:

    @Leo Davidson

    From the MPEG-LA FAQ

    "Q: What is the Term of the AVC Patent Portfolio License?

    A: The initial term runs through December 31, 2010. The License is renewable for successive five year periods for the useful life of any Portfolio patent on reasonable terms and conditions.

    Q: Is there a limitation on the amount that royalty rates may increase at each renewal?

    A: If royalty rates were to increase, they will not increase by more than 10% at each renewal for specific license grants (except Internet Broadcast AVC Video, which is provided for in Section 3.1.5 of the License)."

    So yes, patent licensors in the mepg-la patent pool have committed to reasonable terms and conditions and to limited lisense prices on renewals. The scenarios of steep price rises on renewals are just made up stories by open source fans who feel the need to spread FUD on the h.264 licensing.

    There is no basis to support such stories as that would be against the interests of patent pools which are mainly created to support broad support for a technology with one stop licensing.

  131. Anonymous says:

    To Leo Davidson:

    Really? Is the Windows codec system so bad? But it’s Microsofts own system, so it should be easy to run the decoder in its own process. Then you can simply restart it if it crashes. (Extra bonus if you resume the video where it crashed). But I must admit I have never seen a windows user complain about codecs crashing.

    But even if it is that bad, that’s not an argument because anyone can still make a 3 party codec which decode video in IE9 they just can’t use the video tag to do it. So we once again have to make special html to IE9 -(

    What will most likely happend is that someone make a plugin, which use the windows codecs to decode video, and then we end up with this situation anyway.

  132. Anonymous says:

    Soundtrack for reading these comments: http://www.youtube.com/watch?v=OYws8biwOYc

    People whose major achievement is using Mom’s WiFi are giving advice to an engineering team — I love this country.

  133. ieblog says:

    @Richard: Dean’s point is that ALL browsers support more codecs via plug-ins/addons– in IE, that’s using ActiveX while in other browsers, the mechanism is NPAPI. IE itself doesn’t ship any plugins, but virtually all installs of Windows include Windows Media player, which supports VC-1.

    @Martin: As mentioned a few times, IE9 will support MP3 and AAC for audio.

  134. Anonymous says:

    But the problem with IE9’s codec plugin support, is that it require non standard ie9 only html to use.

    And why no vorbis audio support for <audio>

    Do you fear patents for that too(And if you do, remember to inform Microsofts game section, which does use vorbis).

  135. Leo Davidson says:

    @hAl,

    Thank you for the reply. If that is accurate & binding, and there are no hidden caveats, then it seems reasonable and was (more or less) what I was suggesting.

    @Martin,

    It’s not really the Windows codec system that’s at fault. The problem is that people writing codecs/demuxers tend to do a poor job of checking for unexpected inputs and produce code that crashes (or has security flaws or whatever) when faced with them.

    You can move all your video rendering out-of-process and sandbox it for a bit more security (assuming the codecs are well-written enough to run in the sandbox; and even then sandboxes usually only protect from writes, not reads (data theft)).

    Even then, though, you’d still be asking your users to put up with unpredictable video performance and stability.

    If videos randomly crash or do not work in a web browser then it’s better than taking out the entire web browser — for sure — but it’s not exactly a great user experience.

    We don’t really need a hundred different video codecs anyway. A handful of good codes with known-good quality implementations is much better than a free-for-all.

    I mean, there are a million and one different image formats but the web gets by pretty well with just PNG, JPEG, GIF and SVG.

    I’m not saying there should only be one codec (though it’d be nice if everyone could agree on one which they all support) but there’s no need for ten, either.

  136. Leo Davidson says:

    @hAl, Another thought:

    Given that the rate for non-commercial use is currently 0, according to that FAQ it can never be non-zero. 🙂

  137. Anonymous says:

    [quote]It’s not really the Windows codec system that’s at fault. The problem is that people writing codecs/demuxers tend to do a poor job of checking for unexpected inputs and produce code that crashes (or has security flaws or whatever) when faced with them.[/quote]

    What? If you do the decoding in its own process, that process should not have any read/write access to any other user data.

    And remember the alternative to the possibility of bad codecs are a blank screen, because the browser can’t decode the video at all. I know what i prefer.

    I assume that Microsoft have written their own H.264 windows codec, so we know that just using the codec system will at least work for MPG4.

    So as i see it, the alternatives for non H.264 are between no video, and possible bad video.

    But I really don’t think that there are that many problems with the existing windows codecs.

    And I agree we don’t need support for any insane format(Flv anyone?) but the problem with the current solution is that it’s H.264 only and there is no way for third parties to fix that.

    Using windows codecs would atleast allow users the possibility to view the videos at wikipedia.org and other places which use other formats.

  138. Anonymous says:

    "(except Internet Broadcast AVC Video, which is provided for in Section 3.1.5 of the License).").

    This is the problematic section. So i think they plan to ask money for all H.264 streams 1 jan 2016.

  139. Anonymous says:

    As new media artists and professionals, what we all simply want to ensure is that Apple and Microsoft won’t start using MPEG-LA to sue content “professionals” for adopting the H.264 standard under the guy of HTML5.

    If Microsoft, Apple, including the entire MPEG LA community are willing to waive their royalties rights for the better of the web new media experience, AND guarantee that content producers—including “professionals”—along with viewers, will both, not be harassed or sued, then sure—HTML5.

    However, till then, Adobe Flash video all the way.

  140. Leo Davidson says:

    @Martin,

    "What? If you do the decoding in its own process, that process should not have any read/write access to any other user data."

    Sorry but by saying that you appear to be ignorant of not just how Windows works by how the security model in every desktop OS works. (Including desktop flavours, and most other flavours for that matter, of Linux/Unix.)

    If a process is running under an account then, in general, it has (read, and often write) access to that account’s files.

    You could run it under another account, or even a virtual machine, and marshal all the data back and forth to that account but doing that is easier said than done, both from a software engineering perspective and from a sysadmin perspective. (Even more so when we are talking about third party code where you have no control over its requirements and assumptions.)

    Certainly, and in general, it would be wonderful if code was restricted from "doing things it shouldn’t do," but it would be a full-time job defining (and then vetting) the lists of what each piece of code may do. Instead, at least for now, all desktop OS use accounts (and a few other things like the Low Integrity stuff) which paint with a much broader brush.

    All of which is largely off-topic and beside-the-point anyway. Even if you have perfect sandboxing and security around the code doing the video decoding, if it still crashes then the user still gets annoyed and the people trying to host videos still can’t feel certain that their content will actually work.

    I don’t think anyone really wants anything other than H.264 or Theora (or both), possibly with Google’s On2 codec thrown into the mix if they end up sorting it out. (And chances are if Google do then the Theora advocates will switch to that instead, since it seems to tick all their boxes and then some.)

    Let me stress again that I’m not saying browsers should be completely closed to supporting new codecs in <video> tags; I am just saying that doing it by feeding untrusted data into whatever random codecs happen to be installed is a really, really bad idea.

    I mean, if you advocate doing that then you are advocating a design where web browsers auto-run locally installed code on arbitrary web data. Think about that for a second…

    If you still can’t see what a nightmare that would be, replace the phrase "video codec" with "ActiveX control."

    The two types of components are virtually identical, in terms of how they plug into other apps. You certainly would not want any website you visited to be able to invoke any installed ActiveX DLL with the data/arguments of its choice. Ditto with video codecs.

  141. Anonymous says:

    @martin

    No that is not a problematic section because the licensing fee for Internet Broadcast AVC Video is zero till 2016 and after that will be maximum the fee of free TV broadcasting which is currently 10,000 dollars per broadcaster(site).

    I guess people spreadig the FUD forgot to mention that little detail…

    From the MPEG-LA license summery I have (which is not updated to 2016 yet)

    **********

    "For (b) (2) where remuneration is from other sources, in the case of free television (television broadcasting which is sent by an over-the-air, satellite and/or cable Transmission, and which is not paid for by an End User), the licensee (broadcaster which is identified as providing free television AVC video) may pay (beginning January 1, 2006) according to one of two royalty options: (i) a one-time payment of $2,500 per AVC transmission encoder (applies to each AVC encoder which is used by or on behalf of a Licensee in transmitting AVC video to the End User) or (ii) annual fee per Broadcast Market12 starting at $2,500 per calendar year per Broadcast Markets of at least 100,000 but no more than 499,999 television households, $5,000 per calendar year per Broadcast Market which includes at least 500,000 but no more than 999,999 television households, and $10,000 per calendar year per Broadcast Market which includes 1,000,000 or more television households.13 In the case of Internet broadcast (AVC video that is delivered via the Worldwide Internet to an end user for which the End User does not pay remuneration for the right to receive or view, i.e., neither title-by-title nor subscription), there will be no royalty during the first term of the License (ending December 31, 2010), and after the first term the royalty shall be no more than the economic equivalent of royalties payable during the same time for free television."

  142. Anonymous says:

    In addition to the above license text video broadcast of less that 12 minuten are licensed for free anyways.

    So as I can see it a internet video broadcaster that plays h.264 video longer than 12 minuten and has a marketshare of more than 1 million people (I asume that would be unique visitors to the video) would pay

    – nothing untill 2016 and then a maximum of 10,000 dollars.

    A site with video less than 12 minuten would pay:

    – nothing

    A site with videos that have less than 100,000 visitors would pay:

    – nothing.

  143. Anonymous says:

    And I am inclined to expect that MPEG-LA leaves the fee at nothing even after 2016 anyways as it hardly worth it to collect those fees from the few sites that regularly have long video’s that get more than a million viewers.

    What is at least evident that there is a lot of FUD being spread about the h.264 licensing fees that could have been avoided with some simple surfing tto the MPEG-LA website and doing some minor fact checking.

  144. Anonymous says:

    1 thing that gets me is what about the low powered video proccsors that cant do high qualty flash video properly?

  145. Anonymous says:

    @PG:

    "Theora support can be added (on the OMAP platform they do this already), and Theora on GPU will likely require less resources than h.264 on GPU."

    You’re arguing semantics. When people talk about "hardware accelerated" decoding on PCs, it’s implied that the acceleration is done by the GPU. Whether you call that "software" or "hardware" support, the fact remains that the GPU vendor still needs to implement that support one way or another. Also, the GPU functions that comprise DXVA are only generic to a certain extent: for example, you can’t take an old Nvidia GeForce 4000 series card and make it support H.264 VLD profile decoding. Take a look at http://www.nvidia.com/docs/CP/11036/PureVideo_Product_Comparison.pdf and you’ll notice that not every video card supports every codec for DXVA.

    But more importantly than can Theora support be done, the bigger question is WILL it be done. Please provide me a link to a news source that shows that Nvidia, AMD and Intel have committed to adding Theora DXVA support. Where’s Apple’s API support for Theora decode acceleration?

  146. Anonymous says:

    To all those saying Microsoft is ignoring standards by choosing not to support Theora and Vorbis:

    1. HTML5 specification doesn’t actually require either of those codecs. To be fair, it doesn’t require H.264/AAC support either.

    2. HTML5 specification is still in draft stages which means no browser’s HTML5 implementation is "more" complete than others because the specification isn’t done yet.

    3. Neither Theora nor Vorbis are standards because they haven’t been ratified by any industry or standards organization (such as SMTPE or ISO). Open source != standard

    So to suggest that Microsoft is somehow ignoring web standards for video is completely ridiculous. How can they ignore something that doesn’t even exist?!? One could just as easily make the argument then that Firefox and Chrome are ignoring standards too!

  147. Anonymous says:

    @Charlie:

    Semantics? I talk about the difference between necessarily having to buy a new device for any other codec support, or installing a driver update should that come out. That is, the difference between a possible update and an impossible one.

    The other aspect is that with the GPGPU APIs it should be feasible for third parties to provide GPU-accelerated video decoding. Probably not as efficient as the vendors (that can natively access device functions), but still an improvement. As written, that happens on OMAP.

    Indeed the question is, if it will be done. Simple answer: It will be supported when there’s a business case. Should Theora become common on the Web, it will be supported. Microsoft (and others) seems to be very interested in making sure that this won’t ever happen.

    For "Vorbis and Theora aren’t standards", a standard is a standard once it’s set in stone by _some_ governing body that declares it stable. For Vorbis and Theora, this standard body is Xiph.org – simple as that.

    Following your argument that only SMTPE and ISO are supposed to declare standards, HTML should be universally ignored (That’s W3C, not ISO),SMTP should be ignored (that’s IETF, not ISO).

    ISO gave us (in cooperation with ITU-T) OSI networking. We’re on IP now, surely something must have gone wrong?

    I think I’ll stick to standards that are actually out there (Theora for nearly 6 years by now)

  148. Amtiskaw says:

    @hAl

    The 12 minute limit you mention only applies to video services where the user pays for individual videos, so ad-supported services such as YouTube would not benefit from this.

    Your figures around the royalties for internet broadcasters do not correspond to the language in the summary. You talk about ‘unique viewers’, but the summary makes no mention of actual viewers, only to the size of the ‘Broadcast Markets’ in which people COULD receive the content. This map: http://www.dishuser.org/TVMarkets/ should give you some idea of the number of ‘Broadcast Markets’ in the USA alone. Now, imagine you post a video on the internet, people COULD watch it in every one of those areas (and the rest of the world!), and theoretically the ‘economic equivalent’ royalties promised by the summary could be millions upon millions of dollars.

    Interestingly, the licence summary has a footnote that indicates the royalty equivalence between internet broadcasters and free television is expanded on in section 3.1.5 of the full AVC Patent Portfolio License, but for some reason they don’t actually make the full license available online: http://www.mpegla.com/main/programs/AVC/Pages/Agreement.aspx

    Quite apart from broadcaster royalties, there is also the issues of royalties for distributing decoders. Browser vendors such as Mozilla and Opera would have to pay several million dollars per year to distribute versions of their browsers that included a h.264 decoder, or drop support for HTML5 video. This would be a tremendous strain on their finances, particularly for a non-profit foundation like Mozilla. It would effectively mean only rich companies could make web browsers that could browse the entire web and show HTML5 video.

  149. Anonymous says:

    @PG:

    You’re interpreting my example of ISO and SMPTE literally. I listed them as examples of industry and standards organization, but the list certainly isn’t limited to them. 3GPP, IETF, ITU, DECE… These are all valid examples. But Xiph.org isn’t, I’m sorry to say. Xiph is a non-profit corporation, not a governing body or an organization of industry professionals. If you follow that logic, than RealVideo is also a standard.

    Let’s repeat that again for everyone to hear: Vorbis and Theora are not standards.

  150. Anonymous says:

    <<<Browser vendors such as Mozilla and Opera would have to pay several million dollars per year to distribute versions of their browsers that included a h.264 decoder>>>

    And where exactly did you pull this per-year figure from?

    (FWIW, Mozilla likely spends more per year on Firefox than Microsoft and Apple spend on IE and Safari– they can afford to, because Google plays them almost $100M/year).

  151. Anonymous says:

    @Amtiskaw:

    "Browser vendors such as Mozilla and Opera would have to pay several million dollars per year to distribute versions of their browsers that included a h.264 decoder, or drop support for HTML5 video."

    To be fair, this is not an issue on Windows 7 and Vista because access to the native H.264 decoder is open to any DirectShow or Media Foundation based application. It’s exactly how players such as PowerDVD work, so there’s no reason why Firefox or Chrome couldn’t take advantage of the same decoder.

  152. Anonymous says:

    @Charlie,

    That’s nonsense! They do own the content in an indirect form.

    If an internet broadcaster wishes to sell rights to their content that’s been encoded via h.264 through a professional third party software suite—Adobe Flash, or Final Cut Pro—why should they then need to dish out additional costs to do so, especially since they’ve already paid with the intent to monatize via the price of the third party “professional suite”? That’s usury, not to mention evasive!

    Charlie – also don’t know if you know this, but the majority of individuals who broadcast through the web are not just huge media firms, but average people – YouTube, Vimeo.

    Evermore, with Google’s recent announcement regarding the possbility of users renting out their content — will that mean everyone who’s gone viral, and now wishes to sell access to their YouTube videos using HTML5 will also payout MPEG-LA millions too? That’s absurd!

  153. Anonymous says:

    The security "risks" with downloading codecs is directly related to the way in which Windows Media player works.

    Windows Media Player can prompt a user to download a codec, or a licence for any video and accepting such, opens the whole media player up to scripting access where all kinds of malware comes alive.

    The media player should *never* have allowed browser windows (in particular IE windows when IE wasn’t the default browser (due to already known security issues)) to be popped up.

    Users attempting to download a video for the latest Footy match, not knowing/caring that the video content wasn’t 100% legit would find them self faced with never ending popups for p-o-r-n, e-n-h-a-n-c-e-m-e-n-t drugs, fake-anti-virus software galore.

    Often times the only way to rid oneself of the popups is to CTRL+ALT+DEL and kill WMP.

    I realize the debate over video formats is intense and heated – but we are all very concerned because it is both important, and using *existing* stats to make a long term choice is a massive failure.  SVG never took off with great numbers BECAUSE IE didn’t support it. CSS3 isn’t mainstream yet BECAUSE IE didn’t support any of it (even with vendor prefixes). XHTML didn’t take off BECAUSE IE didn’t support it. HTML5 is slow to take off BECAUSE IE6/IE7 don’t support it, and IE8 only supports some stuff.

    The Browser needs to take an advanced position and support new technologies BEFORE they fully penetrate the market as they DETERMINE where the market goes… and thus when MSFT says that IE9 will ONLY support H.264 natively, MSFT, and IE are in turn FORCING the community to give up supporting other formats.

    Don’t be surprised in the slightest that developers are upset about this – and don’t be surprised when they are vocal about it, or alter their supported browsers in their web apps as a result.

  154. Anonymous says:

    @FactChecker

    I ‘pulled it’ it from the blog of Mike Shaver, chief evangelist for the Mozilla Corporation:

    of http://shaver.off.net/diary/2010/01/23/html5-video-and-codecs/

    To quote:

    "Mozilla has decided differently, in part because there is no apparent means for us to license H.264 under terms that would cover other users of our technology, such as Linux distributors, or people in affiliated projects like Wikimedia or the Participatory Culture Foundation. Even if we were to pay the $5,000,000 annual licensing cost for H.264, and we were to not care about the spectre of license fees for internet distribution of encoded content, or about content and tool creators, downstream projects would be no better off."

  155. Leo Davidson says:

    @Charlie:

    "Let’s repeat that again for everyone to hear: Vorbis and Theora are not standards."

    You say that like you expect it to mean a great deal to people.

    Whatever your definition of "standards," when people say they want "standards support" very few of them care exactly who defined those standards (or file formats or whatever you want to call them).

    What people want is for web browsers (etc.) to implement well-defined specification s(may I use that word?) in ways which are compatible and consistent with other browsers (and other software in general). Clearly the spec has to be a good spec or it won’t be that useful (or it’ll be too difficult to for different teams to implement consistently, a bit like HTML4).

    From what I’ve seen of the Ogg and Vorbis formats (I can’t speak about Theora as I have not written code against it), they are well defined, well documented and well conceived. They have been well maintained over the years, with regard for quality, sensible ideas/changes and backward compatibility. They have several good example implementations and libraries. They have been used in lots of software and hardware projects, including many commercial ones. There are many tools which will input and output data in the Ogg Vorbis format in a consistent way.

    What more do you want from a format before it’s as good as a "standard?"

    If you think there is something specifically wrong with Ogg, Vorbis or Theora then by all means state your objection (like anything else, they are not perfect), but the fact that the body which designed them doesn’t meet your standards* doesn’t seem like a valid objection. Judge the format, not the size of the companies who sat on the committee which rubber-stamped it.

    (* Uh, I mean, "criteria" since you don’t quality as a standards body and thus cannot define a standard, by your own definition. :-))

    There are plenty of other formats which aren’t "standards" by your definition and yet which we all use every day more than happily.

    It’s like insisting on having a THX logo on your audio hardware: It might indicate some level of quality but it doesn’t indicate it absolutely. There are some fairly poor THX-approved sound systems as well as the awesome ones. There are many awesome ones that don’t bother getting THX approval because it costs a lot of money and people who know about audio equipment know that THX is largely meaningless.

    Similarly, some international standards are an absolute crock (like the MS Office XML standards which zero people, including MS themselves, have managed to implement so far) while some international standards are great, and some great formats aren’t "standards," and so on…

  156. Anonymous says:

    @Charlie

    Sure, and I believe they considered doing just that, but decided against it because such a strategy would undermine the cross-platform nature of the Firefox browser, and the web itself.

    As FactChecker pointed out, Mozilla certainly have the cash to license H.264, and probably any other codec they like, but they’re making a stand based on the principles open web. The open web is about more than just following standards, it’s also about open participation. The great strength of the web has always been that anyone can make a website or develop a browser. Adopting H.264 for web video undermines that principle, so Mozilla have taken a stand against it. Not because it’s easier, or because it’s cheaper, but because it’s the right thing to do.

  157. Anonymous says:

    This test in 2010 show that to achieve similar quality a Theora file would have to be twice the size of a h.264 file.

    http://keyj.s2000.ws/?p=356

  158. Anonymous says:

    @hAl

    So given that user bandwidth increases by 50% each year:

    http://www.useit.com/alertbox/980405.html

    We could just stick with Flash for a couple of years then switch to Theora and it would be exactly the same as if we’d switched to H.264 now!

    Problem solved! Everyone meet back in in 2012! 🙂

  159. Anonymous says:

    @Charlie: Did you consider PNG a standard at the time it was implemented by IE 4.0 and 32-bit Netscape 4.04? That was when it was merely described in a RFC, years before being standardised by the ISO.

    @Amtiskaw: The end of 2012 is also when all patents relevant to MP3 decoding should be expired, then Firefox might implement native MP3 support for the audio tag so we have at least some sort of common denominator for native implementations.

  160. Anonymous says:

    <blockquote>We could just stick with Flash for a couple of years then switch to Theora and it would be exactly the same as if we’d switched to H.264 now!</blockquote>

    Unlikely because the amount of video on the internet will also increase and with Theora the increase would be much faster.

    Basically using a mediocre codec like Theora would increase the cost of internet traffic for datacentres, transit and service providers with hunderds of millions of dollars. The prices of internet for consumers and sites would be higher than nescesary.

  161. Anonymous says:

    @Amtiskaw

    In a broadcast the video is send to all people in an area.

    On a site a html video is only send on a pageview to one person.

    So looking at unique visitors to a webpage containing a html video is a good measure for the number of people a video was broadcasted to.

  162. Amtiskaw says:

    @hAl

    That’s certainly a reasonable view, but the point is it’s YOUR opinion, not what’s actually written in the licensing summary. The summary itself is ambiguous. If they’ve nothing to hide, then MPEG-LA should publish exactly how internet broadcasting royalties would be calculated, so we could have a properly informed discussion.

  163. Anonymous says:

    When a company starts choosing to avoid risks and sits on its own success, well I think it’s a sign of decadence.

    I believe a company like Microsoft should look a little bit further and pursue not only its own interests (money) but also oversee -whenever possible- the interests of the entire community.

    Imho copyright as it’s today is only about a way to make money regardles it is right or not.

    Please rethink your decision and add native support for the Ogg Theora technology in IE9.

    Kind regards,

    druss

  164. Anonymous says:

    "When a company starts choosing to avoid risks and sits on its own success, well I think it’s a sign of decadence."

    They’re paying for it as IE’s market share continues it’s inevitable downward slide. I believe we’ve passed MS’ tipping point.

  165. Anonymous says:

    The HTML5 standard doesn’t specify a codec so let the user install whatever DirectShow codec they want to use instead of breaking the spec and stopping non-H.264 codecs from playing.

    Until now Microsoft hasn’t assumed the responsibility for whether or not codecs need a licence in the country that Windows is being used in, they’ve just set up the DirectShow framework and let users install whatever codecs they want, so why should it start now?

    Or would it be something to do with Microsoft using IE as a tool to help cash in in the future on the H.264 patents that they own?

  166. Anonymous says:

    Dan, it’s both foolish and impolite to ask questions when their answers are contained in the original posting.

  167. Anonymous says:

    @Charlie:

    The difference between RealVideo and Theora is that there’s a specification (versioned, stable for 6 years, open to implement for third parties) for Theora. There isn’t such a thing for RealVideo.

    Were Real to release a specification with such characteristics, RealVideo would be standardized, yes.

    The only question for standards is if they’re properly managed: That is, clear specifications, stable release engineering, open access for third parties. Xiph.org has shown to be able to provide that.

    If someone wants to provide their own video standard, they’re free to do so. And prove over time that they’re doing a good job managing a standard.

    But that’s probably a matter of belief, similar to the difference between "big government" (ISO and their ilk) and "individual reponsibility" (lots of standards by whoever cares enough to manage them).

    Given the track record of ISO, I’ll stick to the Xiph.org model.

  168. Anonymous says:

    Here’s all anyone needs to know about MPEG-LA: they write one thing and say another.

  169. Anonymous says:

    @PG

    Theora is not a standard an it takes nearly twice the bitrate to deliver the same quality video as the h.264 which is an actual standard.

    Worthless as an option for internet video.

  170. Anonymous says:

    I think one big thing that people would like to hear is using plugins, can you extend what the video tag supports?

    The post says you can use plugins to use codecs, but nothing mentions extending what the video tag supports.

    So could there be an outright yes or no answer for this? (This should help keep the theora people quiet knowing that IE isn’t limited to just h264 if you can extend the video tag.)

  171. Anonymous says:

    @Noname

    Microsoft themself will not make such a plugin but anybody else could.

  172. Anonymous says:

    I know that, but the whole point of my post was to have at least a semi-official yes or no on the video tag can be extended to support additional video types.

    With who writes the plugin, I don’t care, in the end I know that support in a lot of cases means "if you can do it, good for you, but don’t come crying to us if it breaks." All I care about is whether you can do it.

  173. Leo Davidson says:

    @hAl, AFAIK MS have not specified which kinds of plugins they mean, which I think is what Noname is getting at.

    If people can only write the current styles of plugins then there is no way to extend which video tags IE supports (at least as I understand the plugin APIs).

    They would not be able to make it so that a web author could simply specify a Theora (or whatever) file as the target of a video tag. Instead, the cumbersome embed/object tags would have to be used (just like with Flash today) and all of the browser’s native video UI would be lost or have to be reproduced (again, just like Flash today). Such a video plugin would have little to offer over what Flash gives us today, other than the codec itself.

    OTOH, if IE9 has an API for supplying video codec plugins then that’s different.

    PS: Not sure what you mean when you say one format isn’t a standard because it isn’t as high quality as some other format. Since when has that been the case? By that logic, MP3, MPEG2, JPEG, GIF, XML and a whole heap of things would not be standards as for each of them there exists something which is technically better.

  174. Anonymous says:

    FYI, here’s an excellent overview of H.264 licensing:

    http://www.engadget.com/2010/05/04/know-your-rights-h-264-patent-licensing-and-you/

  175. Anonymous says:

    One thing I still don’t understand: why are people pissed at *Microsoft* for not including Theora/Vorbis/Ogg support in IE9? Shouldn’t you all be mad at W3C for not specifying mandatory video/audio codecs in the HTML5 specification to start with? Microsoft is no more right or wrong in choosing H.264 than Mozilla is right or wrong in choosing Theora – both choices are compliant with the current spec draft! If you want Theora/Vorbis/Ogg to be supported in every browser, then W3C should explicitly say so in the HTML5 spec! Being mad at a company for not doing what they were never required to do in the first place just seems kind of passive aggressive to me.

    Imagine I was throwing a party tonight and I invited you. You ask me what food you should bring to the party and I say, "Whatever you want". You show up at the party with a cheese platter. Can I really be mad at you because you didn’t bring chips too? I don’t think so. After all, I did say "bring anything"!

    Sorry if I’m oversimplifying the issue, but it just seems to me that all this time and effort spent venting at Microsoft would be much better spent venting at W3C and pressuring them to be clearer in the HTML5 video specification. If Microsoft truly is committed to fully supporting the HTML5 spec, then you stand a better chance getting Theora/Vorbis support in IE9 (or IE10) if those codecs are in the spec to start with.

  176. Anonymous says:

    One thing I should make clear then. I’m not annoyed at Microsoft choosing h264. They have the right to choose what format they use and to be honest, I don’t care too much about theora or vorbis.

    The whole purpose of what I’m doing is to hopefully stop those people whining on and on. In both posts on the video tag supporting h264 the wording of the posts didn’t help too much and it has been left implied that the video tag is limited to just a certain set of Microsoft chosen formats and you are left using plugins to get other formats to play, but it will be like flash to use.

    If you think about it, if someone comes back and says, "Yes it is possible" then all of those people whining on will be silenced. This means that it won’t be directly supported by Microsoft themselves but someone can go out and add Theora support to the Video tag. (Although there are bound to be a few die hard complainers who will continue saying that Microsoft should be writing the codecs.) On the other hand, if someone says "No it isn’t possible" then I won’t really care either way. It just means my quest to silence the moaners failed.

    I like places like the IEBlog, yes there is always some glossing over of how things are going but that is expected. I just want to find a way to make a lot of these very annoying comments to go away. I also thought that having one fairly constructive question on the topic rather than lots and lots of people bashing while there is still no complete information on the topic.

  177. Anonymous says:

    Every so called advantage of H.264 mentioned would be equally true of a true open and royalty free industry standard.  Clinging to these proprietary formats harms the public.  They are covered by patents of dubious quality forcing people to purchase licenses directly or indirectly as a form of tax on everything. All evidence that these proprietary formats are a greater benefit than a harm to the public is purely subjective.  People believe or disbelieve these things as they suit their agendas.

    As an engineer, I do not believe that any patent on a file format is legitimate.  Encoding video into a file is not patentable in and of itself since the need for it makes the innovation obvious.  And just what is innovative by a compression technique?  These have been known for decades.  Nothing new there either.

  178. Anonymous says:

    <blockquote>Every so called advantage of H.264 mentioned would be equally true of a true open and royalty free industry standard</blockquote>

    Then name us which true open and royalty free standard:

    * Is an ISO/IEC standard

    * Combines the same quality/compression ratio

    * Is a current Blu ray standard

    * Is a codec used for digital TV broadcasting

    * Has hardware support in hundreds of millions of devices

    * Is widely supported in video en entertainment software

    Possibly if a codec provides all of the above advantage and also is open and royalty free there could be reason for complaints about the descision to use h.264 as the codec for the video tag in IE9.  

  179. Anonymous says:

    @Matt:

    "Dan, it’s both foolish and impolite to ask questions when their answers are contained in the original posting."

    It doesn’t say why Microsoft have suddenly decided to worry about codec patents in IE when every other program of theirs uses DirectShow and works with whatever codec the user wishes to install.

    It doesn’t say why Microsoft have decided that using user-installed codecs to access video on the Internet can be dangerous in IE when Media Player does exactly that already.

    It doesn’t say why Microsoft have decided to block everything that isn’t H.264 on quality grounds when they’re happy to have Media Center play anything.

    The answers are not contained in the original psot.

  180. Leo Davidson says:

    @Charlie,

    Some people *are* angry with the W3C for not mandating a codec. However, if you read up on the issue you’ll find that the W3C wanted to specify a codec in the standard but the participants could not agree on one.

    Apple *refused* to support Theora.

    Mozilla *refused* to support H.264.

    Google were happy to support either or both.

    Microsoft, meanwhile (AFAIK anyway), had not weighed in on the issue until now. So it’s not that (different groups of) people have not been angry with the other players; it’s just that the anger with Microsoft is fresher.

    The W3C decided that there was no point specifying things in a standard which they knew implementers would actively ignore. I’m not sure that was the right thing to do but I can see their reasoning. A big goal of HTML5 seems to be to create a spec which really is (eventually) implemented in its entirety, unlike HTML4.

    For better or worse, standards don’t actually mean much when they conflict with business (etc.) interests and the W3C has no power to dictate anything to anyone.

    Leaving the codec out of the spec. punted the responsibility for choosing a common codec over to the browser makers. Those browser makers have failed to agree on a common codec. Every player (except maybe Google) has attracted some anger from some people over the matter.

  181. Anonymous says:

    nobodyinparticular sez <<<Encoding video into a file is not patentable in and of itself since the need for it makes the innovation obvious>>>

    Your remark makes your complete lack of understanding of patent law obvious. If you’re going to play fake-lawyer, you need to do at least a little bit of research.

  182. Anonymous says:

    @hAl:

    Whether Theora is a standard depends on the definition of a standard. It definitely fits mine (stable, properly specified, accessible to third parties).

    For quality, the specification doesn’t say anything about quality. See the improvements between the libtheora 1.0 and 1.1 implementations, and those that happened after 1.1. It’s catching up, and it definitely has a need to do, but it has more room for improvement than h.264. All those improvements happen within the standard.

    Your list of devices that use h.264 (Bluray, digital broadcasting and all those devices) is actually an example of the issues h.264 faces: Thanks to the complexity of "design by committee", where everyone tried to get their own pet feature in, to improve leverage in the licensing business, h.264 is segmented into various profiles.

    So you have a valid h.264 data stream on Bluray but can’t play that stream on the iPhone (and most other portable devices) as only the baseline profile is supported on the latter. digital broadcasting uses another set of h.264 features, as does the encoding in studio workflows.

    For the web, this means that only h.264 baseline will be universally used (to support the growing segment of mobile internet). So any quality comparison between codecs in the context of web-video must be with h.264 baseline to be meaningful.

    When you get your hands on a h.264 stream you’ll have to look first if the used features are all supported by your codec (ever had those spurious defects in mpeg4 video? Those might have come from different support for specified features).

    Theora will just work.

  183. Anonymous says:

    No reason to artificially limit IE9 users to a single codec, other than ‘business strategy’.

    You people are so unbelievably selfish. Can’t you just make a decent browser that supports as many codecs as possible? It costs you nothing but development time, and your bank account is full.

    And stop pretending your decisions are in the customer’s interest. The only decisions you make support your bottom line, and we all know it. So very predictable.

  184. Anonymous says:

    @Dan:

    Your original question of "Or would it be something to do with Microsoft using IE as a tool to help cash in in the future on the H.264 patents that they own?" WAS in fact addressed in the original post. It’s been pointed out that Microsoft pays more to MPEG-LA to license H.264 than it actually gets back from it in royalties. BTW, anybody who thinks that codec royalties amount to some significant amount of cash – you’re mistaken. We’re talking about pennies per unit. For a company the size of Microsoft the amount of money it gets from codec royalties is a drop in the bucket – certainly not enough to be worth changing entire IE strategies for.

    @PG:

    "Theora will just work."

    Really? A mobile phone will decode 1080p Theora video without a hitch? I sincerely doubt that.

    Your point about H.264 profiles and their fragmented support is valid, but you’re missing the real point: not all playback devices have the same processing power so profiles were defined in order to create conformance guidelines. In other words, profiles are not what make H.264 support fragmented. Even if you took the profiles out of the spec, you’d still need some way to say "this device will play H.264 video but only up to 720×576 25 fps progressive with 4:2:0 subsampling because it doesn’t have the CPU power to handle anything more". If all decoders could handle 1080p 60 fps 4:4:4 video, there’d be no need for profiles.

  185. Anonymous says:

    @Alex:

    This is true, until the licence is changed in 2015 and Microsoft can decide how that licence is changed as they form a part of MPEG-LA.

    I’m sure they’re willing to invest in corning the market by making something free for the consumer before reaping the rewards later on, it’s not as if it’s the first time it’s happened. The decisions taken now seem to point to that end, if it were otherwise they would use DirectShow like any other piece of Windows software to allow the user the freedom to view whatever website they want.

  186. Anonymous says:

    What is the top speed at which browsers can run SunSpider? I guess the answer is going to be ZERO SECONDS.

    I just ran this test on my 2 yr laptop on Chrome 5.0.396 dev channel build and 10/26 of the tests are actually running in 0 seconds (See the Chrome reults here at http://tinyurl.com/25eeswh)

    Come-on IE, catch up. It should not be hard to do all the work in no time … !!!

  187. Anonymous says:

    Wow. People. Seriously. Read the post. The number of comments above that show complete ignorance of the original article is staggering.

    Read it again with perhaps a bit more of an open mind and maybe some more education on the actual issues involved.

    Open source codecs are not a solution to the problem that H.264 addresses for Microsoft. Those codecs may be "open", but that does not mean that they have been legally vetted against patent infringement.

    etc. etc. etc.

    It’s all there in the post as to why Microsoft isn’t supporting other codecs out of the box. If you really want others, then install them. Nobody is stopping you. IE9 supports the plug-in architecture needed for other codecs.

    Stop whining.

  188. Anonymous says:

    @Ryan Smyth:

    « but that does not mean that they have been legally vetted against patent infringement »

    Theora is basically just an improved version of a former proprietary codecs older than 10 years. The original was very likely carefully avoiding any patents and so did the contributers to the open source project. The chances for patent infringement are low, the chances for infringement of patents Microsoft has not already licensed are even lower. Really, how can anybody believe that patents are the issue here. Google had no problem including Theora/Vorbis support, why does Microsoft.

  189. Anonymous says:

    <<<The original was very likely carefully avoiding any patents and so did the contributers to the open source project.>>>

    Your overwhelming naivete would be quaint were it not so dangerous. Please leave the lawyering to those who have a legal education.

  190. Anonymous says:

    @Dam:

    Microsoft does not form part of MPEG-LA – you should check your facts. MPEG-LA is an independent firm that governs the licensing of certain codecs. Some of those codecs have patent pools, but the companies in the patent pools don’t control MPEG-LA. MPEG-LA doesn’t actually own the patents, it’s just a service provider.

    I can’t tell if you’re just uninformed or if you enjoy making wild speculations, but either way, your theory about Microsoft’s world domination by way of surprise H.264 royalties doesn’t add up due to the fact that it goes against both facts and common business sense.

    @Wurst:

    I agree with Matt – you’re being very naive. Theora (VP3) is a DCT-based codec just like every other MPEG codec (including H.264) and VC-1, and considering that nearly every step of the traditional DCT compression process is patented, it’s virtually impossible to construct a DCT-based codec without accidentally stomping on somebody’s patent. While I think it’s completely asinine that basic math operations can be patented, the fact still remains that they are and no amount of pretending they’re not is going to make those patents go away.

    The only reason Theora hasn’t been sued for patent infringement yet is because nobody has bothered to do it yet. The financial benefit of sueing a non-profit organization is dubious at best. But does that make Theora "patent free"? No. Just because some 40-yr old Ford Pinto hasn’t been in a car accident for 40 years doesn’t make it safe either.

    Anybody who doesn’t understand why codecs are a patent minefield should do a simple patent search: http://www.google.com/patents?q=discrete+cosine+transform