Application Compatibility Testing — International


This post continues the discussion of Compatibility testing from our test team.  –Steven


In the previous blog post “Application Compatibility Testing for Windows 7” we talked about the importance of Application Compatibility and work we are doing to engineer this in Windows 7. In this post we will examine the challenge that emerges as we consider the world wide audience that Windows serves.


This blog post will cover the following areas:



  • Overall International App Compatibility Strategy

  • Approach to International App Compatibility

  • Application Acquisition

  • Testing Applications

  • Measuring our Success

  • What it means to “Rescue An Application”

For Windows 7 we have made significant investment in application compatibility, ensuring applications that worked on Vista, continue to work on Windows 7 and we’ve also rescued some applications that were broken in Vista to work on Windows 7 (more on that later).  As we’ve talked about, there are some applications that are OS version specific by design (utilities, firewalls, security, etc.) and those are not included in this discussion.


Approach


One of the biggest challenges in International Application Compatibility is what applications we test, the scale of testing, and what it means for us to say that an application “works”.  For Windows 7 we are testing over 1200 applications across 25 specific markets.   We have improved our coverage over Vista by adding over 300 more international applications.


We look at applications in 3 buckets.



  1. Global ISV (GISV) Applications – Localized software sold by major ISVs in several international markets as well as the United States.

  2. Microsoft (MS) Localized Applications – Microsoft software that has been localized for use in other markets other than the United States.

  3. 3rd Party Local Applications – Software where the user interface language is not-English and the application is sold in non-English speaking markets (for example, IchiTaro – Japanese Word Processor, Парус 8 – Russian ERP system,)

Categories 1 & 2 are pretty straightforward.  There are a known set of key applications and scenarios used around the world and we must ensure these applications function in Windows 7.  Category #3 is where there is some complexity.


The applications list we build for 3rd Party Local Applications is built using a number of methods. First, we build on the list of applications we have used in previous versions Windows (XP/Vista, etc). If it worked on Vista, it must work on Windows 7. 


Next we work with our teams in markets around the world to rank top applications in particular markets.  It is amazing to see the diversity in application use around the world.   The application testing list is based on a combination of market data where it is available, individual knowledge of markets, culture, revenue, usage and even sometimes just “word on the street”.  The cultural knowledge in these markets is probably most critical to our success. For example, casual gaming in Korea is hugely popular and we need to ensure our Windows 7 testing accounts for this. 


Our goal in selecting applications is to test as many applications as we can that will expose the most issues across different scenarios and markets. 


These scenarios include:



  • Productivity

  • Memories (photo editing and sharing apps, etc.)

  • Graphics

  • Productivity

  • Music

  • Fundamentals (security, data backup, etc.)

  • TV/Movies

Application Acquisition


Once we build the list of applications we need to test the next process is acquiring them.  We acquire applications in a variety of ways but many times we have to buy an application from a retail store just as any end user would.  Other methods we use to acquire applications include downloading full featured trial versions, purchasing software, and working with ISVs to acquire their applications to ensure compatibility.


Testing Applications


Testing applications means more than just installing them and making sure they launch.  Every application gets a unique test plan written for it to cover as much functionality as we can.  We write test cases to cover primary and secondary application functions – for our word processing example this would include opening a file, typing a letter, adjusting formatting, save, and print, emailing a copy to someone, etc.  These applications go through 6 or more test passes during the product cycle.


Now, we can’t test every piece of every application and we do run into some interesting challenges when we focus on a worldwide audience.  Many applications depend on location specific information (meaning if you aren’t testing the application in that location – you aren’t likely to have the information needed).  Examples include  Brazilian citizen’s CPF ID, or Brazilian personal number of identification which would be required to test something like tax preparation software. We run into similar problems with SMS applications requiring active local mobile phone accounts.


What it means to Rescue an Application


Along with the core tenet of ensuring that any application that worked on Windows Vista also work on Windows 7 we have a stretch goal to “raise the bar” and make applications work on Windows 7 that never worked on Windows Vista. For Windows 7, we have some good news early in the development cycle.   So far we have made over 30 applications that were “broken” on Vista work on Windows 7.  This means that Windows 7 will have higher application compatibility than Windows Vista.  We are continuing to push this number up.  Below is a table of the # of applications by language that we have made to work on Windows 7 but didn’t’ work on Vista.



































































Language Number of
Apps Fixed
Example Applications
Arabic 1 Khalifa Cartoon Characters Creator
Chinese (Simplified) 1 Arcsoft WebCam Companion
Chinese (Traditional) 3

Asure Purchase/Sale/Stock Master 2008


Cyberlink DVD Suite v6


Asure Accounting Master 2008

Czech 1 J.K.R. BYZNYS
Danish 1 Bogskabet 3.2
German 2

QuickTime 7.1.6


Haufe Personal Office Professional – Haufe Formular-Manager

Hebrew 3

Compedia Timmy in English World


Compedia Moomins: The Search for the Ruby


Compedia The Puzzling Time Quest

Hungarian 1 Infocentrum Road Register
Italian 5

Finson Costo del Lavoro Italian v2


Finson Falco 6


Finson Progetto Condominio


Finson Contintasca 7


Finson ContinBanca

Japanese 5

PostPet v3


Kenchako Adventure 9.0


WZ Editor 5.0


QuickTime 7.1.6


Overland LOKI: with Japanese Manual

Norwegian 1 Visma Avendo Fakturering
Polish 2

WF-Fakturka dla Windows


Nahlik eTeacher 5

Portugese 1 Mr. Escola Win Port
Spanish 3

Mexico Federal Taxes Simplified SAT: Individual Taxes


Monografias Spanglish


IKEA Home Kitchen Planner

Turkish 1 MYTR Filter 2.6

Along with ensuring these applications work on Windows 7 we have taken an extra step for our existing Vista customers.  Of the applications outlined in the above table, 27 of the fixes we made have been back ported to Windows Vista for possible inclusion in future updates.   We really wanted to raise the bar for application compatibility and go beyond just looking at Vista as the baseline.


Takeaway


There is a lot of information here and hopefully gives you some insight into what it means for us to make the application experience (application compatibility)  on Windows 7 as high as possible for users around the world.  We started out with a goal of making sure if an application worked on Windows Vista it should work on Windows 7.  We have taken that further by bringing applications that never worked on Vista to work on Windows 7 and even future updates to Vista. 

Comments (60)

  1. consumer4beta@hotmail.com says:

    Are rescued English language apps deliberately excluded? Can you please rescue Visual Studio .NET 2003, Office XP and dozens of Microsoft apps that fail on Vista? Can you rescue VLC and Nero 6? That would be awesome.

  2. PsironTech says:

    Don’t most of the apps you just listed already have recently released Vista-compatible versions?

  3. domenico says:

    Excuse me OT.

    EU : Windows 7 is Welcomed

    http://news.bbc.co.uk/2/hi/technology/7932149.stm

    ENJOY!!

  4. RonV says:

    @Someone

    "Are rescued English language apps deliberately excluded?"

    Note the title of the article "International".

    "Can you please rescue….."

    Making a software application compatible does not include reviving outdated software that the vendor no longer supports. 🙂

  5. consumer4beta@hotmail.com says:

    Yeah I read the title but that’s what I wanted to know. Does MS only do "rescuing" for international apps? Also, note than when Vista debuted in 2006, for example, Visual Studio .NET 2003 was not obsolete by any measure of Microsoft’s definition and commitment to backward compatibility.

  6. hitman721 says:

    Steven,

    As someone who is apart of an multi-lingual household, both English and Spanish are apart of the daily lexicon. I’m sure this is very frequent across the United States. Besides English and Spanish, you’ve got this ethnic diversity across the US. Hebrew is spoken along with Yiddish. You guys understand that language diversity is strong in many countries. Microsoft and Windows by extention does support various languages and that is very commendable.

    However, if I might be allowed to be critical, Windows, Office, and many Microsoft created products don’t allow you to support switching languages very easy or on the fly. Also, I might add that Windows has been lacking a dictionary and thesarus functionality, which is something I’m sure users everywhere could definitely use. I would love to see the Windows 7 team work to make switching languages on the fly a whole lot easier. It would be nice if future versions of Windows have dictionary and thesarus functions, translation matrix to other languages, and web translation of foreign websites to English along with other languages.

    I know this is difficult at best. Some things do not translate easily or at all. This is also a mountain of work to do as well. However, starting with English, Spanish, French, Japanese, German, and the typical supported languages, this is something I recommend for the next version of Windows. Windows should facilitate not only translation and definition of words. I would love to see the ability to writing something in one language, then with a menu option it is translated to a different language. Not only in Office, but in the basic document formats of notepad and wordpad. I think it might be too late for Windows 7 since you guys are getting close to forking Windows 7 over to Release Candidate Escrow within the coming weeks.

    However, I’d love to see Windows 7 or the Next version of Windows coordinate with its local customization teams that know these languages to create dictionaries, thesarus, and work together to create a translation matrix.

    As someone who has had to work with a bi-lingual education teacher, this was something I discovered both from Office 2003 and Office 2007. Since Windows has the capabilities facilitate such a dictionary either internally or via a web supported function, this would be a great leap foward for Windows. Just a thought.

  7. steven_sinofsky says:

    @hitman721 — We do this very type of work though I can imagine that it is not entirely clear how it plays out for end-users.

    There’s several dimensions to the effort — some of these include:

    * Languages you can "type and read" — this is the support in Windows / Office for keyboards, input methods, fonts, scripts, and so on.

    * Locale you are using — this is the support for calendars, dates, currency, etc.

    * Linguistic features supported for input — this includes dictionaries, handwriting, speech, etc.

    * User interface of the OS — this is the language used for the Windows user interface

    * User interface for applications — this is the language used for the user interface of your applications and tools (such as Office)

    * Switching the user interface being used at any given time

    * Content translation — this is a relatively new item and is part of a free service in beta for web-based content and as a service for cut/paste of content and so on.

    All of these support multiple languages and all of them are available to you to use.  Some examples:

    * Windows supports all langauges for "type and read" out of the box.  In addition, you can support any locale out of the box as well.

    * Office provides support for Spanish, French, English linguistic tools in the English version.  

    * The UI langauge for Windows depends on the market but for Ultimate customers (for Vista) these "multi-lingual packs" were available on Windows Update.  Our enterprise customers receive these as part of volume licensing.  Each market has different language support in the UI depending on market needs.

    * Windows 7, if you have the language pack installed, supports switching the user interface.  There are also many tools for enterprise admins to customize how these are defaulted and made available.

    and so on…

    Windows itself does not have dictionaries that are used by ISVs.  There are many complexities associated with offering these globally as a Windows API and it is something we will continue to investigate.  This includes spelling within Internet Explorer.

    Beyond that I think our support for this area is pretty good.  If there is a specific scenario you have in mind let us know.

    –Steven

  8. Helmore says:

    Regarding multiple languages on a single OS install, it would be nice to set the Windows Userinterface language for each account separately, or is this already supported? This way you could have your own account in English and your wife’s account in Spanish for example. I’m not sure if this is not already supported though, I haven’t looked too much into the language options Windows offers.

  9. RonV says:

    @Someone

    When Vista was released in 2006, VS .NET 2003 was stil in the Mainstream Support phase. It wnet to the Extended Support phase in October 2008.

    You can see the details of this at:

    Microsoft Support Lifecycle:

    http://support.microsoft.com/lifecycle/?p1=3040

    and

    Microsoft Support Lifecycle Policy FAQ:

    http://support.microsoft.com/gp/lifepolicy

    Backward compatibility is a whole different issue.

    Also, see the recent article here from 3/3/2009 = Application Compatibility Testing — Overview.

    Regards.

  10. yken says:

    There is a very famous Quran Reader software thas working with Xp and broke with Vista annd now Win7. I have done everything to run it with Vista but it didnot. İt says control has no parent window. I wish there was a way for me

    to send this probbel to MS and let them fix but i did not know how.

  11. anonymuos says:

    @hitman721, you’re referring to the MUI feature of Windows? You’ll only get that in Ultimate and Enterprise, fully switching languages (including all UI elements) is indeed an "Ultimate" feature. You’ll get basic language switching in a Language Interface Pack (LIP) which is freely downloadable. As for the dictionary/thesaurus, you can buy a copy of Encarta 200x ($30) which includes a decent English dictionary/thesaurus with audio pronunciations. From what I’ve seen over the internet, there’s a huge demand from users for full MUI packs for lower SKUs but MS has not yet given in. Since Office 2007, buying MUI packs has been made easier though, no need to pay for languages you’ll never use.

  12. SaraSaraT says:

    @yken – what is the name of the Quran Reader software?

  13. Mantvydas says:

    30 international apps tested? That’s nothing to brag about. Count the amount of apps, that are available in US (probably thousands), and multiply by 100… this must be the amount of international apps available worldwide. US is just a small part of the world.

    I remember working in a worldwide company, where in american branch they’d develop some kind of solution in 9 months period, and they drop it out to all the rest of the world, and tell: you can implement it in the rest of the world in 3 months. C’mon, world is bigger than US.

  14. oliversz@microsoft.com says:

    Actually, we tested over 1200 applications and rescued 30.

    These are applications that now work on Windows 7 but did not work on Windows Vista.

    Regards.

  15. sdwolf says:

    First, my apologies for an off-topic reply, but this issue has had me scratching my head for a while now (and I have sent feedback about it).

    I’ve discovered an odd bug involving graphics adapters that have multiple outputs, or at least my particular graphics card (GeForce 7950 GT TDH 512MB made by evga).

    I only have a single display connected to this card.  Each time I boot Win7, I can see the startup animation.  But as soon as it switches screen modes to display the login screen, my display goes into powersave.  Win7 cuts the output from whatever port my monitor is using, and forces me to disconnect it and connect to the other port on the same card, which does have output.

    In other words, if the display is connected to port 1, I’m forced to reach behind my machine, disconnect the display, it and connect it to port 2 at startup, or vice-versa (vista merely mirrors the output to both ports).  So, no matter how I toy with it, Win7 will always send video out whatever port on that card is not connected at startup.

    To call this an annoyance is an understatement to say the least; thankfully I don’t reboot my machine that often.

    I wonder if anyone else has had this issue, and whether it’s a nVidia or MS problem, I hope it gets resolved in the RC.  🙂

    Thanks, and take care!

  16. steven_sinofsky says:

    @sdwolf

    We do test this card (on the list of graphics cards in a previous post).  

    If you could run dxdiag.exe and send me the output that would be a good step.

    –Steven

  17. yken says:

    Name of that Quran Reader program is Muallim 1.0

  18. domenico says:

    @Mr Steven

    Mr. Steven , Nvidia driver in DVI not work fine

    screen flash black  random (like UAC effect)

    this problem is already present in Vista x86 and X64 and Windows 7 Beta 7000 x86 and X64

    i try With Nvidia 8800 GTX and more user of Channel 9 have encountered the same problem.

    in VGA no problem and Notebook no problem.

    All version driver Nvidia have this "problem" in DVI

    -Domenico

  19. locolorenzo says:

    I only have a hand full of applications that do not work well in Windows 7, and all of them are only utilized for the drivers that are included for my Astronomical CCD Cameras.

    I have been very pleased with the installations of software in this new Operating System.

    ****

    @Steven

    Due to finacial restraints I would like one ploblem addressed and it follows the last couple of post, one of the most popular chipsets the Intel 852/855/915GM chipset are only installing the VGA drivers…I understand the problems with this chipset and wish that I could afford to use better but could you include some drivers that at least function like the Intel "pci_ven_8086&dev_3582" drivers.

    I love Aero but it really is not a need when sitting at a monitor taking Stellar Images…but support for a lot of compters would increase Microsofts share in the profitability of customers using Windows, and in these times of financial woe a lot of people would upgrade if the Operating system would at least support a poorly disigned chip set.

    I can supply drivers that work if needed.

    Lorne L. Reap

  20. oviradoi says:

    I have a feature request that has nothing to do with Application Compatibility Testing.

    I have an internal card reader with 4 card slots that creates 4 drive letters in My computer. This is sort of annoying that they appear there when I don’t need them.

    I think it would be great if you could create an option for removable drives to only show the drive letter in my computer if a disk is actually inserted. That way, I would get one letter if I plug in one card.

    That would be so great.

  21. boss_kevin_boss@hotmail.com says:

    Like that…but hope you do that not whith hacks in windows…if a developer works bad…do not fix his work, say him that he need to do that…

    Off topic: http://www.windowslivetranslator.com/BV.aspx?ref=Internal#http://winfuture.de/news,45819.html

    What is about that? True? Cant belive…

  22. hitman721 says:

    Steven,

    I think you thoroghly covered a lot of what I was looking for. Thank you so much for clearing this up. I definitely appreciate the feedback. You’ve made my job here working a whole lot easier.

    Jose.

  23. ryancapp says:

    @oviradoi:

    It already exists: Organize -> Folder and search options -> View (tab) -> "Hide empty drives in the Computer folder"

  24. iam2cool says:

    There is a program called foldit and you fold proteins for science, now running foldit under win 7 is very slow making it unplayable, but in winvista and xp it runs smooth, and ive tried the compability settings with 7 with no luck, any suggestions?  you can download the program here

    http://fold.it/portal/

  25. nkhs9412235 says:

    Hello,

    I used Windows 7 7057 to run a game named Fantasy Earth Zero,but it will show error message.

    I used capability function, but it didn’t work!

  26. nkhs9412235 says:

    Hello,

     I used Windows 7 to run a game named Fantasy Earth Zero, but it showed error message.

     Then,I tried to use compatibility function,it still caan’t work!

  27. r_abear says:

    Like me, one reason I will be buying Windows 7 is for games.  I downloaded an old game from GOG, Freespace2, and I bet there are at least 2 or 3 from engineering who played and loved that game.  It’s running on XP though I hope it will be better in Windows 7.

    There is also OpenAL. I hope it will be compatible as DirectX may not be everything especially for old games.  Why OpenAL?  The current FreeSpace2 derivative, Beyond the Red Line, uses OpenAL.  It runs on XP well, the response and battle is better.

    Thanks in advance 🙂

  28. macdet says:

    This is an very usefull aritcle. Thx.

  29. bnta1 says:

    <strong><a title="شات صوتي" href="http://www.bnta1.com/">شات صوتي</a></strong>

  30. bnta1 says:

    eLink" title="شات صوتي" href="http://www.bnta1.com&quot; target="_blank">شات صوتي</a>

  31. Term Paper Help says:

    Why OpenAL?  The current FreeSpace2 derivative, Beyond the Red Line, uses OpenAL.  It runs on XP well, the response and battle is better.

  32. Research Papers says:

    but in winvista and xp it runs smooth, and ive tried the compability settings with 7 with no luck, any suggestions?  you can download the program here

  33. Thesis Service says:

    but support for a lot of compters would increase Microsofts share in the profitability of customers using Windows, and in these times of financial woe a lot of people would upgrade if the Operating system would at least support a poorly disigned chip set.

  34. Custom Dissertation says:

    I can see the startup animation.  But as soon as it switches screen modes to display the login screen, my display goes into powersave.  Win7 cuts the output from whatever port my monitor is using, and forces me to disconnect it and connect to the other port on the same card, which does have output.

  35. Custom Essay says:

    There are many complexities associated with offering these globally as a Windows API and it is something we will continue to investigate.  This includes spelling within Internet Explorer.

  36. Avea says:

    Don’t most of the apps you just listed already have recently released Vista-compatible versions?

  37. mervin.cena says:

    There are many complexities associated with offering these globally as a Windows API and it is something we will continue to investigate.  This includes spelling within Internet Explorer.

  38. vikojhons says:

    I would like to see Windows 7 to be more games oriented with better processing for graphics and sound.

  39. essay writing says:

    I guess that if Microsoft is to introduce Windows 7 as the follower to Vista, they really need to improve performance. I have a Quad CPU proc with 8 gb of ram and I can’t say that performance is so great with Vista.

  40. Gotomeeting Promo Code says:

    Vista was so riddled with performance issues it’s not even funny. Microsoft’s reputation is on the line – they’d better pull something special out of the bag with Windows 7, or watch as Google takes over. And I don’t think anyone wants the company that essentially owns the internet to own operating systems as-well..

  41. Discount Voucher says:

    I had difficulties with vista regarding compatability. I hope Windows 7 will be better in this respect.

  42. UK dissertation says:

    Great article, Windows 7 as the follower to Vista, they really need to improve performance, this is informative post please keep on posting

    thanks!!

  43. ipang says:

    I personally use windows 7 beta version, it has been working great for the past 2-3 months or so. first I hesitate to use, as windows vista for really a bad product after all. Anyway let see how it goes and let see in the next few months and new update / release from microsoft.

  44. vikojhons says:

       Yeah, definitely  <a href="http://www.genuinewriting.com">custom written essay</a>

      Thank you.

  45. vikojhons says:

    Ohh!! It such a nice style of writing, i have just one suggestion if you try to speak

    more delightfully you need to buy essay

    and learn some phrasal words…

  46. toms1202 says:

    I hope windows 7 is better than the disappointing Vista

  47. Vista really wa a disappointment. Windows 7 is much, much better.

  48. I do like your challenges: one of the biggest challenges in International Application Compatibility is what applications we test, the scale of testing, and what it means for us to say that an application “works”.

  49. zenithsocial says:

    Ich hoffe, es wird als DirectX kann nicht alles sein, vor allem für alte Spiele kompatibel. Warum OpenAL? Die aktuelle FreeSpace2 Derivat, Beyond the Red Line, nutzt OpenAL. Es läuft unter XP auch, ist die Antwort und kämpfen besser.

  50. Nice Blog. I am fed up with using all the cheap windows..!! I hope windows 7 will satisfied me with all its features. Thanks For sharing.

    <a href="http://www.research-paper.us">research paper</a>,

    <a href="http://www.research-paper.us">Term Paper</a>

  51. AndyWks says:

    I would really love to see Windows 7 or the Next version of OS coordinate with its local customization teams that know these native languages to create dictionaries, thesarus, and work hard to create a translation matrix. As someone above me already mentioned

  52. I am waiting before i try windows 7 as usally it start off filled with bugs and problems, when windows 8 comes out maybe ill buy 7.. maybe

  53. Windows 7 is much quicker than vista

  54. mahjong says:

    Windows 7 is really useful system. This is not Vista, W7 like very much. Windows Xp can now be replaced by W7, without any regret.

  55. an now be replaced by W7, without an

  56. Alergia says:

    . You’ll get basic language switching in a Language Interface Pack (LIP) which is freely downloadable. As for the dictionary/thesaurus, you can buy a copy of Encarta 200x ($30) which includes a decent English dictionary/thesaurus with audio pronunciations

  57. Coe Case says:

    I have many programs written for the first Windows program, and one written for MS DOS which I was able to install and run on Win XP, but I find no way to run on Windows 7. The sources no longer exist so no updates are available. Is there a Windows 7 solution?

Skip to main content